[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:22:43 dist-test-slave-pgkr krb5kdc[11671](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:22:43 dist-test-slave-pgkr krb5kdc[11671](info): set up 2 sockets
Aug 09 09:22:43 dist-test-slave-pgkr krb5kdc[11671](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260809 09:22:44.152976 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.056s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:22:44 dist-test-slave-pgkr krb5kdc[11671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267364, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:22:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:22:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:22:44.271670 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:44791
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:44565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:44791
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:22:44.379074 11685 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:22:44.379326 11685 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:22:44.379365 11685 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:22:44.383188 11685 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:22:44.383234 11685 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:22:44.383252 11685 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:22:44.383268 11685 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:22:44.383317 11685 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:22:44.388350 11685 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:44565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:44791
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:44791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11685
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:22:44.389258 11685 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:22:44.390165 11685 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:22:44.398808 11692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:44.398747 11694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:44.398833 11685 server_base.cc:1034] running on GCE node
W20260809 09:22:44.398747 11691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:44.399498 11685 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:22:44.400552 11685 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:22:44.401739 11685 hybrid_clock.cc:648] HybridClock initialized: now 1786267364401684 us; error 62 us; skew 500 ppm
Aug 09 09:22:44 dist-test-slave-pgkr krb5kdc[11671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267364, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:22:44.404645 11685 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:22:44.405504 11685 webserver.cc:460] Webserver started at http://127.11.99.254:32907/ using document root <none> and password file <none>
I20260809 09:22:44.406032 11685 fs_manager.cc:359] Metadata directory not provided
I20260809 09:22:44.406123 11685 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:22:44.406348 11685 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:22:44.408380 11685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "1d430fb65ad44c3d9cb521fd1adfe128"
format_stamp: "Formatted at 2026-08-09 09:22:44 on dist-test-slave-pgkr"
server_key: "269df698fe8d736fcef8f0d309e9da78"
server_key_iv: "799ce3d3af9d0aee30a227866f4f59ec"
server_key_version: "encryptionkey@0"
I20260809 09:22:44.408931 11685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "1d430fb65ad44c3d9cb521fd1adfe128"
format_stamp: "Formatted at 2026-08-09 09:22:44 on dist-test-slave-pgkr"
server_key: "269df698fe8d736fcef8f0d309e9da78"
server_key_iv: "799ce3d3af9d0aee30a227866f4f59ec"
server_key_version: "encryptionkey@0"
I20260809 09:22:44.412571 11685 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:22:44.414786 11703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:44.415822 11685 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:22:44.415962 11685 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "1d430fb65ad44c3d9cb521fd1adfe128"
format_stamp: "Formatted at 2026-08-09 09:22:44 on dist-test-slave-pgkr"
server_key: "269df698fe8d736fcef8f0d309e9da78"
server_key_iv: "799ce3d3af9d0aee30a227866f4f59ec"
server_key_version: "encryptionkey@0"
I20260809 09:22:44.416064 11685 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:22:44.439153 11685 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:22:44.442327 11685 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:22:44.442538 11685 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:22:44.449631 11685 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:44791
I20260809 09:22:44.449657 11761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:44791 every 8 connection(s)
I20260809 09:22:44.450462 11685 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:22:44.453003 11762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:44.458290 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 11685
I20260809 09:22:44.458447 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:22:44.458536 11762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d430fb65ad44c3d9cb521fd1adfe128: Bootstrap starting.
I20260809 09:22:44.460009 11663 external_mini_cluster.cc:1428] Setting key 0cb7dcb2d4a75945e4d2daf923c3f052
I20260809 09:22:44.461387 11762 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d430fb65ad44c3d9cb521fd1adfe128: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:44.462214 11762 log.cc:824] T 00000000000000000000000000000000 P 1d430fb65ad44c3d9cb521fd1adfe128: Log is configured to *not* fsync() on all Append() calls
I20260809 09:22:44.464442 11762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d430fb65ad44c3d9cb521fd1adfe128: No bootstrap required, opened a new log
I20260809 09:22:44.468204 11762 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d430fb65ad44c3d9cb521fd1adfe128 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d430fb65ad44c3d9cb521fd1adfe128" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 44791 } }
I20260809 09:22:44.468436 11762 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1d430fb65ad44c3d9cb521fd1adfe128 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:44.468499 11762 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d430fb65ad44c3d9cb521fd1adfe128 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d430fb65ad44c3d9cb521fd1adfe128, State: Initialized, Role: FOLLOWER
I20260809 09:22:44.468930 11762 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d430fb65ad44c3d9cb521fd1adfe128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d430fb65ad44c3d9cb521fd1adfe128" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 44791 } }
I20260809 09:22:44.469069 11762 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d430fb65ad44c3d9cb521fd1adfe128 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:22:44.469147 11762 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d430fb65ad44c3d9cb521fd1adfe128 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:22:44.469264 11762 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d430fb65ad44c3d9cb521fd1adfe128 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:44.470140 11762 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d430fb65ad44c3d9cb521fd1adfe128 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d430fb65ad44c3d9cb521fd1adfe128" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 44791 } }
I20260809 09:22:44.470472 11762 leader_election.cc:302] T 00000000000000000000000000000000 P 1d430fb65ad44c3d9cb521fd1adfe128 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d430fb65ad44c3d9cb521fd1adfe128; no voters:
I20260809 09:22:44.470777 11762 leader_election.cc:288] T 00000000000000000000000000000000 P 1d430fb65ad44c3d9cb521fd1adfe128 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:22:44.470873 11767 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d430fb65ad44c3d9cb521fd1adfe128 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:22:44.471078 11767 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d430fb65ad44c3d9cb521fd1adfe128 [term 1 LEADER]: Becoming Leader. State: Replica: 1d430fb65ad44c3d9cb521fd1adfe128, State: Running, Role: LEADER
I20260809 09:22:44.471354 11767 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d430fb65ad44c3d9cb521fd1adfe128 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d430fb65ad44c3d9cb521fd1adfe128" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 44791 } }
I20260809 09:22:44.471936 11762 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d430fb65ad44c3d9cb521fd1adfe128 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:22:44.472582 11770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d430fb65ad44c3d9cb521fd1adfe128 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d430fb65ad44c3d9cb521fd1adfe128. Latest consensus state: current_term: 1 leader_uuid: "1d430fb65ad44c3d9cb521fd1adfe128" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d430fb65ad44c3d9cb521fd1adfe128" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 44791 } } }
I20260809 09:22:44.472694 11770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d430fb65ad44c3d9cb521fd1adfe128 [sys.catalog]: This master's current role is: LEADER
I20260809 09:22:44.473363 11768 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d430fb65ad44c3d9cb521fd1adfe128 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d430fb65ad44c3d9cb521fd1adfe128" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d430fb65ad44c3d9cb521fd1adfe128" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 44791 } } }
I20260809 09:22:44.473455 11768 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d430fb65ad44c3d9cb521fd1adfe128 [sys.catalog]: This master's current role is: LEADER
I20260809 09:22:44.473685 11773 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:22:44.476598 11773 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 09:22:44 dist-test-slave-pgkr krb5kdc[11671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267364, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:22:44.483443 11773 catalog_manager.cc:1347] Generated new cluster ID: 570ede107e014573a9147141d732d73b
I20260809 09:22:44.483549 11773 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:22:44.485682 11765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:44.463243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44966 (local address 127.11.99.254:44791)
0809 09:22:44.463599 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:44.463613 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:44.464916 (+ 1303us) server_negotiation.cc:407] Connection header received
0809 09:22:44.467858 (+ 2942us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:44.467870 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:44.468140 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:44.468435 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:44.470648 (+ 2213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:44.472136 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:44.473983 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:44.474717 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:44.474870 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:44.480219 (+ 5349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:44.480234 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:44.480248 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:44.480294 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:44.481974 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:44.482597 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:44.482603 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:44.482609 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:44.482779 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:44.483183 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:44.483187 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:44.483189 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:44.483741 (+ 552us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:44.483970 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:44.484492 (+ 522us) server_negotiation.cc:299] Negotiation successful
0809 09:22:44.484801 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":112,"threads_started":1}
I20260809 09:22:44.491472 11773 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:22:44.492185 11773 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:22:44.499490 11773 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1d430fb65ad44c3d9cb521fd1adfe128: Generated new TSK 0
I20260809 09:22:44.500052 11773 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.99.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
I20260809 09:22:44.531991 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:0
--local_ip_for_outbound_sockets=127.11.99.193
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:44791
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:44565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:22:44.661334 11793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:22:44.661546 11793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:22:44.661585 11793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:22:44.665360 11793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:22:44.665411 11793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:22:44.665513 11793 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:22:44.670284 11793 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:44565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:44791
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11793
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:22:44.671201 11793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:22:44.672358 11793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:22:44.681876 11801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:44.681970 11799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:44.682010 11798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:44.682165 11793 server_base.cc:1034] running on GCE node
I20260809 09:22:44.682667 11793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:22:44.683323 11793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:22:44.684517 11793 hybrid_clock.cc:648] HybridClock initialized: now 1786267364684497 us; error 35 us; skew 500 ppm
Aug 09 09:22:44 dist-test-slave-pgkr krb5kdc[11671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267364, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:22:44.687325 11793 init.cc:377] Logged in from keytab as kudu/127.11.99.193@KRBTEST.COM (short username kudu)
I20260809 09:22:44.688166 11793 webserver.cc:460] Webserver started at http://127.11.99.193:32889/ using document root <none> and password file <none>
I20260809 09:22:44.688705 11793 fs_manager.cc:359] Metadata directory not provided
I20260809 09:22:44.688800 11793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:22:44.689042 11793 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:22:44.691183 11793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-0/data/instance:
uuid: "afbd64214c9b4dccb6c1f02af3351359"
format_stamp: "Formatted at 2026-08-09 09:22:44 on dist-test-slave-pgkr"
server_key: "e4422299cde5d5965ee4442da9ebf775"
server_key_iv: "953075e7dff18f565e7cb605a249d76e"
server_key_version: "encryptionkey@0"
I20260809 09:22:44.691831 11793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance:
uuid: "afbd64214c9b4dccb6c1f02af3351359"
format_stamp: "Formatted at 2026-08-09 09:22:44 on dist-test-slave-pgkr"
server_key: "e4422299cde5d5965ee4442da9ebf775"
server_key_iv: "953075e7dff18f565e7cb605a249d76e"
server_key_version: "encryptionkey@0"
I20260809 09:22:44.695674 11793 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260809 09:22:44.697969 11810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:44.699105 11793 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 09:22:44.699258 11793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "afbd64214c9b4dccb6c1f02af3351359"
format_stamp: "Formatted at 2026-08-09 09:22:44 on dist-test-slave-pgkr"
server_key: "e4422299cde5d5965ee4442da9ebf775"
server_key_iv: "953075e7dff18f565e7cb605a249d76e"
server_key_version: "encryptionkey@0"
I20260809 09:22:44.699373 11793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:22:44.714758 11793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:22:44.717298 11793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:22:44.717516 11793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:22:44.718144 11793 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:22:44.719067 11793 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:22:44.719137 11793 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:44.719204 11793 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:22:44.719251 11793 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:44.731258 11793 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:46763
I20260809 09:22:44.731345 11930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:46763 every 8 connection(s)
I20260809 09:22:44.732152 11793 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:22:44.738400 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 11793
I20260809 09:22:44.738510 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance
I20260809 09:22:44.738787 11663 external_mini_cluster.cc:1428] Setting key ce6808b3e7cfffbc74ce6e0783c1dd5f
Aug 09 09:22:44 dist-test-slave-pgkr krb5kdc[11671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267364, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:22:44.746462 11765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:44.733986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:55441 (local address 127.11.99.254:44791)
0809 09:22:44.734134 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:44.734150 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:44.735235 (+ 1085us) server_negotiation.cc:407] Connection header received
0809 09:22:44.736107 (+ 872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:44.736109 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:44.736155 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:44.736232 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:44.737260 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:44.737788 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:44.739307 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:44.739598 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:44.739702 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:44.742320 (+ 2618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:44.742323 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:44.742325 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:44.742347 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:44.744104 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:44.744704 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:44.744707 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:44.744709 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:44.744836 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:44.745266 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:44.745269 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:44.745271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:44.745514 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:44.745618 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:44.746244 (+ 626us) server_negotiation.cc:299] Negotiation successful
0809 09:22:44.746349 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 09:22:44.747642 11933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:44.734347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:44791 (local address 127.11.99.193:55441)
0809 09:22:44.735115 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:44.735153 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:44.735932 (+ 779us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:44.736372 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:44.736378 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:44.736693 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:22:44.737115 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:44.737126 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:44.737894 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:44.737896 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:44.739157 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:44.739170 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:44.739743 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:44.739746 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:44.739889 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:44.740529 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:22:44.740551 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:22:44.742159 (+ 1608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:22:44.744237 (+ 2078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:44.744245 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:44.744260 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:44.744596 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:44.744948 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:44.744954 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:44.744959 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:44.745154 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:44.745643 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:22:44.745651 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:22:44.745963 (+ 312us) client_negotiation.cc:769] Sending connection context
0809 09:22:44.746174 (+ 211us) client_negotiation.cc:240] Negotiation successful
0809 09:22:44.746516 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":201,"threads_started":1}
I20260809 09:22:44.748888 11931 heartbeater.cc:347] Connected to a master server at 127.11.99.254:44791
I20260809 09:22:44.749118 11931 heartbeater.cc:464] Registering TS with master...
I20260809 09:22:44.749696 11931 heartbeater.cc:511] Master 127.11.99.254:44791 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.99.194@KRBTEST.COM; defaulting to no policy
I20260809 09:22:44.751351 11722 ts_manager.cc:194] Registered new tserver with Master: afbd64214c9b4dccb6c1f02af3351359 (127.11.99.193:46763)
I20260809 09:22:44.752511 11722 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.193@KRBTEST.COM'} at 127.11.99.193:55441
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
I20260809 09:22:44.767369 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:0
--local_ip_for_outbound_sockets=127.11.99.194
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:44791
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:44565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:22:44.882730 11936 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:22:44.882951 11936 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:22:44.883006 11936 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:22:44.886711 11936 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:22:44.886763 11936 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:22:44.886822 11936 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:22:44.891502 11936 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:44565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:44791
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11936
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:22:44.892359 11936 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:22:44.893285 11936 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:22:44.902727 11943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:44.902719 11942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:44.902848 11936 server_base.cc:1034] running on GCE node
W20260809 09:22:44.902727 11945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:44.903411 11936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:22:44.904011 11936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:22:44.905192 11936 hybrid_clock.cc:648] HybridClock initialized: now 1786267364905163 us; error 39 us; skew 500 ppm
Aug 09 09:22:44 dist-test-slave-pgkr krb5kdc[11671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267364, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:22:44.908347 11936 init.cc:377] Logged in from keytab as kudu/127.11.99.194@KRBTEST.COM (short username kudu)
I20260809 09:22:44.909286 11936 webserver.cc:460] Webserver started at http://127.11.99.194:44819/ using document root <none> and password file <none>
I20260809 09:22:44.909993 11936 fs_manager.cc:359] Metadata directory not provided
I20260809 09:22:44.910092 11936 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:22:44.910342 11936 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:22:44.912621 11936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-1/data/instance:
uuid: "7aa43d6c5fc64e4493b12927ecbd67c4"
format_stamp: "Formatted at 2026-08-09 09:22:44 on dist-test-slave-pgkr"
server_key: "f463f35dd7ef3410d5304e486aa5ab20"
server_key_iv: "7e9ebdf4b6ce1be9cdf01860ab2bcbf6"
server_key_version: "encryptionkey@0"
I20260809 09:22:44.913257 11936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance:
uuid: "7aa43d6c5fc64e4493b12927ecbd67c4"
format_stamp: "Formatted at 2026-08-09 09:22:44 on dist-test-slave-pgkr"
server_key: "f463f35dd7ef3410d5304e486aa5ab20"
server_key_iv: "7e9ebdf4b6ce1be9cdf01860ab2bcbf6"
server_key_version: "encryptionkey@0"
I20260809 09:22:44.917167 11936 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.005s
I20260809 09:22:44.919557 11952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:44.920739 11936 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:22:44.920871 11936 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "7aa43d6c5fc64e4493b12927ecbd67c4"
format_stamp: "Formatted at 2026-08-09 09:22:44 on dist-test-slave-pgkr"
server_key: "f463f35dd7ef3410d5304e486aa5ab20"
server_key_iv: "7e9ebdf4b6ce1be9cdf01860ab2bcbf6"
server_key_version: "encryptionkey@0"
I20260809 09:22:44.920981 11936 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:22:44.931051 11936 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:22:44.934031 11936 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:22:44.934295 11936 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:22:44.934958 11936 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:22:44.935717 11936 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:22:44.935789 11936 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:44.935854 11936 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:22:44.935907 11936 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:44.948077 11936 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:38691
I20260809 09:22:44.948100 12079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:38691 every 8 connection(s)
I20260809 09:22:44.948921 11936 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:22:44.953572 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 11936
I20260809 09:22:44.953688 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance
I20260809 09:22:44.953959 11663 external_mini_cluster.cc:1428] Setting key de49d977fdc51e3aff1a6462408f810a
Aug 09 09:22:44 dist-test-slave-pgkr krb5kdc[11671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267364, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:22:44.965016 11765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:44.950766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:60283 (local address 127.11.99.254:44791)
0809 09:22:44.950902 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:44.950906 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:44.951816 (+ 910us) server_negotiation.cc:407] Connection header received
0809 09:22:44.952768 (+ 952us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:44.952772 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:44.952836 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:44.952947 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:44.954393 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:44.955166 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:44.956904 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:44.957126 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:44.957216 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:44.960527 (+ 3311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:44.960530 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:44.960532 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:44.960559 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:44.962160 (+ 1601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:44.962886 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:44.962888 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:44.962890 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:44.962964 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:44.963487 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:44.963491 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:44.963493 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:44.963794 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:44.963903 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:44.964791 (+ 888us) server_negotiation.cc:299] Negotiation successful
0809 09:22:44.964895 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 09:22:44.966437 12083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:44.951025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:44791 (local address 127.11.99.194:60283)
0809 09:22:44.951677 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:44.951714 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:44.952565 (+ 851us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:44.953097 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:44.953103 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:44.953562 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:22:44.954247 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:44.954263 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:44.955314 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:44.955317 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:44.956753 (+ 1436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:44.956767 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:44.957304 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:44.957311 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:44.957583 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:44.958293 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:22:44.958318 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:22:44.960346 (+ 2028us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:22:44.962295 (+ 1949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:44.962304 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:44.962323 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:44.962775 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:44.963075 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:44.963080 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:44.963083 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:44.963333 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:44.964003 (+ 670us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:22:44.964012 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:22:44.964399 (+ 387us) client_negotiation.cc:769] Sending connection context
0809 09:22:44.964729 (+ 330us) client_negotiation.cc:240] Negotiation successful
0809 09:22:44.965142 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":134,"threads_started":1}
WARNING: no policy specified for kudu/127.11.99.195@KRBTEST.COM; defaulting to no policy
I20260809 09:22:44.967789 12080 heartbeater.cc:347] Connected to a master server at 127.11.99.254:44791
I20260809 09:22:44.968040 12080 heartbeater.cc:464] Registering TS with master...
I20260809 09:22:44.968657 12080 heartbeater.cc:511] Master 127.11.99.254:44791 requested a full tablet report, sending...
I20260809 09:22:44.969684 11722 ts_manager.cc:194] Registered new tserver with Master: 7aa43d6c5fc64e4493b12927ecbd67c4 (127.11.99.194:38691)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.195@KRBTEST.COM" created.
I20260809 09:22:44.970444 11722 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.194@KRBTEST.COM'} at 127.11.99.194:60283
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
I20260809 09:22:44.986260 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:0
--local_ip_for_outbound_sockets=127.11.99.195
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:44791
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:44565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:22:45.105315 12086 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:22:45.105568 12086 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:22:45.105664 12086 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:22:45.109830 12086 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:22:45.109949 12086 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:22:45.110040 12086 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:22:45.115357 12086 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:44565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:44791
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12086
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:22:45.116366 12086 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:22:45.117323 12086 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:22:45.127427 12091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:45.127496 12093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:45.127370 12098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:45.127599 12086 server_base.cc:1034] running on GCE node
I20260809 09:22:45.128022 12086 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:22:45.128656 12086 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:22:45.129848 12086 hybrid_clock.cc:648] HybridClock initialized: now 1786267365129833 us; error 33 us; skew 500 ppm
Aug 09 09:22:45 dist-test-slave-pgkr krb5kdc[11671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267365, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:22:45.132462 12086 init.cc:377] Logged in from keytab as kudu/127.11.99.195@KRBTEST.COM (short username kudu)
I20260809 09:22:45.133239 12086 webserver.cc:460] Webserver started at http://127.11.99.195:33433/ using document root <none> and password file <none>
I20260809 09:22:45.133801 12086 fs_manager.cc:359] Metadata directory not provided
I20260809 09:22:45.133890 12086 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:22:45.134112 12086 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:22:45.136193 12086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-2/data/instance:
uuid: "f171a3d31add4aef92875c04b6961f2a"
format_stamp: "Formatted at 2026-08-09 09:22:45 on dist-test-slave-pgkr"
server_key: "75b4dd9648e57f924da73ceb65c4261b"
server_key_iv: "5fda978de55fd4b96147d49722756e59"
server_key_version: "encryptionkey@0"
I20260809 09:22:45.136816 12086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance:
uuid: "f171a3d31add4aef92875c04b6961f2a"
format_stamp: "Formatted at 2026-08-09 09:22:45 on dist-test-slave-pgkr"
server_key: "75b4dd9648e57f924da73ceb65c4261b"
server_key_iv: "5fda978de55fd4b96147d49722756e59"
server_key_version: "encryptionkey@0"
I20260809 09:22:45.140353 12086 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 09:22:45.142431 12105 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:45.143553 12086 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 09:22:45.143676 12086 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "f171a3d31add4aef92875c04b6961f2a"
format_stamp: "Formatted at 2026-08-09 09:22:45 on dist-test-slave-pgkr"
server_key: "75b4dd9648e57f924da73ceb65c4261b"
server_key_iv: "5fda978de55fd4b96147d49722756e59"
server_key_version: "encryptionkey@0"
I20260809 09:22:45.143784 12086 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:22:45.158128 12086 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:22:45.160744 12086 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:22:45.160925 12086 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:22:45.161479 12086 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:22:45.162245 12086 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:22:45.162313 12086 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:45.162374 12086 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:22:45.162420 12086 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:45.175936 12086 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:34247
I20260809 09:22:45.176002 12239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:34247 every 8 connection(s)
I20260809 09:22:45.176806 12086 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:22:45.183317 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 12086
I20260809 09:22:45.183460 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance
I20260809 09:22:45.183723 11663 external_mini_cluster.cc:1428] Setting key 5f9ef7bc62cf55b8678d16c14fee0c31
Aug 09 09:22:45 dist-test-slave-pgkr krb5kdc[11671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267365, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:22:45.190116 11765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:45.178728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:33643 (local address 127.11.99.254:44791)
0809 09:22:45.178852 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:45.178855 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:45.179971 (+ 1116us) server_negotiation.cc:407] Connection header received
0809 09:22:45.180866 (+ 895us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:45.180869 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:45.180924 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:45.181032 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:45.182187 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:45.182768 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:45.184013 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:45.184300 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:45.184421 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:45.187093 (+ 2672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:45.187096 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:45.187098 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:45.187121 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:45.188480 (+ 1359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:45.188916 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:45.188919 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:45.188920 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:45.188989 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:45.189278 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:45.189280 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:45.189281 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:45.189434 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:45.189503 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:45.189911 (+ 408us) server_negotiation.cc:299] Negotiation successful
0809 09:22:45.190006 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 09:22:45.190944 12242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:45.179061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:44791 (local address 127.11.99.195:33643)
0809 09:22:45.179833 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:45.179871 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:45.180671 (+ 800us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:45.181201 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:45.181208 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:45.181557 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:22:45.182042 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:45.182056 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:45.182891 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:45.182895 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:45.183891 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:45.183902 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:45.184472 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:45.184477 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:45.184694 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:45.185323 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:22:45.185342 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:22:45.186936 (+ 1594us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:22:45.188579 (+ 1643us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:45.188583 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:45.188593 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:45.188831 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:45.189065 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:45.189068 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:45.189069 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:45.189203 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:45.189518 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:22:45.189522 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:22:45.189712 (+ 190us) client_negotiation.cc:769] Sending connection context
0809 09:22:45.189848 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 09:22:45.190086 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":151,"threads_started":1}
I20260809 09:22:45.191984 12240 heartbeater.cc:347] Connected to a master server at 127.11.99.254:44791
I20260809 09:22:45.192198 12240 heartbeater.cc:464] Registering TS with master...
I20260809 09:22:45.192667 12240 heartbeater.cc:511] Master 127.11.99.254:44791 requested a full tablet report, sending...
I20260809 09:22:45.193579 11722 ts_manager.cc:194] Registered new tserver with Master: f171a3d31add4aef92875c04b6961f2a (127.11.99.195:34247)
I20260809 09:22:45.194104 11722 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.195@KRBTEST.COM'} at 127.11.99.195:33643
I20260809 09:22:45.197853 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 09:22:45 dist-test-slave-pgkr krb5kdc[11671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267365, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 09:22:45 dist-test-slave-pgkr krb5kdc[11671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267365, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.99.193@KRBTEST.COM
I20260809 09:22:45.226006 12247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:45.215413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39350 (local address 127.11.99.193:46763)
0809 09:22:45.215724 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:45.215740 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:45.215838 (+ 98us) server_negotiation.cc:407] Connection header received
0809 09:22:45.216000 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:45.216013 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:45.216189 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:45.216410 (+ 221us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:45.217114 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:45.217920 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:45.218853 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:45.219320 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:45.219485 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:45.222599 (+ 3114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:45.222675 (+ 76us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:45.222693 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:45.222724 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:45.224173 (+ 1449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:45.224615 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:45.224621 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:45.224623 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:45.224732 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:45.225015 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:45.225018 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:45.225020 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:45.225267 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:45.225502 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:45.225659 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 09:22:45.225814 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":86,"threads_started":1}
W20260809 09:22:45.227066 11840 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39350
Aug 09 09:22:45 dist-test-slave-pgkr krb5kdc[11671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267365, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 09:22:45 dist-test-slave-pgkr krb5kdc[11671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267365, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.193@KRBTEST.COM
I20260809 09:22:45.255476 12247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:45.245252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39364 (local address 127.11.99.193:46763)
0809 09:22:45.245421 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:45.245426 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:45.245624 (+ 198us) server_negotiation.cc:407] Connection header received
0809 09:22:45.245745 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:45.245748 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:45.245795 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:45.245876 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:45.246531 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:45.247398 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:45.248864 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:45.249256 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:45.249352 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:45.251848 (+ 2496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:45.251852 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:45.251854 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:45.251877 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:45.253687 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:45.254246 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:45.254249 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:45.254251 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:45.254337 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:45.254653 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:45.254656 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:45.254658 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:45.254829 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:45.254965 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:45.255199 (+ 234us) server_negotiation.cc:299] Negotiation successful
0809 09:22:45.255318 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 09:22:45.256443 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 11793
I20260809 09:22:45.264802 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 11936
I20260809 09:22:45.270850 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 12086
I20260809 09:22:45.277628 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 11685
2026-08-09T09:22:45Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2212 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:22:45 dist-test-slave-pgkr krb5kdc[12254](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:22:45 dist-test-slave-pgkr krb5kdc[12254](info): set up 2 sockets
Aug 09 09:22:45 dist-test-slave-pgkr krb5kdc[12254](info): commencing operation
krb5kdc: starting...
W20260809 09:22:46.321903 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.021s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:22:46 dist-test-slave-pgkr krb5kdc[12254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267366, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:22:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:22:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:22:46.435127 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:33287
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:36319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:33287
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:22:46.540037 12267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:22:46.540283 12267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:22:46.540323 12267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:22:46.544373 12267 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:22:46.544445 12267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:22:46.544471 12267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:22:46.544552 12267 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:22:46.544600 12267 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:22:46.550758 12267 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:36319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:33287
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:33287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:22:46.551787 12267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:22:46.552865 12267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:22:46.562011 12275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:46.562059 12273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:46.562039 12272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:46.562245 12267 server_base.cc:1034] running on GCE node
I20260809 09:22:46.562958 12267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:22:46.563992 12267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:22:46.565169 12267 hybrid_clock.cc:648] HybridClock initialized: now 1786267366565155 us; error 26 us; skew 500 ppm
Aug 09 09:22:46 dist-test-slave-pgkr krb5kdc[12254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267366, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:22:46.572593 12267 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:22:46.573529 12267 webserver.cc:460] Webserver started at http://127.11.99.254:41737/ using document root <none> and password file <none>
I20260809 09:22:46.574102 12267 fs_manager.cc:359] Metadata directory not provided
I20260809 09:22:46.574174 12267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:22:46.574364 12267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:22:46.576629 12267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "b6e2b3b536834f86a6300082c03aca47"
format_stamp: "Formatted at 2026-08-09 09:22:46 on dist-test-slave-pgkr"
server_key: "3233c46a0c82d22c8f6d56a38485ac32"
server_key_iv: "ddaa2d4ca0d11d200a342b94cb15f85f"
server_key_version: "encryptionkey@0"
I20260809 09:22:46.577219 12267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "b6e2b3b536834f86a6300082c03aca47"
format_stamp: "Formatted at 2026-08-09 09:22:46 on dist-test-slave-pgkr"
server_key: "3233c46a0c82d22c8f6d56a38485ac32"
server_key_iv: "ddaa2d4ca0d11d200a342b94cb15f85f"
server_key_version: "encryptionkey@0"
I20260809 09:22:46.581447 12267 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 09:22:46.584156 12282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:46.585448 12267 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 09:22:46.585593 12267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "b6e2b3b536834f86a6300082c03aca47"
format_stamp: "Formatted at 2026-08-09 09:22:46 on dist-test-slave-pgkr"
server_key: "3233c46a0c82d22c8f6d56a38485ac32"
server_key_iv: "ddaa2d4ca0d11d200a342b94cb15f85f"
server_key_version: "encryptionkey@0"
I20260809 09:22:46.585708 12267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:22:46.607429 12267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:22:46.611030 12267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:22:46.611267 12267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:22:46.618871 12267 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:33287
I20260809 09:22:46.618885 12340 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:33287 every 8 connection(s)
I20260809 09:22:46.619787 12267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:22:46.621061 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 12267
I20260809 09:22:46.621189 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:22:46.621454 11663 external_mini_cluster.cc:1428] Setting key 1819ee4026a8f806a5477c89aeaf8618
I20260809 09:22:46.622864 12342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:46.629366 12342 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6e2b3b536834f86a6300082c03aca47: Bootstrap starting.
Aug 09 09:22:46 dist-test-slave-pgkr krb5kdc[12254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267366, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:22:46.631698 12342 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b6e2b3b536834f86a6300082c03aca47: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:46.632615 12342 log.cc:824] T 00000000000000000000000000000000 P b6e2b3b536834f86a6300082c03aca47: Log is configured to *not* fsync() on all Append() calls
I20260809 09:22:46.634928 12342 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6e2b3b536834f86a6300082c03aca47: No bootstrap required, opened a new log
I20260809 09:22:46.636247 12345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:46.622842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41714 (local address 127.11.99.254:33287)
0809 09:22:46.623312 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:46.623331 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:46.623373 (+ 42us) server_negotiation.cc:407] Connection header received
0809 09:22:46.624186 (+ 813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:46.624207 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:46.624594 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:46.624927 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:46.625610 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:46.627050 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:46.627844 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:46.628517 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:46.628688 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:46.631061 (+ 2373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:46.631066 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:46.631081 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:46.631110 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:46.633052 (+ 1942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:46.633537 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:46.633543 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:46.633549 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:46.633672 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:46.633927 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:46.633930 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:46.633931 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:46.634410 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:46.634613 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:46.634929 (+ 316us) server_negotiation.cc:299] Negotiation successful
0809 09:22:46.635213 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":146,"threads_started":1}
I20260809 09:22:46.638523 12342 raft_consensus.cc:348] T 00000000000000000000000000000000 P b6e2b3b536834f86a6300082c03aca47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6e2b3b536834f86a6300082c03aca47" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 33287 } }
I20260809 09:22:46.638831 12342 raft_consensus.cc:374] T 00000000000000000000000000000000 P b6e2b3b536834f86a6300082c03aca47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:46.638898 12342 raft_consensus.cc:729] T 00000000000000000000000000000000 P b6e2b3b536834f86a6300082c03aca47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6e2b3b536834f86a6300082c03aca47, State: Initialized, Role: FOLLOWER
I20260809 09:22:46.639288 12342 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6e2b3b536834f86a6300082c03aca47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6e2b3b536834f86a6300082c03aca47" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 33287 } }
I20260809 09:22:46.639403 12342 raft_consensus.cc:388] T 00000000000000000000000000000000 P b6e2b3b536834f86a6300082c03aca47 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:22:46.639447 12342 raft_consensus.cc:482] T 00000000000000000000000000000000 P b6e2b3b536834f86a6300082c03aca47 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:22:46.639513 12342 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b6e2b3b536834f86a6300082c03aca47 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:46.640300 12342 raft_consensus.cc:504] T 00000000000000000000000000000000 P b6e2b3b536834f86a6300082c03aca47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6e2b3b536834f86a6300082c03aca47" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 33287 } }
I20260809 09:22:46.640645 12342 leader_election.cc:302] T 00000000000000000000000000000000 P b6e2b3b536834f86a6300082c03aca47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b6e2b3b536834f86a6300082c03aca47; no voters:
I20260809 09:22:46.640951 12342 leader_election.cc:288] T 00000000000000000000000000000000 P b6e2b3b536834f86a6300082c03aca47 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:22:46.641057 12347 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b6e2b3b536834f86a6300082c03aca47 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:22:46.641289 12347 raft_consensus.cc:686] T 00000000000000000000000000000000 P b6e2b3b536834f86a6300082c03aca47 [term 1 LEADER]: Becoming Leader. State: Replica: b6e2b3b536834f86a6300082c03aca47, State: Running, Role: LEADER
I20260809 09:22:46.641582 12347 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6e2b3b536834f86a6300082c03aca47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6e2b3b536834f86a6300082c03aca47" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 33287 } }
I20260809 09:22:46.642055 12342 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6e2b3b536834f86a6300082c03aca47 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:22:46.643066 12349 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6e2b3b536834f86a6300082c03aca47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6e2b3b536834f86a6300082c03aca47. Latest consensus state: current_term: 1 leader_uuid: "b6e2b3b536834f86a6300082c03aca47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6e2b3b536834f86a6300082c03aca47" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 33287 } } }
I20260809 09:22:46.643210 12349 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6e2b3b536834f86a6300082c03aca47 [sys.catalog]: This master's current role is: LEADER
I20260809 09:22:46.643643 12356 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:22:46.644121 12348 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6e2b3b536834f86a6300082c03aca47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b6e2b3b536834f86a6300082c03aca47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6e2b3b536834f86a6300082c03aca47" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 33287 } } }
I20260809 09:22:46.644276 12348 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6e2b3b536834f86a6300082c03aca47 [sys.catalog]: This master's current role is: LEADER
I20260809 09:22:46.646497 12356 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:22:46.651460 12356 catalog_manager.cc:1347] Generated new cluster ID: 9c6765d6b44c4a94bec7467c578e542e
I20260809 09:22:46.651548 12356 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:22:46.659266 12356 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:22:46.660022 12356 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:22:46.667295 12356 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b6e2b3b536834f86a6300082c03aca47: Generated new TSK 0
I20260809 09:22:46.667840 12356 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.99.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
I20260809 09:22:46.701184 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:0
--local_ip_for_outbound_sockets=127.11.99.193
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:33287
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:36319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:22:46.804561 12372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:22:46.804768 12372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:22:46.804805 12372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:22:46.809036 12372 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:22:46.809090 12372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:22:46.809144 12372 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:22:46.813808 12372 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:36319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:33287
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12372
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:22:46.814651 12372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:22:46.815544 12372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:22:46.824281 12379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:46.824281 12381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:46.824311 12378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:46.824453 12372 server_base.cc:1034] running on GCE node
I20260809 09:22:46.824851 12372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:22:46.825362 12372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:22:46.826553 12372 hybrid_clock.cc:648] HybridClock initialized: now 1786267366826543 us; error 31 us; skew 500 ppm
Aug 09 09:22:46 dist-test-slave-pgkr krb5kdc[12254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267366, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:22:46.829227 12372 init.cc:377] Logged in from keytab as kudu/127.11.99.193@KRBTEST.COM (short username kudu)
I20260809 09:22:46.830003 12372 webserver.cc:460] Webserver started at http://127.11.99.193:40911/ using document root <none> and password file <none>
I20260809 09:22:46.830482 12372 fs_manager.cc:359] Metadata directory not provided
I20260809 09:22:46.830571 12372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:22:46.830812 12372 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:22:46.832573 12372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-0/data/instance:
uuid: "95567e82d6014c3baddddaf9a6c4efc3"
format_stamp: "Formatted at 2026-08-09 09:22:46 on dist-test-slave-pgkr"
server_key: "df187eb825f7e2f9b80ffff41e64991b"
server_key_iv: "fea90ad2fa2f7fb1fe79dc5ff574e4a8"
server_key_version: "encryptionkey@0"
I20260809 09:22:46.833113 12372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance:
uuid: "95567e82d6014c3baddddaf9a6c4efc3"
format_stamp: "Formatted at 2026-08-09 09:22:46 on dist-test-slave-pgkr"
server_key: "df187eb825f7e2f9b80ffff41e64991b"
server_key_iv: "fea90ad2fa2f7fb1fe79dc5ff574e4a8"
server_key_version: "encryptionkey@0"
I20260809 09:22:46.836599 12372 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:22:46.838845 12388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:46.839887 12372 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:22:46.840026 12372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "95567e82d6014c3baddddaf9a6c4efc3"
format_stamp: "Formatted at 2026-08-09 09:22:46 on dist-test-slave-pgkr"
server_key: "df187eb825f7e2f9b80ffff41e64991b"
server_key_iv: "fea90ad2fa2f7fb1fe79dc5ff574e4a8"
server_key_version: "encryptionkey@0"
I20260809 09:22:46.840130 12372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:22:46.864234 12372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:22:46.866998 12372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:22:46.867192 12372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:22:46.867748 12372 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:22:46.868516 12372 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:22:46.868585 12372 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:46.868654 12372 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:22:46.868701 12372 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:46.877727 12372 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:36327
I20260809 09:22:46.877811 12509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:36327 every 8 connection(s)
I20260809 09:22:46.878674 12372 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
Aug 09 09:22:46 dist-test-slave-pgkr krb5kdc[12254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267366, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:22:46.886869 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 12372
I20260809 09:22:46.886966 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance
I20260809 09:22:46.887233 11663 external_mini_cluster.cc:1428] Setting key f53254920fddc8d39225d5de344eb331
I20260809 09:22:46.891214 12345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:46.880449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:59913 (local address 127.11.99.254:33287)
0809 09:22:46.880604 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:46.880608 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:46.881345 (+ 737us) server_negotiation.cc:407] Connection header received
0809 09:22:46.882122 (+ 777us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:46.882124 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:46.882168 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:46.882246 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:46.883366 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:46.883867 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:46.884863 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:46.885059 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:46.885129 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:46.887371 (+ 2242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:46.887374 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:46.887376 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:46.887399 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:46.889063 (+ 1664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:46.889615 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:46.889618 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:46.889620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:46.889717 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:46.890037 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:46.890042 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:46.890043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:46.890220 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:46.890328 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:46.890883 (+ 555us) server_negotiation.cc:299] Negotiation successful
0809 09:22:46.891021 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 09:22:46.891953 12512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:46.880792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:33287 (local address 127.11.99.193:59913)
0809 09:22:46.881196 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:46.881234 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:46.881945 (+ 711us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:46.882393 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:46.882399 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:46.882797 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:22:46.883251 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:46.883263 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:46.883977 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:46.883980 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:46.884762 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:46.884771 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:46.885173 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:46.885176 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:46.885296 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:46.885756 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:22:46.885770 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:22:46.887181 (+ 1411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:22:46.889198 (+ 2017us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:46.889206 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:46.889220 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:46.889503 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:46.889808 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:46.889813 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:46.889814 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:46.889945 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:46.890327 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:22:46.890333 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:22:46.890571 (+ 238us) client_negotiation.cc:769] Sending connection context
0809 09:22:46.890812 (+ 241us) client_negotiation.cc:240] Negotiation successful
0809 09:22:46.891053 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":108,"threads_started":1}
I20260809 09:22:46.893112 12510 heartbeater.cc:347] Connected to a master server at 127.11.99.254:33287
I20260809 09:22:46.893345 12510 heartbeater.cc:464] Registering TS with master...
I20260809 09:22:46.893795 12510 heartbeater.cc:511] Master 127.11.99.254:33287 requested a full tablet report, sending...
I20260809 09:22:46.895187 12301 ts_manager.cc:194] Registered new tserver with Master: 95567e82d6014c3baddddaf9a6c4efc3 (127.11.99.193:36327)
I20260809 09:22:46.896246 12301 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.193@KRBTEST.COM'} at 127.11.99.193:59913
WARNING: no policy specified for kudu/127.11.99.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
I20260809 09:22:46.912750 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:0
--local_ip_for_outbound_sockets=127.11.99.194
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:33287
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:36319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:22:47.016010 12516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:22:47.016269 12516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:22:47.016343 12516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:22:47.020251 12516 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:22:47.020339 12516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:22:47.020430 12516 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:22:47.025293 12516 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:36319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:33287
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12516
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:22:47.026250 12516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:22:47.027309 12516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:22:47.036366 12522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:47.036437 12523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:47.036414 12516 server_base.cc:1034] running on GCE node
W20260809 09:22:47.036490 12525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:47.036849 12516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:22:47.037438 12516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:22:47.038590 12516 hybrid_clock.cc:648] HybridClock initialized: now 1786267367038572 us; error 29 us; skew 500 ppm
Aug 09 09:22:47 dist-test-slave-pgkr krb5kdc[12254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267367, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:22:47.041249 12516 init.cc:377] Logged in from keytab as kudu/127.11.99.194@KRBTEST.COM (short username kudu)
I20260809 09:22:47.042138 12516 webserver.cc:460] Webserver started at http://127.11.99.194:39591/ using document root <none> and password file <none>
I20260809 09:22:47.042749 12516 fs_manager.cc:359] Metadata directory not provided
I20260809 09:22:47.042866 12516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:22:47.043064 12516 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:22:47.045051 12516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-1/data/instance:
uuid: "f049e89b91e9402285c0fa7396957934"
format_stamp: "Formatted at 2026-08-09 09:22:47 on dist-test-slave-pgkr"
server_key: "0e64a1910547a43b141f22bdfb665f29"
server_key_iv: "24a6d3a60e8802d8b989aa0f19097228"
server_key_version: "encryptionkey@0"
I20260809 09:22:47.045600 12516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance:
uuid: "f049e89b91e9402285c0fa7396957934"
format_stamp: "Formatted at 2026-08-09 09:22:47 on dist-test-slave-pgkr"
server_key: "0e64a1910547a43b141f22bdfb665f29"
server_key_iv: "24a6d3a60e8802d8b989aa0f19097228"
server_key_version: "encryptionkey@0"
I20260809 09:22:47.049088 12516 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:22:47.051328 12532 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:47.052428 12516 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:22:47.052563 12516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "f049e89b91e9402285c0fa7396957934"
format_stamp: "Formatted at 2026-08-09 09:22:47 on dist-test-slave-pgkr"
server_key: "0e64a1910547a43b141f22bdfb665f29"
server_key_iv: "24a6d3a60e8802d8b989aa0f19097228"
server_key_version: "encryptionkey@0"
I20260809 09:22:47.052668 12516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:22:47.072409 12516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:22:47.074990 12516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:22:47.075176 12516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:22:47.075721 12516 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:22:47.076450 12516 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:22:47.076517 12516 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:47.076597 12516 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:22:47.076637 12516 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:47.086035 12516 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:46103
I20260809 09:22:47.086061 12659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:46103 every 8 connection(s)
I20260809 09:22:47.086925 12516 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:22:47.088191 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 12516
I20260809 09:22:47.088310 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance
I20260809 09:22:47.088598 11663 external_mini_cluster.cc:1428] Setting key 244e8bbb2f6d8e113e350897d14c7503
Aug 09 09:22:47 dist-test-slave-pgkr krb5kdc[12254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267367, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.99.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.195@KRBTEST.COM" created.
I20260809 09:22:47.101452 12345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:47.088735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:57621 (local address 127.11.99.254:33287)
0809 09:22:47.088890 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:47.088895 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:47.089730 (+ 835us) server_negotiation.cc:407] Connection header received
0809 09:22:47.091068 (+ 1338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:47.091073 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:47.091134 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:47.091220 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:47.092610 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.093126 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.094894 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.095120 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.095200 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:47.097900 (+ 2700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:47.097903 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:47.097905 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:47.097925 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:47.099460 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:47.099933 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:47.099938 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:47.099939 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:47.100017 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:47.100365 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:47.100370 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:47.100371 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:47.100608 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:47.100719 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:47.101160 (+ 441us) server_negotiation.cc:299] Negotiation successful
0809 09:22:47.101273 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 09:22:47.102276 12662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:47.089112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:33287 (local address 127.11.99.194:57621)
0809 09:22:47.089592 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:47.089642 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:47.090881 (+ 1239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:47.091345 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:47.091351 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:47.091698 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:22:47.092431 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:47.092466 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.093264 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.093270 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:47.094762 (+ 1492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:47.094777 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.095282 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.095288 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:47.095503 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:47.096087 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:22:47.096112 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:22:47.097726 (+ 1614us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:22:47.099571 (+ 1845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:47.099577 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:47.099589 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:47.099827 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:47.100141 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:47.100144 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:47.100146 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:47.100274 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:47.100716 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:22:47.100721 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:22:47.100942 (+ 221us) client_negotiation.cc:769] Sending connection context
0809 09:22:47.101115 (+ 173us) client_negotiation.cc:240] Negotiation successful
0809 09:22:47.101419 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":148,"threads_started":1}
I20260809 09:22:47.103536 12660 heartbeater.cc:347] Connected to a master server at 127.11.99.254:33287
I20260809 09:22:47.103793 12660 heartbeater.cc:464] Registering TS with master...
I20260809 09:22:47.104321 12660 heartbeater.cc:511] Master 127.11.99.254:33287 requested a full tablet report, sending...
I20260809 09:22:47.105476 12301 ts_manager.cc:194] Registered new tserver with Master: f049e89b91e9402285c0fa7396957934 (127.11.99.194:46103)
I20260809 09:22:47.106050 12301 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.194@KRBTEST.COM'} at 127.11.99.194:57621
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
I20260809 09:22:47.116797 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:0
--local_ip_for_outbound_sockets=127.11.99.195
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:33287
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:36319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:22:47.219424 12666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:22:47.219702 12666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:22:47.219784 12666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:22:47.223971 12666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:22:47.224047 12666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:22:47.224131 12666 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:22:47.230103 12666 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:36319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:33287
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12666
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:22:47.231158 12666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:22:47.232106 12666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:22:47.241436 12674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:47.241487 12676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:47.241487 12673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:47.241648 12666 server_base.cc:1034] running on GCE node
I20260809 09:22:47.242025 12666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:22:47.242796 12666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:22:47.243978 12666 hybrid_clock.cc:648] HybridClock initialized: now 1786267367243973 us; error 39 us; skew 500 ppm
Aug 09 09:22:47 dist-test-slave-pgkr krb5kdc[12254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267367, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:22:47.247706 12666 init.cc:377] Logged in from keytab as kudu/127.11.99.195@KRBTEST.COM (short username kudu)
I20260809 09:22:47.248783 12666 webserver.cc:460] Webserver started at http://127.11.99.195:45777/ using document root <none> and password file <none>
I20260809 09:22:47.249451 12666 fs_manager.cc:359] Metadata directory not provided
I20260809 09:22:47.249548 12666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:22:47.249774 12666 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:22:47.252269 12666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-2/data/instance:
uuid: "2e7d98dd7869478aa31843c754aa6fd4"
format_stamp: "Formatted at 2026-08-09 09:22:47 on dist-test-slave-pgkr"
server_key: "ea61b9c3d2a6fe8835f2b8a0d4fe4828"
server_key_iv: "1aec3a7d9ad66371d00e06d4c4e35e7d"
server_key_version: "encryptionkey@0"
I20260809 09:22:47.252810 12666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance:
uuid: "2e7d98dd7869478aa31843c754aa6fd4"
format_stamp: "Formatted at 2026-08-09 09:22:47 on dist-test-slave-pgkr"
server_key: "ea61b9c3d2a6fe8835f2b8a0d4fe4828"
server_key_iv: "1aec3a7d9ad66371d00e06d4c4e35e7d"
server_key_version: "encryptionkey@0"
I20260809 09:22:47.256409 12666 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260809 09:22:47.258579 12685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:47.259657 12666 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 09:22:47.259776 12666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "2e7d98dd7869478aa31843c754aa6fd4"
format_stamp: "Formatted at 2026-08-09 09:22:47 on dist-test-slave-pgkr"
server_key: "ea61b9c3d2a6fe8835f2b8a0d4fe4828"
server_key_iv: "1aec3a7d9ad66371d00e06d4c4e35e7d"
server_key_version: "encryptionkey@0"
I20260809 09:22:47.259865 12666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:22:47.272957 12666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:22:47.275260 12666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:22:47.275453 12666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:22:47.275949 12666 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:22:47.276676 12666 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:22:47.276760 12666 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:47.276824 12666 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:22:47.276863 12666 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:47.286816 12666 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:39023
I20260809 09:22:47.286842 12807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:39023 every 8 connection(s)
I20260809 09:22:47.287609 12666 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:22:47.292527 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 12666
I20260809 09:22:47.292663 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance
I20260809 09:22:47.293006 11663 external_mini_cluster.cc:1428] Setting key c04b93e9f88cd4a21fd8928afed46202
Aug 09 09:22:47 dist-test-slave-pgkr krb5kdc[12254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267367, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:22:47.301043 12345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:47.289412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:33045 (local address 127.11.99.254:33287)
0809 09:22:47.289619 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:47.289625 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:47.290521 (+ 896us) server_negotiation.cc:407] Connection header received
0809 09:22:47.291459 (+ 938us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:47.291461 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:47.291532 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:47.291616 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:47.292870 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.293487 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.295164 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.295377 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.295458 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:47.297816 (+ 2358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:47.297818 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:47.297820 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:47.297843 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:47.299223 (+ 1380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:47.299739 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:47.299742 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:47.299743 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:47.299812 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:47.300177 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:47.300179 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:47.300181 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:47.300336 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:47.300408 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:47.300845 (+ 437us) server_negotiation.cc:299] Negotiation successful
0809 09:22:47.300934 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260809 09:22:47.301868 12810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:47.289870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:33287 (local address 127.11.99.195:33045)
0809 09:22:47.290374 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:47.290414 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:47.291243 (+ 829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:47.291760 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:47.291766 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:47.292092 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:22:47.292615 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:47.292634 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.293648 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.293651 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:47.295026 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:47.295038 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.295528 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.295531 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:47.295670 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:47.296176 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:22:47.296192 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:22:47.297663 (+ 1471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:22:47.299325 (+ 1662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:47.299329 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:47.299338 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:47.299644 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:47.299920 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:47.299923 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:47.299924 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:47.300094 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:47.300426 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:22:47.300430 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:22:47.300650 (+ 220us) client_negotiation.cc:769] Sending connection context
0809 09:22:47.300803 (+ 153us) client_negotiation.cc:240] Negotiation successful
0809 09:22:47.301038 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":125,"threads_started":1}
I20260809 09:22:47.302927 12808 heartbeater.cc:347] Connected to a master server at 127.11.99.254:33287
I20260809 09:22:47.303109 12808 heartbeater.cc:464] Registering TS with master...
I20260809 09:22:47.303483 12808 heartbeater.cc:511] Master 127.11.99.254:33287 requested a full tablet report, sending...
I20260809 09:22:47.304409 12301 ts_manager.cc:194] Registered new tserver with Master: 2e7d98dd7869478aa31843c754aa6fd4 (127.11.99.195:39023)
I20260809 09:22:47.304968 12301 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.195@KRBTEST.COM'} at 127.11.99.195:33045
I20260809 09:22:47.306843 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 09:22:47.316543 12345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:47.310172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41720 (local address 127.11.99.254:33287)
0809 09:22:47.310273 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:47.310276 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:47.310474 (+ 198us) server_negotiation.cc:407] Connection header received
0809 09:22:47.310547 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:47.310548 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:47.310587 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:47.310711 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:47.311324 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.311777 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.312529 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.312742 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.312837 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:47.314082 (+ 1245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:47.314084 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:47.314086 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:47.314103 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:47.315265 (+ 1162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:47.315617 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:47.315619 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:47.315620 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:47.315684 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:47.315895 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:47.315897 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:47.315898 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:47.316060 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:47.316151 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:47.316356 (+ 205us) server_negotiation.cc:299] Negotiation successful
0809 09:22:47.316434 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 09:22:47.320405 12301 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41720:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 09:22:47.323311 12301 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:22:47.336283 12821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:47.330979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34234 (local address 127.11.99.195:39023)
0809 09:22:47.331362 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:47.331371 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:47.331393 (+ 22us) server_negotiation.cc:407] Connection header received
0809 09:22:47.331446 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:47.331449 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:47.331584 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:47.331748 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:22:47.332176 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.333272 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.334900 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.335666 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.335774 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:47.335901 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:47.336067 (+ 166us) server_negotiation.cc:299] Negotiation successful
0809 09:22:47.336159 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":165,"threads_started":1}
I20260809 09:22:47.336282 12820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:47.330870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:39023 (local address 127.0.0.1:34234)
0809 09:22:47.331169 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:47.331209 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:47.331322 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:47.331738 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:47.331745 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:47.331896 (+ 151us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:22:47.332034 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:47.332043 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.333442 (+ 1399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.333446 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:47.334777 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:47.334787 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.335793 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.335796 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:47.335897 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:47.335931 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 09:22:47.336031 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 09:22:47.336139 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":84,"threads_started":1}
I20260809 09:22:47.336740 12825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:47.331552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:46103 (local address 127.0.0.1:35194)
0809 09:22:47.332456 (+ 904us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:47.332469 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:47.332561 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:47.332995 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:47.332997 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:47.333015 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:22:47.333110 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:47.333116 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.334086 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.334091 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:47.335441 (+ 1350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:47.335450 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.336365 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.336369 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:47.336465 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:47.336494 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 09:22:47.336540 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 09:22:47.336606 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":843,"thread_start_us":90,"threads_started":1}
I20260809 09:22:47.337278 12824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:47.331755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35194 (local address 127.11.99.194:46103)
0809 09:22:47.332177 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:47.332190 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:47.332573 (+ 383us) server_negotiation.cc:407] Connection header received
0809 09:22:47.332657 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:47.332662 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:47.332859 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:47.333019 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:22:47.333203 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.333960 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.335553 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.336239 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.336914 (+ 675us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:47.337036 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:47.337078 (+ 42us) server_negotiation.cc:299] Negotiation successful
0809 09:22:47.337154 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":124,"threads_started":1}
I20260809 09:22:47.337301 12822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:47.331853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:36327 (local address 127.0.0.1:54662)
0809 09:22:47.332727 (+ 874us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:47.332739 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:47.332820 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:47.333248 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:47.333251 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:47.333268 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:22:47.333354 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:47.333361 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.334736 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.334739 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:47.335807 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:47.335816 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.336928 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.336932 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:47.337026 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:47.337043 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 09:22:47.337128 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 09:22:47.337191 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":820,"thread_start_us":91,"threads_started":1}
I20260809 09:22:47.337563 12827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:47.332285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54662 (local address 127.11.99.193:36327)
0809 09:22:47.332679 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:47.332689 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:47.332824 (+ 135us) server_negotiation.cc:407] Connection header received
0809 09:22:47.332919 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:47.332923 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:47.333090 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:47.333222 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:22:47.333483 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.334563 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.335922 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.336643 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.336742 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:47.336870 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:47.337157 (+ 287us) server_negotiation.cc:299] Negotiation successful
0809 09:22:47.337237 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":116,"threads_started":1}
I20260809 09:22:47.339692 12735 tablet_service.cc:1467] Processing CreateTablet for tablet a4c7fb17a1064d50ab18b65396a16c2a (DEFAULT_TABLE table=test-table [id=d9bed9e7c71749af93c7df8d26b85855]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:22:47.340845 12735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4c7fb17a1064d50ab18b65396a16c2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:47.340715 12437 tablet_service.cc:1467] Processing CreateTablet for tablet a4c7fb17a1064d50ab18b65396a16c2a (DEFAULT_TABLE table=test-table [id=d9bed9e7c71749af93c7df8d26b85855]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:22:47.341183 12586 tablet_service.cc:1467] Processing CreateTablet for tablet a4c7fb17a1064d50ab18b65396a16c2a (DEFAULT_TABLE table=test-table [id=d9bed9e7c71749af93c7df8d26b85855]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:22:47.341637 12437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4c7fb17a1064d50ab18b65396a16c2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:47.342104 12586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4c7fb17a1064d50ab18b65396a16c2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:47.347483 12828 tablet_bootstrap.cc:492] T a4c7fb17a1064d50ab18b65396a16c2a P 95567e82d6014c3baddddaf9a6c4efc3: Bootstrap starting.
I20260809 09:22:47.348749 12830 tablet_bootstrap.cc:492] T a4c7fb17a1064d50ab18b65396a16c2a P 2e7d98dd7869478aa31843c754aa6fd4: Bootstrap starting.
I20260809 09:22:47.349871 12828 tablet_bootstrap.cc:654] T a4c7fb17a1064d50ab18b65396a16c2a P 95567e82d6014c3baddddaf9a6c4efc3: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:47.350831 12830 tablet_bootstrap.cc:654] T a4c7fb17a1064d50ab18b65396a16c2a P 2e7d98dd7869478aa31843c754aa6fd4: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:47.351028 12828 log.cc:824] T a4c7fb17a1064d50ab18b65396a16c2a P 95567e82d6014c3baddddaf9a6c4efc3: Log is configured to *not* fsync() on all Append() calls
I20260809 09:22:47.351837 12830 log.cc:824] T a4c7fb17a1064d50ab18b65396a16c2a P 2e7d98dd7869478aa31843c754aa6fd4: Log is configured to *not* fsync() on all Append() calls
I20260809 09:22:47.352769 12828 tablet_bootstrap.cc:492] T a4c7fb17a1064d50ab18b65396a16c2a P 95567e82d6014c3baddddaf9a6c4efc3: No bootstrap required, opened a new log
I20260809 09:22:47.352990 12828 ts_tablet_manager.cc:1397] T a4c7fb17a1064d50ab18b65396a16c2a P 95567e82d6014c3baddddaf9a6c4efc3: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 09:22:47.353683 12830 tablet_bootstrap.cc:492] T a4c7fb17a1064d50ab18b65396a16c2a P 2e7d98dd7869478aa31843c754aa6fd4: No bootstrap required, opened a new log
I20260809 09:22:47.353818 12830 ts_tablet_manager.cc:1397] T a4c7fb17a1064d50ab18b65396a16c2a P 2e7d98dd7869478aa31843c754aa6fd4: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 09:22:47.352465 12831 tablet_bootstrap.cc:492] T a4c7fb17a1064d50ab18b65396a16c2a P f049e89b91e9402285c0fa7396957934: Bootstrap starting.
I20260809 09:22:47.356550 12828 raft_consensus.cc:348] T a4c7fb17a1064d50ab18b65396a16c2a P 95567e82d6014c3baddddaf9a6c4efc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7d98dd7869478aa31843c754aa6fd4" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 39023 } } peers { permanent_uuid: "f049e89b91e9402285c0fa7396957934" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 46103 } } peers { permanent_uuid: "95567e82d6014c3baddddaf9a6c4efc3" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 36327 } }
I20260809 09:22:47.356666 12830 raft_consensus.cc:348] T a4c7fb17a1064d50ab18b65396a16c2a P 2e7d98dd7869478aa31843c754aa6fd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7d98dd7869478aa31843c754aa6fd4" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 39023 } } peers { permanent_uuid: "f049e89b91e9402285c0fa7396957934" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 46103 } } peers { permanent_uuid: "95567e82d6014c3baddddaf9a6c4efc3" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 36327 } }
I20260809 09:22:47.356827 12828 raft_consensus.cc:374] T a4c7fb17a1064d50ab18b65396a16c2a P 95567e82d6014c3baddddaf9a6c4efc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:47.356873 12830 raft_consensus.cc:374] T a4c7fb17a1064d50ab18b65396a16c2a P 2e7d98dd7869478aa31843c754aa6fd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:47.356907 12828 raft_consensus.cc:729] T a4c7fb17a1064d50ab18b65396a16c2a P 95567e82d6014c3baddddaf9a6c4efc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95567e82d6014c3baddddaf9a6c4efc3, State: Initialized, Role: FOLLOWER
I20260809 09:22:47.356925 12830 raft_consensus.cc:729] T a4c7fb17a1064d50ab18b65396a16c2a P 2e7d98dd7869478aa31843c754aa6fd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7d98dd7869478aa31843c754aa6fd4, State: Initialized, Role: FOLLOWER
I20260809 09:22:47.357165 12831 tablet_bootstrap.cc:654] T a4c7fb17a1064d50ab18b65396a16c2a P f049e89b91e9402285c0fa7396957934: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:47.357379 12830 consensus_queue.cc:260] T a4c7fb17a1064d50ab18b65396a16c2a P 2e7d98dd7869478aa31843c754aa6fd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7d98dd7869478aa31843c754aa6fd4" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 39023 } } peers { permanent_uuid: "f049e89b91e9402285c0fa7396957934" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 46103 } } peers { permanent_uuid: "95567e82d6014c3baddddaf9a6c4efc3" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 36327 } }
I20260809 09:22:47.357458 12828 consensus_queue.cc:260] T a4c7fb17a1064d50ab18b65396a16c2a P 95567e82d6014c3baddddaf9a6c4efc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7d98dd7869478aa31843c754aa6fd4" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 39023 } } peers { permanent_uuid: "f049e89b91e9402285c0fa7396957934" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 46103 } } peers { permanent_uuid: "95567e82d6014c3baddddaf9a6c4efc3" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 36327 } }
I20260809 09:22:47.357978 12808 heartbeater.cc:503] Master 127.11.99.254:33287 was elected leader, sending a full tablet report...
I20260809 09:22:47.358068 12831 log.cc:824] T a4c7fb17a1064d50ab18b65396a16c2a P f049e89b91e9402285c0fa7396957934: Log is configured to *not* fsync() on all Append() calls
I20260809 09:22:47.358443 12828 ts_tablet_manager.cc:1428] T a4c7fb17a1064d50ab18b65396a16c2a P 95567e82d6014c3baddddaf9a6c4efc3: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 09:22:47.358753 12510 heartbeater.cc:503] Master 127.11.99.254:33287 was elected leader, sending a full tablet report...
I20260809 09:22:47.359457 12830 ts_tablet_manager.cc:1428] T a4c7fb17a1064d50ab18b65396a16c2a P 2e7d98dd7869478aa31843c754aa6fd4: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 09:22:47.360070 12831 tablet_bootstrap.cc:492] T a4c7fb17a1064d50ab18b65396a16c2a P f049e89b91e9402285c0fa7396957934: No bootstrap required, opened a new log
I20260809 09:22:47.360288 12831 ts_tablet_manager.cc:1397] T a4c7fb17a1064d50ab18b65396a16c2a P f049e89b91e9402285c0fa7396957934: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260809 09:22:47.363731 12831 raft_consensus.cc:348] T a4c7fb17a1064d50ab18b65396a16c2a P f049e89b91e9402285c0fa7396957934 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7d98dd7869478aa31843c754aa6fd4" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 39023 } } peers { permanent_uuid: "f049e89b91e9402285c0fa7396957934" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 46103 } } peers { permanent_uuid: "95567e82d6014c3baddddaf9a6c4efc3" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 36327 } }
I20260809 09:22:47.363960 12831 raft_consensus.cc:374] T a4c7fb17a1064d50ab18b65396a16c2a P f049e89b91e9402285c0fa7396957934 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:47.364043 12831 raft_consensus.cc:729] T a4c7fb17a1064d50ab18b65396a16c2a P f049e89b91e9402285c0fa7396957934 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f049e89b91e9402285c0fa7396957934, State: Initialized, Role: FOLLOWER
I20260809 09:22:47.364355 12831 consensus_queue.cc:260] T a4c7fb17a1064d50ab18b65396a16c2a P f049e89b91e9402285c0fa7396957934 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7d98dd7869478aa31843c754aa6fd4" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 39023 } } peers { permanent_uuid: "f049e89b91e9402285c0fa7396957934" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 46103 } } peers { permanent_uuid: "95567e82d6014c3baddddaf9a6c4efc3" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 36327 } }
I20260809 09:22:47.364979 12660 heartbeater.cc:503] Master 127.11.99.254:33287 was elected leader, sending a full tablet report...
I20260809 09:22:47.365150 12831 ts_tablet_manager.cc:1428] T a4c7fb17a1064d50ab18b65396a16c2a P f049e89b91e9402285c0fa7396957934: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
W20260809 09:22:47.379779 12511 tablet.cc:2369] T a4c7fb17a1064d50ab18b65396a16c2a P 95567e82d6014c3baddddaf9a6c4efc3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:22:47.381534 12835 raft_consensus.cc:482] T a4c7fb17a1064d50ab18b65396a16c2a P 95567e82d6014c3baddddaf9a6c4efc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:22:47.381665 12835 raft_consensus.cc:504] T a4c7fb17a1064d50ab18b65396a16c2a P 95567e82d6014c3baddddaf9a6c4efc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7d98dd7869478aa31843c754aa6fd4" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 39023 } } peers { permanent_uuid: "f049e89b91e9402285c0fa7396957934" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 46103 } } peers { permanent_uuid: "95567e82d6014c3baddddaf9a6c4efc3" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 36327 } }
I20260809 09:22:47.382565 12835 leader_election.cc:288] T a4c7fb17a1064d50ab18b65396a16c2a P 95567e82d6014c3baddddaf9a6c4efc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7d98dd7869478aa31843c754aa6fd4 (127.11.99.195:39023), f049e89b91e9402285c0fa7396957934 (127.11.99.194:46103)
I20260809 09:22:47.386487 12824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:47.383302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:53799 (local address 127.11.99.194:46103)
0809 09:22:47.383438 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:47.383442 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:47.383575 (+ 133us) server_negotiation.cc:407] Connection header received
0809 09:22:47.383686 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:47.383688 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:47.383733 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:47.383804 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:22:47.384056 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.384487 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.385430 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.385827 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.385957 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:47.386014 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:47.386293 (+ 279us) server_negotiation.cc:299] Negotiation successful
0809 09:22:47.386353 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 09:22:47.386536 12838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:47.383219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:46103 (local address 127.11.99.193:53799)
0809 09:22:47.383485 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:47.383496 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:47.383612 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:47.383821 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:47.383824 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:47.383838 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:22:47.383955 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:47.383960 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.384590 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.384594 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:47.385308 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:47.385316 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.385952 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.385955 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:47.386131 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:47.386174 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 09:22:47.386279 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 09:22:47.386346 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"mutex_wait_us":56,"thread_start_us":104,"threads_started":1}
I20260809 09:22:47.386539 12821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:47.382990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:51373 (local address 127.11.99.195:39023)
0809 09:22:47.383150 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:47.383156 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:47.383173 (+ 17us) server_negotiation.cc:407] Connection header received
0809 09:22:47.383413 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:47.383416 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:47.383465 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:47.383571 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:22:47.383936 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.384410 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.385408 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.385814 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.385962 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:47.386028 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:47.386333 (+ 305us) server_negotiation.cc:299] Negotiation successful
0809 09:22:47.386403 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 09:22:47.386570 12512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:47.382903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:39023 (local address 127.11.99.193:51373)
0809 09:22:47.383039 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:47.383055 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:47.383167 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:47.383583 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:47.383586 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:47.383629 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:22:47.383813 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:47.383820 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.384542 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.384546 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:47.385277 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:47.385286 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.385950 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.385954 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:47.386181 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:47.386200 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 09:22:47.386303 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 09:22:47.386371 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":6,"spinlock_wait_cycles":34688}
I20260809 09:22:47.387176 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4c7fb17a1064d50ab18b65396a16c2a" candidate_uuid: "95567e82d6014c3baddddaf9a6c4efc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7d98dd7869478aa31843c754aa6fd4" is_pre_election: true
I20260809 09:22:47.387224 12611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4c7fb17a1064d50ab18b65396a16c2a" candidate_uuid: "95567e82d6014c3baddddaf9a6c4efc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f049e89b91e9402285c0fa7396957934" is_pre_election: true
I20260809 09:22:47.387408 12757 raft_consensus.cc:2454] T a4c7fb17a1064d50ab18b65396a16c2a P 2e7d98dd7869478aa31843c754aa6fd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95567e82d6014c3baddddaf9a6c4efc3 in term 0.
I20260809 09:22:47.387450 12611 raft_consensus.cc:2454] T a4c7fb17a1064d50ab18b65396a16c2a P f049e89b91e9402285c0fa7396957934 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95567e82d6014c3baddddaf9a6c4efc3 in term 0.
I20260809 09:22:47.387869 12392 leader_election.cc:302] T a4c7fb17a1064d50ab18b65396a16c2a P 95567e82d6014c3baddddaf9a6c4efc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7d98dd7869478aa31843c754aa6fd4, 95567e82d6014c3baddddaf9a6c4efc3; no voters:
I20260809 09:22:47.388077 12835 raft_consensus.cc:2781] T a4c7fb17a1064d50ab18b65396a16c2a P 95567e82d6014c3baddddaf9a6c4efc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:22:47.388186 12835 raft_consensus.cc:482] T a4c7fb17a1064d50ab18b65396a16c2a P 95567e82d6014c3baddddaf9a6c4efc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:22:47.388252 12835 raft_consensus.cc:3037] T a4c7fb17a1064d50ab18b65396a16c2a P 95567e82d6014c3baddddaf9a6c4efc3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:47.389364 12835 raft_consensus.cc:504] T a4c7fb17a1064d50ab18b65396a16c2a P 95567e82d6014c3baddddaf9a6c4efc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7d98dd7869478aa31843c754aa6fd4" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 39023 } } peers { permanent_uuid: "f049e89b91e9402285c0fa7396957934" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 46103 } } peers { permanent_uuid: "95567e82d6014c3baddddaf9a6c4efc3" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 36327 } }
I20260809 09:22:47.389678 12835 leader_election.cc:288] T a4c7fb17a1064d50ab18b65396a16c2a P 95567e82d6014c3baddddaf9a6c4efc3 [CANDIDATE]: Term 1 election: Requested vote from peers 2e7d98dd7869478aa31843c754aa6fd4 (127.11.99.195:39023), f049e89b91e9402285c0fa7396957934 (127.11.99.194:46103)
I20260809 09:22:47.390130 12611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4c7fb17a1064d50ab18b65396a16c2a" candidate_uuid: "95567e82d6014c3baddddaf9a6c4efc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f049e89b91e9402285c0fa7396957934"
I20260809 09:22:47.390132 12757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4c7fb17a1064d50ab18b65396a16c2a" candidate_uuid: "95567e82d6014c3baddddaf9a6c4efc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7d98dd7869478aa31843c754aa6fd4"
I20260809 09:22:47.390241 12757 raft_consensus.cc:3037] T a4c7fb17a1064d50ab18b65396a16c2a P 2e7d98dd7869478aa31843c754aa6fd4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:47.390249 12611 raft_consensus.cc:3037] T a4c7fb17a1064d50ab18b65396a16c2a P f049e89b91e9402285c0fa7396957934 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:47.391577 12757 raft_consensus.cc:2454] T a4c7fb17a1064d50ab18b65396a16c2a P 2e7d98dd7869478aa31843c754aa6fd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95567e82d6014c3baddddaf9a6c4efc3 in term 1.
I20260809 09:22:47.391577 12611 raft_consensus.cc:2454] T a4c7fb17a1064d50ab18b65396a16c2a P f049e89b91e9402285c0fa7396957934 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95567e82d6014c3baddddaf9a6c4efc3 in term 1.
I20260809 09:22:47.391920 12392 leader_election.cc:302] T a4c7fb17a1064d50ab18b65396a16c2a P 95567e82d6014c3baddddaf9a6c4efc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95567e82d6014c3baddddaf9a6c4efc3, f049e89b91e9402285c0fa7396957934; no voters:
I20260809 09:22:47.392113 12835 raft_consensus.cc:2781] T a4c7fb17a1064d50ab18b65396a16c2a P 95567e82d6014c3baddddaf9a6c4efc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:22:47.392892 12835 raft_consensus.cc:686] T a4c7fb17a1064d50ab18b65396a16c2a P 95567e82d6014c3baddddaf9a6c4efc3 [term 1 LEADER]: Becoming Leader. State: Replica: 95567e82d6014c3baddddaf9a6c4efc3, State: Running, Role: LEADER
I20260809 09:22:47.393246 12835 consensus_queue.cc:237] T a4c7fb17a1064d50ab18b65396a16c2a P 95567e82d6014c3baddddaf9a6c4efc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7d98dd7869478aa31843c754aa6fd4" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 39023 } } peers { permanent_uuid: "f049e89b91e9402285c0fa7396957934" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 46103 } } peers { permanent_uuid: "95567e82d6014c3baddddaf9a6c4efc3" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 36327 } }
I20260809 09:22:47.396028 12300 catalog_manager.cc:5495] T a4c7fb17a1064d50ab18b65396a16c2a P 95567e82d6014c3baddddaf9a6c4efc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95567e82d6014c3baddddaf9a6c4efc3 (127.11.99.193). New cstate: current_term: 1 leader_uuid: "95567e82d6014c3baddddaf9a6c4efc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7d98dd7869478aa31843c754aa6fd4" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 39023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f049e89b91e9402285c0fa7396957934" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 46103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95567e82d6014c3baddddaf9a6c4efc3" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 36327 } health_report { overall_health: HEALTHY } } }
Aug 09 09:22:47 dist-test-slave-pgkr krb5kdc[12254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267366, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.193@KRBTEST.COM
I20260809 09:22:47.417611 12827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:47.409125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54666 (local address 127.11.99.193:36327)
0809 09:22:47.409288 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:47.409292 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:47.409372 (+ 80us) server_negotiation.cc:407] Connection header received
0809 09:22:47.409470 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:47.409472 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:47.409508 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:47.409574 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:47.410239 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.410736 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.411713 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.411902 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.411972 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:47.414305 (+ 2333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:47.414315 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:47.414328 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:47.414349 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:47.415931 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:47.416350 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:47.416355 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:47.416356 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:47.416439 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:47.416722 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:47.416727 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:47.416729 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:47.416962 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:47.417182 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:47.417345 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 09:22:47.417462 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
Aug 09 09:22:47 dist-test-slave-pgkr krb5kdc[12254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267367, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 09:22:47 dist-test-slave-pgkr krb5kdc[12254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267367, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.99.193@KRBTEST.COM
I20260809 09:22:47.445369 12827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:47.436578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54670 (local address 127.11.99.193:36327)
0809 09:22:47.436731 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:47.436737 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:47.436895 (+ 158us) server_negotiation.cc:407] Connection header received
0809 09:22:47.437065 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:47.437073 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:47.437116 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:47.437206 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:47.437945 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.438460 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.439378 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.439652 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.439851 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:47.442215 (+ 2364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:47.442219 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:47.442221 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:47.442251 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:47.443664 (+ 1413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:47.444167 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:47.444170 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:47.444171 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:47.444273 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:47.444545 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:47.444547 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:47.444548 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:47.444703 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:47.444819 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:47.445082 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 09:22:47.445167 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
Aug 09 09:22:47 dist-test-slave-pgkr krb5kdc[12254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267367, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 09:22:47 dist-test-slave-pgkr krb5kdc[12254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267367, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.193@KRBTEST.COM
I20260809 09:22:47.470074 12827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:47.462429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54686 (local address 127.11.99.193:36327)
0809 09:22:47.462596 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:47.462600 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:47.462750 (+ 150us) server_negotiation.cc:407] Connection header received
0809 09:22:47.462922 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:47.462925 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:47.462981 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:47.463056 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:47.463711 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.464173 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.464910 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:47.465122 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:47.465195 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:47.467412 (+ 2217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:47.467415 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:47.467416 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:47.467436 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:47.468732 (+ 1296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:47.469067 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:47.469069 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:47.469070 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:47.469149 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:47.469403 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:47.469405 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:47.469406 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:47.469565 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:47.469678 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:47.469807 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 09:22:47.469888 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260809 09:22:47.471576 12417 tablet_service.cc:2908] Rejecting scan request for tablet a4c7fb17a1064d50ab18b65396a16c2a: Uninitialized: clean time has not yet been initialized
I20260809 09:22:47.473634 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 12372
I20260809 09:22:47.481256 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 12516
I20260809 09:22:47.489286 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 12666
I20260809 09:22:47.496157 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 12267
2026-08-09T09:22:47Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2218 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:22:47 dist-test-slave-pgkr krb5kdc[12853](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:22:47 dist-test-slave-pgkr krb5kdc[12853](info): set up 2 sockets
Aug 09 09:22:47 dist-test-slave-pgkr krb5kdc[12853](info): commencing operation
krb5kdc: starting...
W20260809 09:22:48.529937 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.011s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:22:48 dist-test-slave-pgkr krb5kdc[12853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267368, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:22:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:22:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:22:48.641351 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:39507
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:39645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:39507
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:22:48.744644 12867 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:22:48.744995 12867 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:22:48.745087 12867 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:22:48.748723 12867 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:22:48.748767 12867 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 09:22:48.748783 12867 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:22:48.748828 12867 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:22:48.748862 12867 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:22:48.748883 12867 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:22:48.753666 12867 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:39645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:39507
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:39507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12867
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:22:48.754492 12867 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:22:48.755406 12867 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:22:48.762867 12872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:48.762859 12873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:48.762949 12875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:48.763474 12867 server_base.cc:1034] running on GCE node
I20260809 09:22:48.763962 12867 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:22:48.764976 12867 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:22:48.766160 12867 hybrid_clock.cc:648] HybridClock initialized: now 1786267368766134 us; error 36 us; skew 500 ppm
Aug 09 09:22:48 dist-test-slave-pgkr krb5kdc[12853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267368, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:22:48.768869 12867 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:22:48.769637 12867 webserver.cc:460] Webserver started at http://127.11.99.254:38765/ using document root <none> and password file <none>
I20260809 09:22:48.770157 12867 fs_manager.cc:359] Metadata directory not provided
I20260809 09:22:48.770269 12867 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:22:48.770494 12867 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:22:48.772413 12867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "6eca17f11e3249d0b4060e71e60eb627"
format_stamp: "Formatted at 2026-08-09 09:22:48 on dist-test-slave-pgkr"
server_key: "b728fbdf7b8f877a5d4ab1b953a3467e"
server_key_iv: "277eaf5cfbf7724ea2c18549977ccafa"
server_key_version: "encryptionkey@0"
I20260809 09:22:48.772953 12867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "6eca17f11e3249d0b4060e71e60eb627"
format_stamp: "Formatted at 2026-08-09 09:22:48 on dist-test-slave-pgkr"
server_key: "b728fbdf7b8f877a5d4ab1b953a3467e"
server_key_iv: "277eaf5cfbf7724ea2c18549977ccafa"
server_key_version: "encryptionkey@0"
I20260809 09:22:48.776489 12867 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:22:48.778707 12882 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:48.779788 12867 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:22:48.779917 12867 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "6eca17f11e3249d0b4060e71e60eb627"
format_stamp: "Formatted at 2026-08-09 09:22:48 on dist-test-slave-pgkr"
server_key: "b728fbdf7b8f877a5d4ab1b953a3467e"
server_key_iv: "277eaf5cfbf7724ea2c18549977ccafa"
server_key_version: "encryptionkey@0"
I20260809 09:22:48.780016 12867 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:22:48.790268 12867 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:22:48.793339 12867 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:22:48.793548 12867 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:22:48.801167 12867 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:39507
I20260809 09:22:48.801231 12955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:39507 every 8 connection(s)
I20260809 09:22:48.802050 12867 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:22:48.804644 12956 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:48.806764 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 12867
I20260809 09:22:48.806860 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:22:48.807121 11663 external_mini_cluster.cc:1428] Setting key 9d02d1f551a5ad5077609b9379896c54
I20260809 09:22:48.810753 12956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6eca17f11e3249d0b4060e71e60eb627: Bootstrap starting.
I20260809 09:22:48.813210 12956 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6eca17f11e3249d0b4060e71e60eb627: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:48.813880 12956 log.cc:824] T 00000000000000000000000000000000 P 6eca17f11e3249d0b4060e71e60eb627: Log is configured to *not* fsync() on all Append() calls
I20260809 09:22:48.815718 12956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6eca17f11e3249d0b4060e71e60eb627: No bootstrap required, opened a new log
Aug 09 09:22:48 dist-test-slave-pgkr krb5kdc[12853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267368, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:22:48.819315 12956 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6eca17f11e3249d0b4060e71e60eb627 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6eca17f11e3249d0b4060e71e60eb627" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39507 } }
I20260809 09:22:48.819550 12956 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6eca17f11e3249d0b4060e71e60eb627 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:48.819604 12956 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6eca17f11e3249d0b4060e71e60eb627 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6eca17f11e3249d0b4060e71e60eb627, State: Initialized, Role: FOLLOWER
I20260809 09:22:48.820080 12956 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6eca17f11e3249d0b4060e71e60eb627 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6eca17f11e3249d0b4060e71e60eb627" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39507 } }
I20260809 09:22:48.820276 12956 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6eca17f11e3249d0b4060e71e60eb627 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:22:48.820340 12956 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6eca17f11e3249d0b4060e71e60eb627 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:22:48.820431 12956 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6eca17f11e3249d0b4060e71e60eb627 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:48.821120 12959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:48.808452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43520 (local address 127.11.99.254:39507)
0809 09:22:48.808834 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:48.808853 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:48.808895 (+ 42us) server_negotiation.cc:407] Connection header received
0809 09:22:48.809688 (+ 793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:48.809709 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:48.810090 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:48.810416 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:48.811160 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:48.812583 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:48.813431 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:48.813862 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:48.814020 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:48.816494 (+ 2474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:48.816499 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:48.816510 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:48.816536 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:48.818080 (+ 1544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:48.818522 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:48.818533 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:48.818537 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:48.818734 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:48.819032 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:48.819036 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:48.819037 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:48.819400 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:48.819613 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:48.820078 (+ 465us) server_negotiation.cc:299] Negotiation successful
0809 09:22:48.820377 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":89,"threads_started":1}
I20260809 09:22:48.821292 12956 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6eca17f11e3249d0b4060e71e60eb627 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6eca17f11e3249d0b4060e71e60eb627" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39507 } }
I20260809 09:22:48.821617 12956 leader_election.cc:302] T 00000000000000000000000000000000 P 6eca17f11e3249d0b4060e71e60eb627 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6eca17f11e3249d0b4060e71e60eb627; no voters:
I20260809 09:22:48.821893 12956 leader_election.cc:288] T 00000000000000000000000000000000 P 6eca17f11e3249d0b4060e71e60eb627 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:22:48.822031 12961 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6eca17f11e3249d0b4060e71e60eb627 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:22:48.822243 12961 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6eca17f11e3249d0b4060e71e60eb627 [term 1 LEADER]: Becoming Leader. State: Replica: 6eca17f11e3249d0b4060e71e60eb627, State: Running, Role: LEADER
I20260809 09:22:48.822496 12961 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6eca17f11e3249d0b4060e71e60eb627 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6eca17f11e3249d0b4060e71e60eb627" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39507 } }
I20260809 09:22:48.823092 12956 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6eca17f11e3249d0b4060e71e60eb627 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:22:48.823750 12963 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6eca17f11e3249d0b4060e71e60eb627 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6eca17f11e3249d0b4060e71e60eb627. Latest consensus state: current_term: 1 leader_uuid: "6eca17f11e3249d0b4060e71e60eb627" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6eca17f11e3249d0b4060e71e60eb627" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39507 } } }
I20260809 09:22:48.823894 12963 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6eca17f11e3249d0b4060e71e60eb627 [sys.catalog]: This master's current role is: LEADER
I20260809 09:22:48.824106 12962 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6eca17f11e3249d0b4060e71e60eb627 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6eca17f11e3249d0b4060e71e60eb627" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6eca17f11e3249d0b4060e71e60eb627" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39507 } } }
I20260809 09:22:48.824213 12962 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6eca17f11e3249d0b4060e71e60eb627 [sys.catalog]: This master's current role is: LEADER
I20260809 09:22:48.824383 12973 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:22:48.827706 12973 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:22:48.833077 12973 catalog_manager.cc:1347] Generated new cluster ID: 9ec785316f8e4d068c7abb4a204b91a2
I20260809 09:22:48.833137 12973 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:22:48.841094 12973 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:22:48.841820 12973 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:22:48.846498 12973 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6eca17f11e3249d0b4060e71e60eb627: Generated new TSK 0
I20260809 09:22:48.847043 12973 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.99.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
I20260809 09:22:48.877256 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:0
--local_ip_for_outbound_sockets=127.11.99.193
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:39507
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:39645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:22:48.985126 12986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:22:48.985383 12986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:22:48.985464 12986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:22:48.989241 12986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:22:48.989306 12986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:22:48.989403 12986 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 09:22:48.989511 12986 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:22:48.995034 12986 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:39645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.99.254:39507
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12986
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:22:48.995935 12986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:22:48.996960 12986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:22:49.006069 12995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:49.006115 12991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:49.006218 12986 server_base.cc:1034] running on GCE node
W20260809 09:22:49.006069 12992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:49.006817 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:22:49.007443 12986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:22:49.008644 12986 hybrid_clock.cc:648] HybridClock initialized: now 1786267369008636 us; error 36 us; skew 500 ppm
Aug 09 09:22:49 dist-test-slave-pgkr krb5kdc[12853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267369, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:22:49.011611 12986 init.cc:377] Logged in from keytab as kudu/127.11.99.193@KRBTEST.COM (short username kudu)
I20260809 09:22:49.012529 12986 webserver.cc:460] Webserver started at http://127.11.99.193:34753/ using document root <none> and password file <none>
I20260809 09:22:49.013079 12986 fs_manager.cc:359] Metadata directory not provided
I20260809 09:22:49.013172 12986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:22:49.013414 12986 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:22:49.015975 12986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-0/data/instance:
uuid: "016cad2bd9de49b8a2191bc635b01d73"
format_stamp: "Formatted at 2026-08-09 09:22:49 on dist-test-slave-pgkr"
server_key: "5cc50d0af04843e6337d7c13d7a12855"
server_key_iv: "bf5798a9acb42a8b2426e486f8f43e2e"
server_key_version: "encryptionkey@0"
I20260809 09:22:49.016716 12986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance:
uuid: "016cad2bd9de49b8a2191bc635b01d73"
format_stamp: "Formatted at 2026-08-09 09:22:49 on dist-test-slave-pgkr"
server_key: "5cc50d0af04843e6337d7c13d7a12855"
server_key_iv: "bf5798a9acb42a8b2426e486f8f43e2e"
server_key_version: "encryptionkey@0"
I20260809 09:22:49.020502 12986 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:22:49.022888 13003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:49.024099 12986 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 09:22:49.024217 12986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "016cad2bd9de49b8a2191bc635b01d73"
format_stamp: "Formatted at 2026-08-09 09:22:49 on dist-test-slave-pgkr"
server_key: "5cc50d0af04843e6337d7c13d7a12855"
server_key_iv: "bf5798a9acb42a8b2426e486f8f43e2e"
server_key_version: "encryptionkey@0"
I20260809 09:22:49.024363 12986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:22:49.034168 12986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:22:49.037365 12986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:22:49.037567 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:22:49.039007 12986 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:22:49.039083 12986 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:49.039151 12986 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:22:49.039207 12986 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 09:22:49 dist-test-slave-pgkr krb5kdc[12853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267369, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:22:49.050129 12986 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:45285
I20260809 09:22:49.051044 12986 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:22:49.051011 13138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:45285 every 8 connection(s)
I20260809 09:22:49.053020 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 12986
I20260809 09:22:49.053067 12959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.039636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:45541 (local address 127.11.99.254:39507)
0809 09:22:49.039807 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:49.039814 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:49.041041 (+ 1227us) server_negotiation.cc:407] Connection header received
0809 09:22:49.042094 (+ 1053us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:49.042097 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:49.042155 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:49.042266 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:49.043905 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.044743 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.046167 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.046590 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.046737 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.049119 (+ 2382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:49.049123 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:49.049125 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:49.049159 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:49.050811 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:49.051374 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:49.051379 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:49.051381 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:49.051465 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:49.051881 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:49.051884 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:49.051886 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:49.052137 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:49.052215 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:49.052731 (+ 516us) server_negotiation.cc:299] Negotiation successful
0809 09:22:49.052892 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 09:22:49.053143 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance
I20260809 09:22:49.053417 11663 external_mini_cluster.cc:1428] Setting key 76ef2720da6269cc19575639fd8b027f
I20260809 09:22:49.053828 13014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.040471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:39507 (local address 127.11.99.193:45541)
0809 09:22:49.040890 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:49.040937 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:49.041895 (+ 958us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:49.042479 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:49.042492 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:49.042990 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:22:49.043716 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:49.043737 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.044915 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.044919 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:49.046061 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:49.046071 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.046791 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.046794 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:49.046929 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.047499 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:22:49.047514 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:22:49.048961 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:22:49.050925 (+ 1964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:49.050931 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:49.050945 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:49.051269 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:49.051596 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:49.051600 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:49.051601 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:49.051765 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:49.052245 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:22:49.052250 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:22:49.052495 (+ 245us) client_negotiation.cc:769] Sending connection context
0809 09:22:49.052676 (+ 181us) client_negotiation.cc:240] Negotiation successful
0809 09:22:49.052907 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":121,"threads_started":1}
I20260809 09:22:49.055295 13139 heartbeater.cc:347] Connected to a master server at 127.11.99.254:39507
I20260809 09:22:49.055426 13139 heartbeater.cc:464] Registering TS with master...
I20260809 09:22:49.055981 13139 heartbeater.cc:511] Master 127.11.99.254:39507 requested a full tablet report, sending...
I20260809 09:22:49.057601 12898 ts_manager.cc:194] Registered new tserver with Master: 016cad2bd9de49b8a2191bc635b01d73 (127.11.99.193:45285)
I20260809 09:22:49.058859 12898 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.193@KRBTEST.COM'} at 127.11.99.193:45541
WARNING: no policy specified for kudu/127.11.99.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.194@KRBTEST.COM" created.
I20260809 09:22:49.069751 12959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.057685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:43861 (local address 127.11.99.254:39507)
0809 09:22:49.057791 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:49.057795 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:49.062912 (+ 5117us) server_negotiation.cc:407] Connection header received
0809 09:22:49.063061 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:49.063063 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:49.063109 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:49.063200 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:49.063707 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.064187 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.065064 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.065251 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.065329 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.066438 (+ 1109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:49.066441 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:49.066443 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:49.066464 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:49.068110 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:49.068538 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:49.068542 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:49.068544 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:49.068621 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:49.068888 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:49.068892 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:49.068894 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:49.069081 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:49.069209 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:49.069490 (+ 281us) server_negotiation.cc:299] Negotiation successful
0809 09:22:49.069605 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 09:22:49.069758 13146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.057609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:39507 (local address 127.11.99.193:43861)
0809 09:22:49.062816 (+ 5207us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:49.062829 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:49.062946 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:49.063252 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:49.063255 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:49.063466 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:22:49.063572 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:49.063578 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.064319 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.064321 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:49.064932 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:49.064946 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.065377 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.065380 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:49.065487 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.066004 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:22:49.066017 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:22:49.066308 (+ 291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:22:49.068224 (+ 1916us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:49.068229 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:49.068231 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:49.068424 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:49.068709 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:49.068713 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:49.068715 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:49.068799 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:49.069200 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:22:49.069203 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:22:49.069322 (+ 119us) client_negotiation.cc:769] Sending connection context
0809 09:22:49.069427 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 09:22:49.069567 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5136,"thread_start_us":257,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
I20260809 09:22:49.080895 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:0
--local_ip_for_outbound_sockets=127.11.99.194
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:39507
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:39645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:22:49.188319 13150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:22:49.188584 13150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:22:49.188663 13150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:22:49.192728 13150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:22:49.192781 13150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:22:49.192819 13150 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 09:22:49.192901 13150 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:22:49.198186 13150 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:39645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.99.254:39507
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13150
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:22:49.199163 13150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:22:49.200179 13150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:22:49.209432 13156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:49.209441 13158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:49.209483 13150 server_base.cc:1034] running on GCE node
W20260809 09:22:49.209437 13160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:49.210003 13150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:22:49.210605 13150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:22:49.211820 13150 hybrid_clock.cc:648] HybridClock initialized: now 1786267369211803 us; error 28 us; skew 500 ppm
Aug 09 09:22:49 dist-test-slave-pgkr krb5kdc[12853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267369, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:22:49.214480 13150 init.cc:377] Logged in from keytab as kudu/127.11.99.194@KRBTEST.COM (short username kudu)
I20260809 09:22:49.215303 13150 webserver.cc:460] Webserver started at http://127.11.99.194:42777/ using document root <none> and password file <none>
I20260809 09:22:49.215828 13150 fs_manager.cc:359] Metadata directory not provided
I20260809 09:22:49.215916 13150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:22:49.216146 13150 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:22:49.218062 13150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-1/data/instance:
uuid: "6f04d153d8e94cb6bf19b85b790b3a7b"
format_stamp: "Formatted at 2026-08-09 09:22:49 on dist-test-slave-pgkr"
server_key: "bb2a6fa3222cd4a731bef65ae6921682"
server_key_iv: "0dba0eebcb7e1fbb2dd14f77f5144cb1"
server_key_version: "encryptionkey@0"
I20260809 09:22:49.218660 13150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance:
uuid: "6f04d153d8e94cb6bf19b85b790b3a7b"
format_stamp: "Formatted at 2026-08-09 09:22:49 on dist-test-slave-pgkr"
server_key: "bb2a6fa3222cd4a731bef65ae6921682"
server_key_iv: "0dba0eebcb7e1fbb2dd14f77f5144cb1"
server_key_version: "encryptionkey@0"
I20260809 09:22:49.222329 13150 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260809 09:22:49.224933 13167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:49.226140 13150 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:22:49.226235 13150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "6f04d153d8e94cb6bf19b85b790b3a7b"
format_stamp: "Formatted at 2026-08-09 09:22:49 on dist-test-slave-pgkr"
server_key: "bb2a6fa3222cd4a731bef65ae6921682"
server_key_iv: "0dba0eebcb7e1fbb2dd14f77f5144cb1"
server_key_version: "encryptionkey@0"
I20260809 09:22:49.226313 13150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:22:49.243249 13150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:22:49.246770 13150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:22:49.246970 13150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:22:49.248703 13150 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:22:49.248755 13150 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:49.248802 13150 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:22:49.248826 13150 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 09:22:49 dist-test-slave-pgkr krb5kdc[12853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267369, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:22:49.260412 13150 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:34989
I20260809 09:22:49.260493 13294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:34989 every 8 connection(s)
I20260809 09:22:49.261441 13150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:22:49.262586 12959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.249569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:36637 (local address 127.11.99.254:39507)
0809 09:22:49.249694 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:49.249699 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:49.250721 (+ 1022us) server_negotiation.cc:407] Connection header received
0809 09:22:49.251907 (+ 1186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:49.251912 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:49.251971 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:49.252028 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:49.253912 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.254418 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.255770 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.256007 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.256124 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.258819 (+ 2695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:49.258822 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:49.258825 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:49.258858 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:49.260381 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:49.260964 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:49.260967 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:49.260968 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:49.261043 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:49.261401 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:49.261403 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:49.261404 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:49.261609 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:49.261686 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:49.262345 (+ 659us) server_negotiation.cc:299] Negotiation successful
0809 09:22:49.262460 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 09:22:49.263258 13177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.250126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:39507 (local address 127.11.99.194:36637)
0809 09:22:49.250560 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:49.250604 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:49.251666 (+ 1062us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:49.252456 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:49.252463 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:49.253126 (+ 663us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:22:49.253771 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:49.253792 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.254542 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.254545 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:49.255639 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:49.255649 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.256171 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.256176 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:49.256406 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.256967 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:22:49.256989 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:22:49.258595 (+ 1606us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:22:49.260507 (+ 1912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:49.260512 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:49.260525 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:49.260837 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:49.261149 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:49.261152 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:49.261154 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:49.261305 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:49.261707 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:22:49.261714 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:22:49.262005 (+ 291us) client_negotiation.cc:769] Sending connection context
0809 09:22:49.262224 (+ 219us) client_negotiation.cc:240] Negotiation successful
0809 09:22:49.262474 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":120,"threads_started":1}
I20260809 09:22:49.264422 13295 heartbeater.cc:347] Connected to a master server at 127.11.99.254:39507
I20260809 09:22:49.264560 13295 heartbeater.cc:464] Registering TS with master...
I20260809 09:22:49.264981 13295 heartbeater.cc:511] Master 127.11.99.254:39507 requested a full tablet report, sending...
I20260809 09:22:49.265954 12898 ts_manager.cc:194] Registered new tserver with Master: 6f04d153d8e94cb6bf19b85b790b3a7b (127.11.99.194:34989)
I20260809 09:22:49.266662 12898 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.194@KRBTEST.COM'} at 127.11.99.194:36637
I20260809 09:22:49.267371 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 13150
I20260809 09:22:49.267484 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance
I20260809 09:22:49.267808 11663 external_mini_cluster.cc:1428] Setting key 910045890806fe8d1b94dc70ccb83ca8
I20260809 09:22:49.273416 12959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.266351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:57661 (local address 127.11.99.254:39507)
0809 09:22:49.266453 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:49.266462 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:49.266579 (+ 117us) server_negotiation.cc:407] Connection header received
0809 09:22:49.266706 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:49.266708 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:49.266761 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:49.266834 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:49.267298 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.267847 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.268871 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.269210 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.269314 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.270242 (+ 928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:49.270248 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:49.270253 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:49.270281 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:49.271747 (+ 1466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:49.272229 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:49.272231 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:49.272232 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:49.272311 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:49.272611 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:49.272614 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:49.272616 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:49.272833 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:49.272945 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:49.273185 (+ 240us) server_negotiation.cc:299] Negotiation successful
0809 09:22:49.273283 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 09:22:49.273432 13303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.266249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:39507 (local address 127.11.99.194:57661)
0809 09:22:49.266509 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:49.266521 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:49.266633 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:49.266849 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:49.266852 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:49.267024 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:22:49.267176 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:49.267184 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.268022 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.268024 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:49.268756 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:49.268766 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.269325 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.269328 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:49.269406 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.269850 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:22:49.269861 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:22:49.270112 (+ 251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:22:49.271851 (+ 1739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:49.271856 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:49.271859 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:49.272119 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:49.272398 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:49.272401 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:49.272404 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:49.272513 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:49.272935 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:22:49.272938 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:22:49.273028 (+ 90us) client_negotiation.cc:769] Sending connection context
0809 09:22:49.273132 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 09:22:49.273273 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":87,"threads_started":1}
WARNING: no policy specified for kudu/127.11.99.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
I20260809 09:22:49.295167 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:0
--local_ip_for_outbound_sockets=127.11.99.195
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:39507
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:39645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:22:49.398972 13306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:22:49.399192 13306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:22:49.399259 13306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:22:49.403164 13306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:22:49.403218 13306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:22:49.403292 13306 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 09:22:49.403379 13306 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:22:49.408371 13306 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:39645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.99.254:39507
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13306
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:22:49.409267 13306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:22:49.410177 13306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:22:49.418891 13315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:49.418897 13312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:49.418882 13313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:49.419139 13306 server_base.cc:1034] running on GCE node
I20260809 09:22:49.419641 13306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:22:49.420217 13306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:22:49.421403 13306 hybrid_clock.cc:648] HybridClock initialized: now 1786267369421388 us; error 28 us; skew 500 ppm
Aug 09 09:22:49 dist-test-slave-pgkr krb5kdc[12853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267369, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:22:49.424134 13306 init.cc:377] Logged in from keytab as kudu/127.11.99.195@KRBTEST.COM (short username kudu)
I20260809 09:22:49.424995 13306 webserver.cc:460] Webserver started at http://127.11.99.195:42651/ using document root <none> and password file <none>
I20260809 09:22:49.425554 13306 fs_manager.cc:359] Metadata directory not provided
I20260809 09:22:49.425644 13306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:22:49.425848 13306 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:22:49.427789 13306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-2/data/instance:
uuid: "cf3fa43862244a1ea13f10d3080f7afe"
format_stamp: "Formatted at 2026-08-09 09:22:49 on dist-test-slave-pgkr"
server_key: "b286cdc30487b8cd61f2a02462765fd0"
server_key_iv: "8f64b4001ce4b979efb97f3cd608b6f9"
server_key_version: "encryptionkey@0"
I20260809 09:22:49.428323 13306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance:
uuid: "cf3fa43862244a1ea13f10d3080f7afe"
format_stamp: "Formatted at 2026-08-09 09:22:49 on dist-test-slave-pgkr"
server_key: "b286cdc30487b8cd61f2a02462765fd0"
server_key_iv: "8f64b4001ce4b979efb97f3cd608b6f9"
server_key_version: "encryptionkey@0"
I20260809 09:22:49.432542 13306 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 09:22:49.434811 13322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:49.435918 13306 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:22:49.436060 13306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "cf3fa43862244a1ea13f10d3080f7afe"
format_stamp: "Formatted at 2026-08-09 09:22:49 on dist-test-slave-pgkr"
server_key: "b286cdc30487b8cd61f2a02462765fd0"
server_key_iv: "8f64b4001ce4b979efb97f3cd608b6f9"
server_key_version: "encryptionkey@0"
I20260809 09:22:49.436179 13306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:22:49.454408 13306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:22:49.457472 13306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:22:49.457662 13306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:22:49.459105 13306 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:22:49.459184 13306 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:49.459244 13306 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:22:49.459301 13306 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 09:22:49 dist-test-slave-pgkr krb5kdc[12853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267369, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:22:49.470139 13306 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:38855
I20260809 09:22:49.470232 13451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:38855 every 8 connection(s)
I20260809 09:22:49.471184 13306 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:22:49.473340 12959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.459768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:42809 (local address 127.11.99.254:39507)
0809 09:22:49.459892 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:49.459895 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:49.461442 (+ 1547us) server_negotiation.cc:407] Connection header received
0809 09:22:49.462435 (+ 993us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:49.462438 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:49.462496 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:49.462655 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:49.464200 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.465084 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.466980 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.467182 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.467260 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.469762 (+ 2502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:49.469766 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:49.469768 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:49.469799 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:49.471455 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:49.472044 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:49.472048 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:49.472049 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:49.472150 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:49.472495 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:49.472497 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:49.472498 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:49.472661 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:49.472735 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:49.473139 (+ 404us) server_negotiation.cc:299] Negotiation successful
0809 09:22:49.473229 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 09:22:49.474087 13333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.460805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:39507 (local address 127.11.99.195:42809)
0809 09:22:49.461304 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:49.461343 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:49.462244 (+ 901us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:49.462837 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:49.462849 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:49.463325 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:22:49.464039 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:49.464064 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.465209 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.465214 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:49.466856 (+ 1642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:49.466866 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.467351 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.467357 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:49.467556 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.468188 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:22:49.468207 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:22:49.469610 (+ 1403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:22:49.471588 (+ 1978us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:49.471596 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:49.471609 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:49.471915 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:49.472252 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:49.472255 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:49.472257 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:49.472409 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:49.472753 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:22:49.472758 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:22:49.472951 (+ 193us) client_negotiation.cc:769] Sending connection context
0809 09:22:49.473093 (+ 142us) client_negotiation.cc:240] Negotiation successful
0809 09:22:49.473312 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":135,"threads_started":1}
I20260809 09:22:49.475178 13452 heartbeater.cc:347] Connected to a master server at 127.11.99.254:39507
I20260809 09:22:49.475317 13452 heartbeater.cc:464] Registering TS with master...
I20260809 09:22:49.475771 13452 heartbeater.cc:511] Master 127.11.99.254:39507 requested a full tablet report, sending...
I20260809 09:22:49.476811 12898 ts_manager.cc:194] Registered new tserver with Master: cf3fa43862244a1ea13f10d3080f7afe (127.11.99.195:38855)
I20260809 09:22:49.477524 12898 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.195@KRBTEST.COM'} at 127.11.99.195:42809
I20260809 09:22:49.480638 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 13306
I20260809 09:22:49.480758 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance
I20260809 09:22:49.481000 11663 external_mini_cluster.cc:1428] Setting key 98ace7e92ead92e74bd88a0e485c75fa
I20260809 09:22:49.483165 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 09:22:49.483737 13458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.477150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:39507 (local address 127.11.99.195:57517)
0809 09:22:49.477414 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:49.477428 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:49.477520 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:49.477760 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:49.477765 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:49.478001 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:22:49.478126 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:49.478132 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.479088 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.479090 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:49.479603 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:49.479611 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.479985 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.479987 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:49.480050 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.480411 (+ 361us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:22:49.480421 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:22:49.480673 (+ 252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:22:49.482379 (+ 1706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:49.482384 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:49.482386 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:49.482566 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:49.482869 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:49.482873 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:49.482874 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:49.482982 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:49.483367 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:22:49.483370 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:22:49.483452 (+ 82us) client_negotiation.cc:769] Sending connection context
0809 09:22:49.483533 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 09:22:49.483627 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":116,"threads_started":1}
I20260809 09:22:49.483867 12959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.477223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:57517 (local address 127.11.99.254:39507)
0809 09:22:49.477341 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:49.477345 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:49.477480 (+ 135us) server_negotiation.cc:407] Connection header received
0809 09:22:49.477598 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:49.477617 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:49.477670 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:49.477729 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:49.478236 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.478964 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.479704 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.479892 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.479968 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.480814 (+ 846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:49.480817 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:49.480821 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:49.480847 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:49.482278 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:49.482700 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:49.482703 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:49.482704 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:49.482782 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:49.483060 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:49.483063 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:49.483065 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:49.483270 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:49.483359 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:49.483610 (+ 251us) server_negotiation.cc:299] Negotiation successful
0809 09:22:49.483721 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
Aug 09 09:22:49 dist-test-slave-pgkr krb5kdc[12853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267369, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 09:22:49 dist-test-slave-pgkr krb5kdc[12853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267369, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:22:49.509825 12959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.501889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43522 (local address 127.11.99.254:39507)
0809 09:22:49.502011 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:49.502014 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:49.502034 (+ 20us) server_negotiation.cc:407] Connection header received
0809 09:22:49.502072 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:49.502074 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:49.502110 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:49.502179 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:49.502919 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.503418 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.504377 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.504798 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.504932 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.507221 (+ 2289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:49.507225 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:49.507227 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:49.507249 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:49.508343 (+ 1094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:49.508693 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:49.508695 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:49.508696 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:49.508762 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:49.508972 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:49.508974 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:49.508974 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:49.509136 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:49.509225 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:49.509504 (+ 279us) server_negotiation.cc:299] Negotiation successful
0809 09:22:49.509664 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 09:22:49.512949 12898 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43522:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 09:22:49.515899 12898 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:22:49.531020 13470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.524956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:38855 (local address 127.0.0.1:42084)
0809 09:22:49.525524 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:49.525573 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:49.525699 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:49.526415 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:49.526420 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:49.526460 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:22:49.526701 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:49.526712 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.528022 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.528025 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:49.529396 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:49.529405 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.530441 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.530446 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:49.530572 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.530646 (+ 74us) client_negotiation.cc:769] Sending connection context
0809 09:22:49.530755 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 09:22:49.530867 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"mutex_wait_us":105,"spinlock_wait_cycles":7040,"thread_start_us":112,"threads_started":1}
I20260809 09:22:49.531064 13475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.525623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42084 (local address 127.11.99.195:38855)
0809 09:22:49.526031 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:49.526043 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:49.526060 (+ 17us) server_negotiation.cc:407] Connection header received
0809 09:22:49.526115 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:49.526119 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:49.526258 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:49.526372 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:22:49.526830 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.527891 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.529521 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.530319 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.530447 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.530678 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:49.530786 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 09:22:49.530896 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":133,"threads_started":1}
I20260809 09:22:49.531975 13473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.524566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:45285 (local address 127.0.0.1:57318)
0809 09:22:49.525524 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:49.525573 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:49.525716 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:49.526415 (+ 699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:49.526420 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:49.526458 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:22:49.526756 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:49.526767 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.527933 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.527940 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:49.529202 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:49.529231 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.530341 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.530344 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:49.531706 (+ 1362us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.531741 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 09:22:49.531810 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 09:22:49.531866 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":803,"mutex_wait_us":1387,"spinlock_wait_cycles":5248,"thread_start_us":65,"threads_started":1}
I20260809 09:22:49.532117 13472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.524791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57318 (local address 127.11.99.193:45285)
0809 09:22:49.525262 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:49.525279 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:49.525661 (+ 382us) server_negotiation.cc:407] Connection header received
0809 09:22:49.525874 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:49.525881 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:49.526079 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:49.526220 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:22:49.526926 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.527820 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.529338 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.530002 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.530137 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.530287 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:49.531852 (+ 1565us) server_negotiation.cc:299] Negotiation successful
0809 09:22:49.531931 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":83,"threads_started":1}
I20260809 09:22:49.532518 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.525216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:34989 (local address 127.0.0.1:33870)
0809 09:22:49.525945 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:49.525958 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:49.526051 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:49.527237 (+ 1186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:49.527241 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:49.527258 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:22:49.527341 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:49.527346 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.529277 (+ 1931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.529283 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:49.530506 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:49.530518 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.532138 (+ 1620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.532142 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:49.532216 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.532249 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 09:22:49.532325 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 09:22:49.532403 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":675,"mutex_wait_us":25,"thread_start_us":98,"threads_started":1}
I20260809 09:22:49.532650 13476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.525589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33870 (local address 127.11.99.194:34989)
0809 09:22:49.526601 (+ 1012us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:49.526655 (+ 54us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:49.526677 (+ 22us) server_negotiation.cc:407] Connection header received
0809 09:22:49.526759 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:49.526767 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:49.526952 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:49.527089 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:22:49.527464 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.529160 (+ 1696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.530610 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.531425 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.531524 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.531672 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:49.532390 (+ 718us) server_negotiation.cc:299] Negotiation successful
0809 09:22:49.532484 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":931,"thread_start_us":174,"threads_started":1}
I20260809 09:22:49.533977 13379 tablet_service.cc:1467] Processing CreateTablet for tablet b3fa9cbfc5914685ae185e37370711a3 (DEFAULT_TABLE table=test-table [id=511e3bf3ff49449f8e904e7153d9c7cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:22:49.535038 13379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3fa9cbfc5914685ae185e37370711a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:49.536971 13062 tablet_service.cc:1467] Processing CreateTablet for tablet b3fa9cbfc5914685ae185e37370711a3 (DEFAULT_TABLE table=test-table [id=511e3bf3ff49449f8e904e7153d9c7cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:22:49.537245 13221 tablet_service.cc:1467] Processing CreateTablet for tablet b3fa9cbfc5914685ae185e37370711a3 (DEFAULT_TABLE table=test-table [id=511e3bf3ff49449f8e904e7153d9c7cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:22:49.537855 13062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3fa9cbfc5914685ae185e37370711a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:49.538193 13221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3fa9cbfc5914685ae185e37370711a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:49.542982 13477 tablet_bootstrap.cc:492] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe: Bootstrap starting.
I20260809 09:22:49.544575 13478 tablet_bootstrap.cc:492] T b3fa9cbfc5914685ae185e37370711a3 P 016cad2bd9de49b8a2191bc635b01d73: Bootstrap starting.
I20260809 09:22:49.545456 13479 tablet_bootstrap.cc:492] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b: Bootstrap starting.
I20260809 09:22:49.546343 13477 tablet_bootstrap.cc:654] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:49.546573 13478 tablet_bootstrap.cc:654] T b3fa9cbfc5914685ae185e37370711a3 P 016cad2bd9de49b8a2191bc635b01d73: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:49.547252 13478 log.cc:824] T b3fa9cbfc5914685ae185e37370711a3 P 016cad2bd9de49b8a2191bc635b01d73: Log is configured to *not* fsync() on all Append() calls
I20260809 09:22:49.547290 13477 log.cc:824] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe: Log is configured to *not* fsync() on all Append() calls
I20260809 09:22:49.547538 13479 tablet_bootstrap.cc:654] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:49.548300 13479 log.cc:824] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b: Log is configured to *not* fsync() on all Append() calls
I20260809 09:22:49.549175 13477 tablet_bootstrap.cc:492] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe: No bootstrap required, opened a new log
I20260809 09:22:49.549170 13478 tablet_bootstrap.cc:492] T b3fa9cbfc5914685ae185e37370711a3 P 016cad2bd9de49b8a2191bc635b01d73: No bootstrap required, opened a new log
I20260809 09:22:49.549369 13477 ts_tablet_manager.cc:1397] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260809 09:22:49.549369 13478 ts_tablet_manager.cc:1397] T b3fa9cbfc5914685ae185e37370711a3 P 016cad2bd9de49b8a2191bc635b01d73: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260809 09:22:49.549932 13479 tablet_bootstrap.cc:492] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b: No bootstrap required, opened a new log
I20260809 09:22:49.550125 13479 ts_tablet_manager.cc:1397] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 09:22:49.553102 13479 raft_consensus.cc:348] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:49.553102 13477 raft_consensus.cc:348] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:49.553102 13478 raft_consensus.cc:348] T b3fa9cbfc5914685ae185e37370711a3 P 016cad2bd9de49b8a2191bc635b01d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:49.553337 13478 raft_consensus.cc:374] T b3fa9cbfc5914685ae185e37370711a3 P 016cad2bd9de49b8a2191bc635b01d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:49.553337 13477 raft_consensus.cc:374] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:49.553335 13479 raft_consensus.cc:374] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:49.553411 13479 raft_consensus.cc:729] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f04d153d8e94cb6bf19b85b790b3a7b, State: Initialized, Role: FOLLOWER
I20260809 09:22:49.553411 13478 raft_consensus.cc:729] T b3fa9cbfc5914685ae185e37370711a3 P 016cad2bd9de49b8a2191bc635b01d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 016cad2bd9de49b8a2191bc635b01d73, State: Initialized, Role: FOLLOWER
I20260809 09:22:49.553421 13477 raft_consensus.cc:729] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf3fa43862244a1ea13f10d3080f7afe, State: Initialized, Role: FOLLOWER
I20260809 09:22:49.553822 13477 consensus_queue.cc:260] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:49.553822 13478 consensus_queue.cc:260] T b3fa9cbfc5914685ae185e37370711a3 P 016cad2bd9de49b8a2191bc635b01d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:49.553860 13479 consensus_queue.cc:260] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:49.554447 13452 heartbeater.cc:503] Master 127.11.99.254:39507 was elected leader, sending a full tablet report...
I20260809 09:22:49.554772 13478 ts_tablet_manager.cc:1428] T b3fa9cbfc5914685ae185e37370711a3 P 016cad2bd9de49b8a2191bc635b01d73: Time spent starting tablet: real 0.005s user 0.005s sys 0.002s
I20260809 09:22:49.554771 13477 ts_tablet_manager.cc:1428] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260809 09:22:49.554919 13139 heartbeater.cc:503] Master 127.11.99.254:39507 was elected leader, sending a full tablet report...
I20260809 09:22:49.555900 13295 heartbeater.cc:503] Master 127.11.99.254:39507 was elected leader, sending a full tablet report...
I20260809 09:22:49.556079 13479 ts_tablet_manager.cc:1428] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20260809 09:22:49.722328 13453 tablet.cc:2369] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 09:22:49.762734 13296 tablet.cc:2369] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 09:22:49.802474 13140 tablet.cc:2369] T b3fa9cbfc5914685ae185e37370711a3 P 016cad2bd9de49b8a2191bc635b01d73: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:22:49.975148 13488 raft_consensus.cc:482] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:22:49.975343 13488 raft_consensus.cc:504] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:49.975906 13485 raft_consensus.cc:482] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:22:49.976107 13485 raft_consensus.cc:504] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:49.976706 13488 leader_election.cc:288] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 016cad2bd9de49b8a2191bc635b01d73 (127.11.99.193:45285), cf3fa43862244a1ea13f10d3080f7afe (127.11.99.195:38855)
I20260809 09:22:49.977105 13485 leader_election.cc:288] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 016cad2bd9de49b8a2191bc635b01d73 (127.11.99.193:45285), 6f04d153d8e94cb6bf19b85b790b3a7b (127.11.99.194:34989)
I20260809 09:22:49.982013 13472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.977369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:46741 (local address 127.11.99.193:45285)
0809 09:22:49.977488 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:49.977491 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:49.977757 (+ 266us) server_negotiation.cc:407] Connection header received
0809 09:22:49.977954 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:49.977957 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:49.977999 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:49.978041 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:22:49.978423 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.979191 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.980790 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.981365 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.981434 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.981480 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:49.981807 (+ 327us) server_negotiation.cc:299] Negotiation successful
0809 09:22:49.981877 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49,"spinlock_wait_cycles":1792}
I20260809 09:22:49.982219 13490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.976897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:38855 (local address 127.11.99.194:49597)
0809 09:22:49.977371 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:49.977386 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:49.977476 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:49.978084 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:49.978087 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:49.978102 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:22:49.978218 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:49.978224 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.979326 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.979330 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:49.980649 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:49.980659 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.981565 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.981568 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:49.981912 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.981928 (+ 16us) client_negotiation.cc:769] Sending connection context
0809 09:22:49.981986 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 09:22:49.982058 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":404,"mutex_wait_us":25,"thread_start_us":55,"threads_started":1}
I20260809 09:22:49.982270 13492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.977694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:49327 (local address 127.11.99.193:45285)
0809 09:22:49.977968 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:49.977972 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:49.977985 (+ 13us) server_negotiation.cc:407] Connection header received
0809 09:22:49.978036 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:49.978048 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:49.978106 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:49.978191 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:22:49.978568 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.979433 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.980900 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.981517 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.981626 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.981676 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:49.982113 (+ 437us) server_negotiation.cc:299] Negotiation successful
0809 09:22:49.982172 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":81,"threads_started":1}
I20260809 09:22:49.982285 13493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.977590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:34989 (local address 127.11.99.195:46469)
0809 09:22:49.978150 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:49.978164 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:49.978285 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:49.978652 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:49.978655 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:49.978673 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:22:49.978795 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:49.978801 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.979768 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.979771 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:49.980965 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:49.980974 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.981741 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.981745 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:49.981835 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.981854 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 09:22:49.982081 (+ 227us) client_negotiation.cc:240] Negotiation successful
0809 09:22:49.982148 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"mutex_wait_us":289,"thread_start_us":66,"threads_started":1}
I20260809 09:22:49.982537 13476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.977663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:46469 (local address 127.11.99.194:34989)
0809 09:22:49.977834 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:49.977838 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:49.978225 (+ 387us) server_negotiation.cc:407] Connection header received
0809 09:22:49.978379 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:49.978382 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:49.978418 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:49.978476 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:22:49.978919 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.979641 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.981080 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.981657 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.981766 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.981839 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:49.981957 (+ 118us) server_negotiation.cc:299] Negotiation successful
0809 09:22:49.982035 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":93}
I20260809 09:22:49.982558 13489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.976897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:45285 (local address 127.11.99.194:49327)
0809 09:22:49.977218 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:49.977232 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:49.977331 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:49.978299 (+ 968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:49.978304 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:49.978325 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:22:49.978432 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:49.978440 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.979557 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.979560 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:49.980775 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:49.980785 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.981686 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.981691 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:49.981785 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.981846 (+ 61us) client_negotiation.cc:769] Sending connection context
0809 09:22:49.981918 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 09:22:49.982007 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"mutex_wait_us":35,"thread_start_us":68,"threads_started":1}
I20260809 09:22:49.982596 13475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.977703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:49597 (local address 127.11.99.195:38855)
0809 09:22:49.977802 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:49.977806 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:49.977817 (+ 11us) server_negotiation.cc:407] Connection header received
0809 09:22:49.977854 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:49.977859 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:49.977899 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:49.977961 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:22:49.978332 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.979182 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.980794 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.981344 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.981431 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.981479 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:49.982422 (+ 943us) server_negotiation.cc:299] Negotiation successful
0809 09:22:49.982500 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 09:22:49.983076 13491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:49.977265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:45285 (local address 127.11.99.195:46741)
0809 09:22:49.977681 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:49.977694 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:49.977831 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:49.978179 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:49.978183 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:49.978201 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:22:49.978318 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:49.978325 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.979378 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.979381 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:49.980652 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:49.980659 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:49.981564 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:49.981567 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:49.981668 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:49.981699 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 09:22:49.982910 (+ 1211us) client_negotiation.cc:240] Negotiation successful
0809 09:22:49.982981 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":1,"thread_start_us":59,"threads_started":1}
I20260809 09:22:49.983063 13245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3fa9cbfc5914685ae185e37370711a3" candidate_uuid: "cf3fa43862244a1ea13f10d3080f7afe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" is_pre_election: true
I20260809 09:22:49.983057 13087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3fa9cbfc5914685ae185e37370711a3" candidate_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016cad2bd9de49b8a2191bc635b01d73" is_pre_election: true
I20260809 09:22:49.983237 13245 raft_consensus.cc:2454] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf3fa43862244a1ea13f10d3080f7afe in term 0.
I20260809 09:22:49.983278 13087 raft_consensus.cc:2454] T b3fa9cbfc5914685ae185e37370711a3 P 016cad2bd9de49b8a2191bc635b01d73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f04d153d8e94cb6bf19b85b790b3a7b in term 0.
I20260809 09:22:49.983510 13086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3fa9cbfc5914685ae185e37370711a3" candidate_uuid: "cf3fa43862244a1ea13f10d3080f7afe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016cad2bd9de49b8a2191bc635b01d73" is_pre_election: true
I20260809 09:22:49.983636 13086 raft_consensus.cc:2454] T b3fa9cbfc5914685ae185e37370711a3 P 016cad2bd9de49b8a2191bc635b01d73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf3fa43862244a1ea13f10d3080f7afe in term 0.
I20260809 09:22:49.983691 13402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3fa9cbfc5914685ae185e37370711a3" candidate_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf3fa43862244a1ea13f10d3080f7afe" is_pre_election: true
I20260809 09:22:49.983767 13170 leader_election.cc:302] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016cad2bd9de49b8a2191bc635b01d73, 6f04d153d8e94cb6bf19b85b790b3a7b; no voters:
I20260809 09:22:49.983872 13402 raft_consensus.cc:2454] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f04d153d8e94cb6bf19b85b790b3a7b in term 0.
I20260809 09:22:49.984025 13488 raft_consensus.cc:2781] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:22:49.984117 13488 raft_consensus.cc:482] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:22:49.984165 13488 raft_consensus.cc:3037] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:49.984123 13326 leader_election.cc:302] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f04d153d8e94cb6bf19b85b790b3a7b, cf3fa43862244a1ea13f10d3080f7afe; no voters:
I20260809 09:22:49.984531 13485 raft_consensus.cc:2781] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:22:49.984619 13485 raft_consensus.cc:482] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:22:49.984671 13485 raft_consensus.cc:3037] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:49.985253 13488 raft_consensus.cc:504] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:49.985548 13488 leader_election.cc:288] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b [CANDIDATE]: Term 1 election: Requested vote from peers 016cad2bd9de49b8a2191bc635b01d73 (127.11.99.193:45285), cf3fa43862244a1ea13f10d3080f7afe (127.11.99.195:38855)
I20260809 09:22:49.985710 13485 raft_consensus.cc:504] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:49.985829 13086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3fa9cbfc5914685ae185e37370711a3" candidate_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016cad2bd9de49b8a2191bc635b01d73"
I20260809 09:22:49.985893 13402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3fa9cbfc5914685ae185e37370711a3" candidate_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf3fa43862244a1ea13f10d3080f7afe"
I20260809 09:22:49.985916 13086 raft_consensus.cc:3037] T b3fa9cbfc5914685ae185e37370711a3 P 016cad2bd9de49b8a2191bc635b01d73 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:49.986028 13485 leader_election.cc:288] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe [CANDIDATE]: Term 1 election: Requested vote from peers 016cad2bd9de49b8a2191bc635b01d73 (127.11.99.193:45285), 6f04d153d8e94cb6bf19b85b790b3a7b (127.11.99.194:34989)
I20260809 09:22:49.986047 13402 raft_consensus.cc:2379] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f04d153d8e94cb6bf19b85b790b3a7b in current term 1: Already voted for candidate cf3fa43862244a1ea13f10d3080f7afe in this term.
I20260809 09:22:49.986482 13245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3fa9cbfc5914685ae185e37370711a3" candidate_uuid: "cf3fa43862244a1ea13f10d3080f7afe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b"
I20260809 09:22:49.986548 13087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3fa9cbfc5914685ae185e37370711a3" candidate_uuid: "cf3fa43862244a1ea13f10d3080f7afe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016cad2bd9de49b8a2191bc635b01d73"
I20260809 09:22:49.986688 13245 raft_consensus.cc:2379] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cf3fa43862244a1ea13f10d3080f7afe in current term 1: Already voted for candidate 6f04d153d8e94cb6bf19b85b790b3a7b in this term.
I20260809 09:22:49.987061 13326 leader_election.cc:302] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf3fa43862244a1ea13f10d3080f7afe; no voters: 016cad2bd9de49b8a2191bc635b01d73, 6f04d153d8e94cb6bf19b85b790b3a7b
I20260809 09:22:49.987206 13485 raft_consensus.cc:2726] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260809 09:22:49.987313 13086 raft_consensus.cc:2454] T b3fa9cbfc5914685ae185e37370711a3 P 016cad2bd9de49b8a2191bc635b01d73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f04d153d8e94cb6bf19b85b790b3a7b in term 1.
I20260809 09:22:49.987536 13170 leader_election.cc:302] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 016cad2bd9de49b8a2191bc635b01d73, 6f04d153d8e94cb6bf19b85b790b3a7b; no voters: cf3fa43862244a1ea13f10d3080f7afe
I20260809 09:22:49.987675 13488 raft_consensus.cc:2781] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:22:49.987815 13488 raft_consensus.cc:686] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b [term 1 LEADER]: Becoming Leader. State: Replica: 6f04d153d8e94cb6bf19b85b790b3a7b, State: Running, Role: LEADER
I20260809 09:22:49.988109 13488 consensus_queue.cc:237] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:49.991052 12899 catalog_manager.cc:5495] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f04d153d8e94cb6bf19b85b790b3a7b (127.11.99.194). New cstate: current_term: 1 leader_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } health_report { overall_health: UNKNOWN } } }
I20260809 09:22:50.091794 13476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:50.087714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33874 (local address 127.11.99.194:34989)
0809 09:22:50.087879 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:50.087884 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:50.088049 (+ 165us) server_negotiation.cc:407] Connection header received
0809 09:22:50.088311 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:50.088313 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:50.088369 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:50.088476 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:22:50.088768 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.089290 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.090260 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.090495 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.090613 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:50.090976 (+ 363us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:22:50.091364 (+ 388us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:22:50.091491 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:50.091594 (+ 103us) server_negotiation.cc:299] Negotiation successful
0809 09:22:50.091645 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 09:22:50.096946 13086 raft_consensus.cc:1261] T b3fa9cbfc5914685ae185e37370711a3 P 016cad2bd9de49b8a2191bc635b01d73 [term 1 FOLLOWER]: Refusing update from remote peer 6f04d153d8e94cb6bf19b85b790b3a7b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:22:50.096953 13402 raft_consensus.cc:1261] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe [term 1 FOLLOWER]: Refusing update from remote peer 6f04d153d8e94cb6bf19b85b790b3a7b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:22:50.097692 13494 consensus_queue.cc:1035] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:22:50.097899 13488 consensus_queue.cc:1035] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:22:50.105130 13501 mvcc.cc:205] Tried to move back new op lower bound from 7316551147910885376 to 7316551147473719296. Current Snapshot: MvccSnapshot[applied={T|T < 7316551147910885376}]
I20260809 09:22:50.116798 12900 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43522:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:22:50.117046 12900 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43522:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:22:50.119575 12900 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6eca17f11e3249d0b4060e71e60eb627: Sending DeleteTablet for 3 replicas of tablet b3fa9cbfc5914685ae185e37370711a3
I20260809 09:22:50.120268 13062 tablet_service.cc:1514] Processing DeleteTablet for tablet b3fa9cbfc5914685ae185e37370711a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:22:50 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:57318
I20260809 09:22:50.120268 13221 tablet_service.cc:1514] Processing DeleteTablet for tablet b3fa9cbfc5914685ae185e37370711a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:22:50 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:33870
I20260809 09:22:50.120438 13379 tablet_service.cc:1514] Processing DeleteTablet for tablet b3fa9cbfc5914685ae185e37370711a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:22:50 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:42084
I20260809 09:22:50.120698 13509 tablet_replica.cc:330] T b3fa9cbfc5914685ae185e37370711a3 P 016cad2bd9de49b8a2191bc635b01d73: stopping tablet replica
I20260809 09:22:50.120800 13510 tablet_replica.cc:330] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b: stopping tablet replica
I20260809 09:22:50.121013 13509 raft_consensus.cc:2229] T b3fa9cbfc5914685ae185e37370711a3 P 016cad2bd9de49b8a2191bc635b01d73 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:22:50.121098 13510 raft_consensus.cc:2229] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b [term 1 LEADER]: Raft consensus shutting down.
I20260809 09:22:50.121272 13509 raft_consensus.cc:2258] T b3fa9cbfc5914685ae185e37370711a3 P 016cad2bd9de49b8a2191bc635b01d73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:22:50.121412 13510 raft_consensus.cc:2258] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:22:50.121628 12900 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43522:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 09:22:50.122013 12900 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:22:50.122586 13509 ts_tablet_manager.cc:1905] T b3fa9cbfc5914685ae185e37370711a3 P 016cad2bd9de49b8a2191bc635b01d73: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:22:50.123940 13510 ts_tablet_manager.cc:1905] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:22:50.126398 13062 tablet_service.cc:1467] Processing CreateTablet for tablet e2b2e6750fe04393902908c70b2a1b6f (DEFAULT_TABLE table=test-table [id=faa54ebf782140aab8880ea513c9625b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:22:50.126490 13221 tablet_service.cc:1467] Processing CreateTablet for tablet e2b2e6750fe04393902908c70b2a1b6f (DEFAULT_TABLE table=test-table [id=faa54ebf782140aab8880ea513c9625b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:22:50.126658 13062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2b2e6750fe04393902908c70b2a1b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:50.126737 13221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2b2e6750fe04393902908c70b2a1b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:50.126730 13379 tablet_service.cc:1467] Processing CreateTablet for tablet e2b2e6750fe04393902908c70b2a1b6f (DEFAULT_TABLE table=test-table [id=faa54ebf782140aab8880ea513c9625b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:22:50.126991 13379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2b2e6750fe04393902908c70b2a1b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:50.127791 13511 tablet_replica.cc:330] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe: stopping tablet replica
I20260809 09:22:50.128078 13511 raft_consensus.cc:2229] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:22:50.128324 13511 raft_consensus.cc:2258] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:22:50.129558 13510 ts_tablet_manager.cc:1918] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:22:50.129721 13510 log.cc:1196] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/b3fa9cbfc5914685ae185e37370711a3
I20260809 09:22:50.129853 13511 ts_tablet_manager.cc:1905] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:22:50.130283 13510 ts_tablet_manager.cc:1939] T b3fa9cbfc5914685ae185e37370711a3 P 6f04d153d8e94cb6bf19b85b790b3a7b: Deleting consensus metadata
I20260809 09:22:50.130447 13514 tablet_bootstrap.cc:492] T e2b2e6750fe04393902908c70b2a1b6f P cf3fa43862244a1ea13f10d3080f7afe: Bootstrap starting.
I20260809 09:22:50.131320 13509 ts_tablet_manager.cc:1918] T b3fa9cbfc5914685ae185e37370711a3 P 016cad2bd9de49b8a2191bc635b01d73: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:22:50.131421 13509 log.cc:1196] T b3fa9cbfc5914685ae185e37370711a3 P 016cad2bd9de49b8a2191bc635b01d73: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-0/wal/wals/b3fa9cbfc5914685ae185e37370711a3
I20260809 09:22:50.131641 12885 catalog_manager.cc:4841] TS 6f04d153d8e94cb6bf19b85b790b3a7b (127.11.99.194:34989): tablet b3fa9cbfc5914685ae185e37370711a3 (table test-table [id=511e3bf3ff49449f8e904e7153d9c7cd]) successfully deleted
I20260809 09:22:50.131736 13514 tablet_bootstrap.cc:654] T e2b2e6750fe04393902908c70b2a1b6f P cf3fa43862244a1ea13f10d3080f7afe: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:50.131750 13509 ts_tablet_manager.cc:1939] T b3fa9cbfc5914685ae185e37370711a3 P 016cad2bd9de49b8a2191bc635b01d73: Deleting consensus metadata
I20260809 09:22:50.132109 13513 tablet_bootstrap.cc:492] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73: Bootstrap starting.
I20260809 09:22:50.132532 13511 ts_tablet_manager.cc:1918] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:22:50.132651 13511 log.cc:1196] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/b3fa9cbfc5914685ae185e37370711a3
I20260809 09:22:50.132848 12885 catalog_manager.cc:4841] TS 016cad2bd9de49b8a2191bc635b01d73 (127.11.99.193:45285): tablet b3fa9cbfc5914685ae185e37370711a3 (table test-table [id=511e3bf3ff49449f8e904e7153d9c7cd]) successfully deleted
I20260809 09:22:50.132969 13511 ts_tablet_manager.cc:1939] T b3fa9cbfc5914685ae185e37370711a3 P cf3fa43862244a1ea13f10d3080f7afe: Deleting consensus metadata
I20260809 09:22:50.133216 13512 tablet_bootstrap.cc:492] T e2b2e6750fe04393902908c70b2a1b6f P 6f04d153d8e94cb6bf19b85b790b3a7b: Bootstrap starting.
I20260809 09:22:50.133836 13514 tablet_bootstrap.cc:492] T e2b2e6750fe04393902908c70b2a1b6f P cf3fa43862244a1ea13f10d3080f7afe: No bootstrap required, opened a new log
I20260809 09:22:50.133939 13514 ts_tablet_manager.cc:1397] T e2b2e6750fe04393902908c70b2a1b6f P cf3fa43862244a1ea13f10d3080f7afe: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260809 09:22:50.134019 12886 catalog_manager.cc:4841] TS cf3fa43862244a1ea13f10d3080f7afe (127.11.99.195:38855): tablet b3fa9cbfc5914685ae185e37370711a3 (table test-table [id=511e3bf3ff49449f8e904e7153d9c7cd]) successfully deleted
I20260809 09:22:50.134092 13513 tablet_bootstrap.cc:654] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:50.134351 13512 tablet_bootstrap.cc:654] T e2b2e6750fe04393902908c70b2a1b6f P 6f04d153d8e94cb6bf19b85b790b3a7b: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:50.134380 13514 raft_consensus.cc:348] T e2b2e6750fe04393902908c70b2a1b6f P cf3fa43862244a1ea13f10d3080f7afe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:50.134522 13514 raft_consensus.cc:374] T e2b2e6750fe04393902908c70b2a1b6f P cf3fa43862244a1ea13f10d3080f7afe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:50.134577 13514 raft_consensus.cc:729] T e2b2e6750fe04393902908c70b2a1b6f P cf3fa43862244a1ea13f10d3080f7afe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf3fa43862244a1ea13f10d3080f7afe, State: Initialized, Role: FOLLOWER
I20260809 09:22:50.134707 13514 consensus_queue.cc:260] T e2b2e6750fe04393902908c70b2a1b6f P cf3fa43862244a1ea13f10d3080f7afe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:50.134974 13514 ts_tablet_manager.cc:1428] T e2b2e6750fe04393902908c70b2a1b6f P cf3fa43862244a1ea13f10d3080f7afe: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 09:22:50.135722 13512 tablet_bootstrap.cc:492] T e2b2e6750fe04393902908c70b2a1b6f P 6f04d153d8e94cb6bf19b85b790b3a7b: No bootstrap required, opened a new log
I20260809 09:22:50.135831 13512 ts_tablet_manager.cc:1397] T e2b2e6750fe04393902908c70b2a1b6f P 6f04d153d8e94cb6bf19b85b790b3a7b: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260809 09:22:50.136353 13513 tablet_bootstrap.cc:492] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73: No bootstrap required, opened a new log
I20260809 09:22:50.136305 13512 raft_consensus.cc:348] T e2b2e6750fe04393902908c70b2a1b6f P 6f04d153d8e94cb6bf19b85b790b3a7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:50.136404 13512 raft_consensus.cc:374] T e2b2e6750fe04393902908c70b2a1b6f P 6f04d153d8e94cb6bf19b85b790b3a7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:50.136425 13513 ts_tablet_manager.cc:1397] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260809 09:22:50.136437 13512 raft_consensus.cc:729] T e2b2e6750fe04393902908c70b2a1b6f P 6f04d153d8e94cb6bf19b85b790b3a7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f04d153d8e94cb6bf19b85b790b3a7b, State: Initialized, Role: FOLLOWER
I20260809 09:22:50.136586 13512 consensus_queue.cc:260] T e2b2e6750fe04393902908c70b2a1b6f P 6f04d153d8e94cb6bf19b85b790b3a7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:50.136861 13512 ts_tablet_manager.cc:1428] T e2b2e6750fe04393902908c70b2a1b6f P 6f04d153d8e94cb6bf19b85b790b3a7b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 09:22:50.136960 13513 raft_consensus.cc:348] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:50.137065 13513 raft_consensus.cc:374] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:50.137096 13513 raft_consensus.cc:729] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 016cad2bd9de49b8a2191bc635b01d73, State: Initialized, Role: FOLLOWER
I20260809 09:22:50.137200 13513 consensus_queue.cc:260] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:50.137435 13513 ts_tablet_manager.cc:1428] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 09:22:50.427879 13499 raft_consensus.cc:482] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:22:50.428018 13499 raft_consensus.cc:504] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:50.429221 13499 leader_election.cc:288] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f04d153d8e94cb6bf19b85b790b3a7b (127.11.99.194:34989), cf3fa43862244a1ea13f10d3080f7afe (127.11.99.195:38855)
I20260809 09:22:50.433382 13475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:50.429594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:45341 (local address 127.11.99.195:38855)
0809 09:22:50.429718 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:50.429725 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:50.429868 (+ 143us) server_negotiation.cc:407] Connection header received
0809 09:22:50.430080 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:50.430083 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:50.430144 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:50.430251 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:22:50.430545 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.431114 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.432281 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.432734 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.432873 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:50.432929 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:50.433169 (+ 240us) server_negotiation.cc:299] Negotiation successful
0809 09:22:50.433247 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 09:22:50.433403 13519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:50.429450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:38855 (local address 127.11.99.193:45341)
0809 09:22:50.429777 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:50.429790 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:50.429950 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:50.430290 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:50.430293 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:50.430309 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:22:50.430435 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:50.430439 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.431227 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.431230 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:50.432145 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:50.432155 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.432878 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.432882 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:50.433011 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:50.433063 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 09:22:50.433150 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 09:22:50.433261 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"mutex_wait_us":123,"thread_start_us":133,"threads_started":1}
I20260809 09:22:50.433393 13476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:50.429793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:33047 (local address 127.11.99.194:34989)
0809 09:22:50.429987 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:50.429992 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:50.430003 (+ 11us) server_negotiation.cc:407] Connection header received
0809 09:22:50.430045 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:50.430047 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:50.430088 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:50.430183 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:22:50.430450 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.431169 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.432297 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.432747 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.432891 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:50.432958 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:50.433179 (+ 221us) server_negotiation.cc:299] Negotiation successful
0809 09:22:50.433270 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 09:22:50.433413 13518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:50.429349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:34989 (local address 127.11.99.193:33047)
0809 09:22:50.429691 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:50.429707 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:50.429848 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:50.430194 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:50.430196 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:50.430212 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:22:50.430343 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:50.430348 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.431282 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.431287 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:50.432147 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:50.432156 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.432892 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.432896 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:50.433057 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:50.433074 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 09:22:50.433162 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 09:22:50.433271 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"mutex_wait_us":91,"thread_start_us":146,"threads_started":1}
I20260809 09:22:50.433947 13402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2b2e6750fe04393902908c70b2a1b6f" candidate_uuid: "016cad2bd9de49b8a2191bc635b01d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf3fa43862244a1ea13f10d3080f7afe" is_pre_election: true
I20260809 09:22:50.434118 13402 raft_consensus.cc:2454] T e2b2e6750fe04393902908c70b2a1b6f P cf3fa43862244a1ea13f10d3080f7afe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 016cad2bd9de49b8a2191bc635b01d73 in term 0.
I20260809 09:22:50.434305 13245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2b2e6750fe04393902908c70b2a1b6f" candidate_uuid: "016cad2bd9de49b8a2191bc635b01d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" is_pre_election: true
I20260809 09:22:50.434441 13245 raft_consensus.cc:2454] T e2b2e6750fe04393902908c70b2a1b6f P 6f04d153d8e94cb6bf19b85b790b3a7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 016cad2bd9de49b8a2191bc635b01d73 in term 0.
I20260809 09:22:50.434471 13008 leader_election.cc:302] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016cad2bd9de49b8a2191bc635b01d73, cf3fa43862244a1ea13f10d3080f7afe; no voters:
I20260809 09:22:50.434796 13499 raft_consensus.cc:2781] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:22:50.434866 13499 raft_consensus.cc:482] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:22:50.434924 13499 raft_consensus.cc:3037] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:50.435926 13499 raft_consensus.cc:504] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:50.436272 13499 leader_election.cc:288] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73 [CANDIDATE]: Term 1 election: Requested vote from peers 6f04d153d8e94cb6bf19b85b790b3a7b (127.11.99.194:34989), cf3fa43862244a1ea13f10d3080f7afe (127.11.99.195:38855)
I20260809 09:22:50.436599 13245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2b2e6750fe04393902908c70b2a1b6f" candidate_uuid: "016cad2bd9de49b8a2191bc635b01d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b"
I20260809 09:22:50.436720 13245 raft_consensus.cc:3037] T e2b2e6750fe04393902908c70b2a1b6f P 6f04d153d8e94cb6bf19b85b790b3a7b [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:50.436738 13402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2b2e6750fe04393902908c70b2a1b6f" candidate_uuid: "016cad2bd9de49b8a2191bc635b01d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf3fa43862244a1ea13f10d3080f7afe"
I20260809 09:22:50.436864 13402 raft_consensus.cc:3037] T e2b2e6750fe04393902908c70b2a1b6f P cf3fa43862244a1ea13f10d3080f7afe [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:50.437721 13245 raft_consensus.cc:2454] T e2b2e6750fe04393902908c70b2a1b6f P 6f04d153d8e94cb6bf19b85b790b3a7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 016cad2bd9de49b8a2191bc635b01d73 in term 1.
I20260809 09:22:50.437995 13402 raft_consensus.cc:2454] T e2b2e6750fe04393902908c70b2a1b6f P cf3fa43862244a1ea13f10d3080f7afe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 016cad2bd9de49b8a2191bc635b01d73 in term 1.
I20260809 09:22:50.438305 13008 leader_election.cc:302] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016cad2bd9de49b8a2191bc635b01d73, cf3fa43862244a1ea13f10d3080f7afe; no voters:
I20260809 09:22:50.438498 13499 raft_consensus.cc:2781] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:22:50.438742 13499 raft_consensus.cc:686] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73 [term 1 LEADER]: Becoming Leader. State: Replica: 016cad2bd9de49b8a2191bc635b01d73, State: Running, Role: LEADER
I20260809 09:22:50.438994 13499 consensus_queue.cc:237] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:50.441485 12899 catalog_manager.cc:5495] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 016cad2bd9de49b8a2191bc635b01d73 (127.11.99.193). New cstate: current_term: 1 leader_uuid: "016cad2bd9de49b8a2191bc635b01d73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } health_report { overall_health: UNKNOWN } } }
Aug 09 09:22:50 dist-test-slave-pgkr krb5kdc[12853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267368, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:22:50.528566 13528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:50.520158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:39507 (local address 127.0.0.1:43526)
0809 09:22:50.520465 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:50.520480 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:50.520617 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:50.520875 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:50.520878 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:50.521282 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:22:50.521370 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:50.521376 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.522121 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.522127 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:50.522729 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:50.522738 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.523216 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.523220 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:50.523303 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:50.523927 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:22:50.523939 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:22:50.525432 (+ 1493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:22:50.527039 (+ 1607us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:50.527047 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:50.527052 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:50.527289 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:50.527516 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:50.527517 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:50.527519 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:50.527590 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:50.527994 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:22:50.528000 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:22:50.528105 (+ 105us) client_negotiation.cc:769] Sending connection context
0809 09:22:50.528218 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 09:22:50.528371 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":91,"threads_started":1}
I20260809 09:22:50.528566 13529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:50.520189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43526 (local address 127.11.99.254:39507)
0809 09:22:50.520439 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:50.520448 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:50.520562 (+ 114us) server_negotiation.cc:407] Connection header received
0809 09:22:50.520709 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:50.520713 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:50.520762 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:50.520856 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:50.521491 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.522012 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.522846 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.523082 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.523200 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:50.525574 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:50.525577 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:50.525579 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:50.525599 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:50.526940 (+ 1341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:50.527369 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:50.527371 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:50.527373 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:50.527443 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:50.527686 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:50.527689 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:50.527691 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:50.527874 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:50.527998 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:50.528280 (+ 282us) server_negotiation.cc:299] Negotiation successful
0809 09:22:50.528443 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":198,"thread_start_us":123,"threads_started":1}
I20260809 09:22:50.532713 12899 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:43526:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 09:22:50.533476 12899 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:22:50.538340 13062 tablet_service.cc:1467] Processing CreateTablet for tablet 628b0579298d4accaf3cbadc1c13f7e7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=49bba775103d451098ca4c1841b68b37]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 09:22:50.538403 13221 tablet_service.cc:1467] Processing CreateTablet for tablet 628b0579298d4accaf3cbadc1c13f7e7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=49bba775103d451098ca4c1841b68b37]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 09:22:50.538427 13379 tablet_service.cc:1467] Processing CreateTablet for tablet 628b0579298d4accaf3cbadc1c13f7e7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=49bba775103d451098ca4c1841b68b37]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 09:22:50.538772 13379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 628b0579298d4accaf3cbadc1c13f7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:50.538769 13062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 628b0579298d4accaf3cbadc1c13f7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:50.538800 13221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 628b0579298d4accaf3cbadc1c13f7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:50.541409 13512 tablet_bootstrap.cc:492] T 628b0579298d4accaf3cbadc1c13f7e7 P 6f04d153d8e94cb6bf19b85b790b3a7b: Bootstrap starting.
I20260809 09:22:50.541581 13514 tablet_bootstrap.cc:492] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe: Bootstrap starting.
I20260809 09:22:50.542526 13514 tablet_bootstrap.cc:654] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:50.542526 13512 tablet_bootstrap.cc:654] T 628b0579298d4accaf3cbadc1c13f7e7 P 6f04d153d8e94cb6bf19b85b790b3a7b: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:50.542774 13513 tablet_bootstrap.cc:492] T 628b0579298d4accaf3cbadc1c13f7e7 P 016cad2bd9de49b8a2191bc635b01d73: Bootstrap starting.
I20260809 09:22:50.543712 13513 tablet_bootstrap.cc:654] T 628b0579298d4accaf3cbadc1c13f7e7 P 016cad2bd9de49b8a2191bc635b01d73: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:50.543855 13512 tablet_bootstrap.cc:492] T 628b0579298d4accaf3cbadc1c13f7e7 P 6f04d153d8e94cb6bf19b85b790b3a7b: No bootstrap required, opened a new log
I20260809 09:22:50.543917 13512 ts_tablet_manager.cc:1397] T 628b0579298d4accaf3cbadc1c13f7e7 P 6f04d153d8e94cb6bf19b85b790b3a7b: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260809 09:22:50.544312 13512 raft_consensus.cc:348] T 628b0579298d4accaf3cbadc1c13f7e7 P 6f04d153d8e94cb6bf19b85b790b3a7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:50.544432 13512 raft_consensus.cc:374] T 628b0579298d4accaf3cbadc1c13f7e7 P 6f04d153d8e94cb6bf19b85b790b3a7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:50.544479 13512 raft_consensus.cc:729] T 628b0579298d4accaf3cbadc1c13f7e7 P 6f04d153d8e94cb6bf19b85b790b3a7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f04d153d8e94cb6bf19b85b790b3a7b, State: Initialized, Role: FOLLOWER
I20260809 09:22:50.544626 13512 consensus_queue.cc:260] T 628b0579298d4accaf3cbadc1c13f7e7 P 6f04d153d8e94cb6bf19b85b790b3a7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:50.544914 13512 ts_tablet_manager.cc:1428] T 628b0579298d4accaf3cbadc1c13f7e7 P 6f04d153d8e94cb6bf19b85b790b3a7b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 09:22:50.544974 13513 tablet_bootstrap.cc:492] T 628b0579298d4accaf3cbadc1c13f7e7 P 016cad2bd9de49b8a2191bc635b01d73: No bootstrap required, opened a new log
I20260809 09:22:50.545070 13513 ts_tablet_manager.cc:1397] T 628b0579298d4accaf3cbadc1c13f7e7 P 016cad2bd9de49b8a2191bc635b01d73: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 09:22:50.545176 13494 tablet_replica.cc:439] T 628b0579298d4accaf3cbadc1c13f7e7 P 6f04d153d8e94cb6bf19b85b790b3a7b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } } }
I20260809 09:22:50.545334 13494 tablet_replica.cc:442] T 628b0579298d4accaf3cbadc1c13f7e7 P 6f04d153d8e94cb6bf19b85b790b3a7b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 09:22:50.545548 13513 raft_consensus.cc:348] T 628b0579298d4accaf3cbadc1c13f7e7 P 016cad2bd9de49b8a2191bc635b01d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:50.545655 13513 raft_consensus.cc:374] T 628b0579298d4accaf3cbadc1c13f7e7 P 016cad2bd9de49b8a2191bc635b01d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:50.545687 13513 raft_consensus.cc:729] T 628b0579298d4accaf3cbadc1c13f7e7 P 016cad2bd9de49b8a2191bc635b01d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 016cad2bd9de49b8a2191bc635b01d73, State: Initialized, Role: FOLLOWER
I20260809 09:22:50.545826 13513 consensus_queue.cc:260] T 628b0579298d4accaf3cbadc1c13f7e7 P 016cad2bd9de49b8a2191bc635b01d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:50.546121 13513 ts_tablet_manager.cc:1428] T 628b0579298d4accaf3cbadc1c13f7e7 P 016cad2bd9de49b8a2191bc635b01d73: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 09:22:50.546205 13514 tablet_bootstrap.cc:492] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe: No bootstrap required, opened a new log
I20260809 09:22:50.546315 13514 ts_tablet_manager.cc:1397] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260809 09:22:50.546316 13499 tablet_replica.cc:439] T 628b0579298d4accaf3cbadc1c13f7e7 P 016cad2bd9de49b8a2191bc635b01d73: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } } }
I20260809 09:22:50.546415 13499 tablet_replica.cc:442] T 628b0579298d4accaf3cbadc1c13f7e7 P 016cad2bd9de49b8a2191bc635b01d73: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 09:22:50.546900 13514 raft_consensus.cc:348] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:50.547025 13514 raft_consensus.cc:374] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:50.547051 13514 raft_consensus.cc:729] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf3fa43862244a1ea13f10d3080f7afe, State: Initialized, Role: FOLLOWER
I20260809 09:22:50.547195 13514 consensus_queue.cc:260] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:50.547930 13485 tablet_replica.cc:439] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } } }
I20260809 09:22:50.548046 13485 tablet_replica.cc:442] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 09:22:50.548310 13514 ts_tablet_manager.cc:1428] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260809 09:22:50.707769 13485 raft_consensus.cc:482] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:22:50.707944 13485 raft_consensus.cc:504] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:50.708400 13485 leader_election.cc:288] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 016cad2bd9de49b8a2191bc635b01d73 (127.11.99.193:45285), 6f04d153d8e94cb6bf19b85b790b3a7b (127.11.99.194:34989)
I20260809 09:22:50.708953 13245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "628b0579298d4accaf3cbadc1c13f7e7" candidate_uuid: "cf3fa43862244a1ea13f10d3080f7afe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" is_pre_election: true
I20260809 09:22:50.708953 13086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "628b0579298d4accaf3cbadc1c13f7e7" candidate_uuid: "cf3fa43862244a1ea13f10d3080f7afe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016cad2bd9de49b8a2191bc635b01d73" is_pre_election: true
I20260809 09:22:50.709116 13245 raft_consensus.cc:2454] T 628b0579298d4accaf3cbadc1c13f7e7 P 6f04d153d8e94cb6bf19b85b790b3a7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf3fa43862244a1ea13f10d3080f7afe in term 0.
I20260809 09:22:50.709116 13086 raft_consensus.cc:2454] T 628b0579298d4accaf3cbadc1c13f7e7 P 016cad2bd9de49b8a2191bc635b01d73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf3fa43862244a1ea13f10d3080f7afe in term 0.
I20260809 09:22:50.709427 13326 leader_election.cc:302] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f04d153d8e94cb6bf19b85b790b3a7b, cf3fa43862244a1ea13f10d3080f7afe; no voters:
I20260809 09:22:50.709597 13485 raft_consensus.cc:2781] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:22:50.709656 13485 raft_consensus.cc:482] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:22:50.709697 13485 raft_consensus.cc:3037] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:50.710700 13485 raft_consensus.cc:504] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:50.711032 13485 leader_election.cc:288] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe [CANDIDATE]: Term 1 election: Requested vote from peers 016cad2bd9de49b8a2191bc635b01d73 (127.11.99.193:45285), 6f04d153d8e94cb6bf19b85b790b3a7b (127.11.99.194:34989)
I20260809 09:22:50.711444 13086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "628b0579298d4accaf3cbadc1c13f7e7" candidate_uuid: "cf3fa43862244a1ea13f10d3080f7afe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016cad2bd9de49b8a2191bc635b01d73"
I20260809 09:22:50.711445 13245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "628b0579298d4accaf3cbadc1c13f7e7" candidate_uuid: "cf3fa43862244a1ea13f10d3080f7afe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b"
I20260809 09:22:50.711573 13086 raft_consensus.cc:3037] T 628b0579298d4accaf3cbadc1c13f7e7 P 016cad2bd9de49b8a2191bc635b01d73 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:50.711584 13245 raft_consensus.cc:3037] T 628b0579298d4accaf3cbadc1c13f7e7 P 6f04d153d8e94cb6bf19b85b790b3a7b [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:50.712852 13086 raft_consensus.cc:2454] T 628b0579298d4accaf3cbadc1c13f7e7 P 016cad2bd9de49b8a2191bc635b01d73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf3fa43862244a1ea13f10d3080f7afe in term 1.
I20260809 09:22:50.712868 13245 raft_consensus.cc:2454] T 628b0579298d4accaf3cbadc1c13f7e7 P 6f04d153d8e94cb6bf19b85b790b3a7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf3fa43862244a1ea13f10d3080f7afe in term 1.
I20260809 09:22:50.713156 13326 leader_election.cc:302] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f04d153d8e94cb6bf19b85b790b3a7b, cf3fa43862244a1ea13f10d3080f7afe; no voters:
I20260809 09:22:50.713341 13485 raft_consensus.cc:2781] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:22:50.713553 13485 raft_consensus.cc:686] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe [term 1 LEADER]: Becoming Leader. State: Replica: cf3fa43862244a1ea13f10d3080f7afe, State: Running, Role: LEADER
I20260809 09:22:50.713817 13485 consensus_queue.cc:237] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } }
I20260809 09:22:50.715210 13533 tablet_replica.cc:439] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe: TxnStatusTablet state changed. Reason: New leader cf3fa43862244a1ea13f10d3080f7afe. Latest consensus state: current_term: 1 leader_uuid: "cf3fa43862244a1ea13f10d3080f7afe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } } }
I20260809 09:22:50.715319 13533 tablet_replica.cc:442] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe: This TxnStatusTablet replica's current role is: LEADER
I20260809 09:22:50.715557 13535 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 09:22:50.715755 13535 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 09:22:50.716466 12900 catalog_manager.cc:5495] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe reported cstate change: term changed from 0 to 1, leader changed from <none> to cf3fa43862244a1ea13f10d3080f7afe (127.11.99.195). New cstate: current_term: 1 leader_uuid: "cf3fa43862244a1ea13f10d3080f7afe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } health_report { overall_health: HEALTHY } } }
I20260809 09:22:50.735678 13475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:50.731958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42098 (local address 127.11.99.195:38855)
0809 09:22:50.732072 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:50.732075 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:50.732087 (+ 12us) server_negotiation.cc:407] Connection header received
0809 09:22:50.732303 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:50.732305 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:50.732355 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:50.732437 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:22:50.732693 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.733171 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.734363 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.734596 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.734722 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:50.735002 (+ 280us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:22:50.735355 (+ 353us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:22:50.735433 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:50.735521 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 09:22:50.735565 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 09:22:50.735736 13528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:50.731846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:38855 (local address 127.0.0.1:42098)
0809 09:22:50.732035 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:50.732051 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:50.732144 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:50.732469 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:50.732472 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:50.732480 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 09:22:50.732595 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:50.732601 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.733326 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.733329 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:50.734237 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:50.734248 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.734735 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.734738 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:50.734828 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:50.734877 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 09:22:50.735438 (+ 561us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 09:22:50.735451 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 09:22:50.735525 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 09:22:50.735607 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 09:22:50.738500 13086 raft_consensus.cc:1261] T 628b0579298d4accaf3cbadc1c13f7e7 P 016cad2bd9de49b8a2191bc635b01d73 [term 1 FOLLOWER]: Refusing update from remote peer cf3fa43862244a1ea13f10d3080f7afe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:22:50.738636 13245 raft_consensus.cc:1261] T 628b0579298d4accaf3cbadc1c13f7e7 P 6f04d153d8e94cb6bf19b85b790b3a7b [term 1 FOLLOWER]: Refusing update from remote peer cf3fa43862244a1ea13f10d3080f7afe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:22:50.739004 13533 consensus_queue.cc:1035] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe [LEADER]: Connected to new peer: Peer: permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:22:50.739200 13485 consensus_queue.cc:1035] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:22:50.740484 13499 tablet_replica.cc:439] T 628b0579298d4accaf3cbadc1c13f7e7 P 016cad2bd9de49b8a2191bc635b01d73: TxnStatusTablet state changed. Reason: New leader cf3fa43862244a1ea13f10d3080f7afe. Latest consensus state: current_term: 1 leader_uuid: "cf3fa43862244a1ea13f10d3080f7afe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } } }
I20260809 09:22:50.740585 13499 tablet_replica.cc:442] T 628b0579298d4accaf3cbadc1c13f7e7 P 016cad2bd9de49b8a2191bc635b01d73: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 09:22:50.740816 13494 tablet_replica.cc:439] T 628b0579298d4accaf3cbadc1c13f7e7 P 6f04d153d8e94cb6bf19b85b790b3a7b: TxnStatusTablet state changed. Reason: New leader cf3fa43862244a1ea13f10d3080f7afe. Latest consensus state: current_term: 1 leader_uuid: "cf3fa43862244a1ea13f10d3080f7afe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } } }
I20260809 09:22:50.740919 13494 tablet_replica.cc:442] T 628b0579298d4accaf3cbadc1c13f7e7 P 6f04d153d8e94cb6bf19b85b790b3a7b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 09:22:50.743113 13533 tablet_replica.cc:439] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cf3fa43862244a1ea13f10d3080f7afe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } } }
I20260809 09:22:50.743245 13533 tablet_replica.cc:442] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe: This TxnStatusTablet replica's current role is: LEADER
I20260809 09:22:50.743268 13538 mvcc.cc:205] Tried to move back new op lower bound from 7316551150540230656 to 7316551150446477312. Current Snapshot: MvccSnapshot[applied={T|T < 7316551150540230656}]
I20260809 09:22:50.743875 13494 tablet_replica.cc:439] T 628b0579298d4accaf3cbadc1c13f7e7 P 6f04d153d8e94cb6bf19b85b790b3a7b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cf3fa43862244a1ea13f10d3080f7afe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } } }
I20260809 09:22:50.743964 13494 tablet_replica.cc:442] T 628b0579298d4accaf3cbadc1c13f7e7 P 6f04d153d8e94cb6bf19b85b790b3a7b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 09:22:50.747823 13533 tablet_replica.cc:439] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cf3fa43862244a1ea13f10d3080f7afe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } } }
I20260809 09:22:50.747924 13533 tablet_replica.cc:442] T 628b0579298d4accaf3cbadc1c13f7e7 P cf3fa43862244a1ea13f10d3080f7afe: This TxnStatusTablet replica's current role is: LEADER
I20260809 09:22:50.749167 13499 tablet_replica.cc:439] T 628b0579298d4accaf3cbadc1c13f7e7 P 016cad2bd9de49b8a2191bc635b01d73: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cf3fa43862244a1ea13f10d3080f7afe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016cad2bd9de49b8a2191bc635b01d73" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45285 } } peers { permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 } } peers { permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 } } }
I20260809 09:22:50.749261 13499 tablet_replica.cc:442] T 628b0579298d4accaf3cbadc1c13f7e7 P 016cad2bd9de49b8a2191bc635b01d73: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 09:22:50.754278 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:50.750689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57328 (local address 127.11.99.193:45285)
0809 09:22:50.750896 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:50.750901 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:50.750913 (+ 12us) server_negotiation.cc:407] Connection header received
0809 09:22:50.750973 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:50.750976 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:50.751027 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:50.751288 (+ 261us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:22:50.751467 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.752124 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.752868 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.753208 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.753316 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:50.753520 (+ 204us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:22:50.753975 (+ 455us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:22:50.754077 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:50.754111 (+ 34us) server_negotiation.cc:299] Negotiation successful
0809 09:22:50.754158 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":70,"threads_started":1}
I20260809 09:22:50.763998 13475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:50.760476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:52221 (local address 127.11.99.195:38855)
0809 09:22:50.760619 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:50.760623 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:50.761044 (+ 421us) server_negotiation.cc:407] Connection header received
0809 09:22:50.761194 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:50.761196 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:50.761242 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:50.761301 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:22:50.761559 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.762013 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.762932 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.763188 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.763304 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:50.763577 (+ 273us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:22:50.763650 (+ 73us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:22:50.763725 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:50.763828 (+ 103us) server_negotiation.cc:299] Negotiation successful
0809 09:22:50.763874 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 09:22:50.764034 13556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:50.760363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:38855 (local address 127.11.99.193:52221)
0809 09:22:50.760944 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:50.760956 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:50.761057 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:50.761332 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:50.761335 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:50.761342 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 09:22:50.761452 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:50.761458 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.762135 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.762141 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:50.762812 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:50.762821 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.763304 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.763307 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:50.763399 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:50.763446 (+ 47us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 09:22:50.763752 (+ 306us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 09:22:50.763759 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 09:22:50.763818 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 09:22:50.763893 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":393,"threads_started":1}
I20260809 09:22:50.770493 13245 raft_consensus.cc:1261] T e2b2e6750fe04393902908c70b2a1b6f P 6f04d153d8e94cb6bf19b85b790b3a7b [term 1 FOLLOWER]: Refusing update from remote peer 016cad2bd9de49b8a2191bc635b01d73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:22:50.770617 13402 raft_consensus.cc:1261] T e2b2e6750fe04393902908c70b2a1b6f P cf3fa43862244a1ea13f10d3080f7afe [term 1 FOLLOWER]: Refusing update from remote peer 016cad2bd9de49b8a2191bc635b01d73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:22:50.771209 13520 consensus_queue.cc:1035] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f04d153d8e94cb6bf19b85b790b3a7b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:22:50.771427 13499 consensus_queue.cc:1035] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf3fa43862244a1ea13f10d3080f7afe" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 38855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:22:50.777660 13540 mvcc.cc:205] Tried to move back new op lower bound from 7316551150672277504 to 7316551149320622080. Current Snapshot: MvccSnapshot[applied={T|T < 7316551150672277504}]
I20260809 09:22:50.796017 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:50.791775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:54569 (local address 127.11.99.193:45285)
0809 09:22:50.791929 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:50.791933 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:50.792400 (+ 467us) server_negotiation.cc:407] Connection header received
0809 09:22:50.792564 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:50.792567 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:50.792619 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:50.792709 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:22:50.793018 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.793874 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.794859 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.795211 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.795308 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:50.795567 (+ 259us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:22:50.795642 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:22:50.795713 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:50.795839 (+ 126us) server_negotiation.cc:299] Negotiation successful
0809 09:22:50.795889 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 09:22:50.796030 13560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:50.791624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:45285 (local address 127.11.99.195:54569)
0809 09:22:50.792130 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:50.792145 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:50.792425 (+ 280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:50.792738 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:50.792742 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:50.792750 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 09:22:50.792893 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:50.792902 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.793999 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.794004 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:50.794751 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:50.794761 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.795322 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.795324 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:50.795402 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:50.795443 (+ 41us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 09:22:50.795741 (+ 298us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 09:22:50.795749 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 09:22:50.795822 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 09:22:50.795899 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":176,"threads_started":1}
I20260809 09:22:50.821930 12900 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43522:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:22:50.822098 12900 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43522:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:22:50.824290 12900 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6eca17f11e3249d0b4060e71e60eb627: Sending DeleteTablet for 3 replicas of tablet e2b2e6750fe04393902908c70b2a1b6f
I20260809 09:22:50.824954 13379 tablet_service.cc:1514] Processing DeleteTablet for tablet e2b2e6750fe04393902908c70b2a1b6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:22:50 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:42084
I20260809 09:22:50.824990 13221 tablet_service.cc:1514] Processing DeleteTablet for tablet e2b2e6750fe04393902908c70b2a1b6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:22:50 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:33870
I20260809 09:22:50.825793 13062 tablet_service.cc:1514] Processing DeleteTablet for tablet e2b2e6750fe04393902908c70b2a1b6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:22:50 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:57318
I20260809 09:22:50.826246 13569 tablet_replica.cc:330] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73: stopping tablet replica
I20260809 09:22:50.826385 13566 tablet_replica.cc:330] T e2b2e6750fe04393902908c70b2a1b6f P cf3fa43862244a1ea13f10d3080f7afe: stopping tablet replica
I20260809 09:22:50.826408 13569 raft_consensus.cc:2229] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73 [term 1 LEADER]: Raft consensus shutting down.
I20260809 09:22:50.826553 13566 raft_consensus.cc:2229] T e2b2e6750fe04393902908c70b2a1b6f P cf3fa43862244a1ea13f10d3080f7afe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:22:50.826678 13566 raft_consensus.cc:2258] T e2b2e6750fe04393902908c70b2a1b6f P cf3fa43862244a1ea13f10d3080f7afe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:22:50.826915 13569 raft_consensus.cc:2258] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:22:50.827409 13566 ts_tablet_manager.cc:1905] T e2b2e6750fe04393902908c70b2a1b6f P cf3fa43862244a1ea13f10d3080f7afe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:22:50.827677 13569 ts_tablet_manager.cc:1905] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:22:50.830868 13566 ts_tablet_manager.cc:1918] T e2b2e6750fe04393902908c70b2a1b6f P cf3fa43862244a1ea13f10d3080f7afe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 09:22:50.830947 13566 log.cc:1196] T e2b2e6750fe04393902908c70b2a1b6f P cf3fa43862244a1ea13f10d3080f7afe: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/e2b2e6750fe04393902908c70b2a1b6f
I20260809 09:22:50.831255 13566 ts_tablet_manager.cc:1939] T e2b2e6750fe04393902908c70b2a1b6f P cf3fa43862244a1ea13f10d3080f7afe: Deleting consensus metadata
I20260809 09:22:50.831735 13569 ts_tablet_manager.cc:1918] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 09:22:50.831878 13569 log.cc:1196] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-0/wal/wals/e2b2e6750fe04393902908c70b2a1b6f
I20260809 09:22:50.831924 12886 catalog_manager.cc:4841] TS cf3fa43862244a1ea13f10d3080f7afe (127.11.99.195:38855): tablet e2b2e6750fe04393902908c70b2a1b6f (table test-table [id=faa54ebf782140aab8880ea513c9625b]) successfully deleted
I20260809 09:22:50.832370 13569 ts_tablet_manager.cc:1939] T e2b2e6750fe04393902908c70b2a1b6f P 016cad2bd9de49b8a2191bc635b01d73: Deleting consensus metadata
I20260809 09:22:50.832593 13567 tablet_replica.cc:330] T e2b2e6750fe04393902908c70b2a1b6f P 6f04d153d8e94cb6bf19b85b790b3a7b: stopping tablet replica
I20260809 09:22:50.832734 13567 raft_consensus.cc:2229] T e2b2e6750fe04393902908c70b2a1b6f P 6f04d153d8e94cb6bf19b85b790b3a7b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:22:50.832855 13567 raft_consensus.cc:2258] T e2b2e6750fe04393902908c70b2a1b6f P 6f04d153d8e94cb6bf19b85b790b3a7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:22:50.833724 13567 ts_tablet_manager.cc:1905] T e2b2e6750fe04393902908c70b2a1b6f P 6f04d153d8e94cb6bf19b85b790b3a7b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:22:50.833729 12885 catalog_manager.cc:4841] TS 016cad2bd9de49b8a2191bc635b01d73 (127.11.99.193:45285): tablet e2b2e6750fe04393902908c70b2a1b6f (table test-table [id=faa54ebf782140aab8880ea513c9625b]) successfully deleted
I20260809 09:22:50.836529 13567 ts_tablet_manager.cc:1918] T e2b2e6750fe04393902908c70b2a1b6f P 6f04d153d8e94cb6bf19b85b790b3a7b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 09:22:50.836621 13567 log.cc:1196] T e2b2e6750fe04393902908c70b2a1b6f P 6f04d153d8e94cb6bf19b85b790b3a7b: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/e2b2e6750fe04393902908c70b2a1b6f
I20260809 09:22:50.836863 13567 ts_tablet_manager.cc:1939] T e2b2e6750fe04393902908c70b2a1b6f P 6f04d153d8e94cb6bf19b85b790b3a7b: Deleting consensus metadata
I20260809 09:22:50.837682 12885 catalog_manager.cc:4841] TS 6f04d153d8e94cb6bf19b85b790b3a7b (127.11.99.194:34989): tablet e2b2e6750fe04393902908c70b2a1b6f (table test-table [id=faa54ebf782140aab8880ea513c9625b]) successfully deleted
Aug 09 09:22:50 dist-test-slave-pgkr krb5kdc[12853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267369, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.99.193@KRBTEST.COM
I20260809 09:22:50.847035 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:50.832503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57344 (local address 127.11.99.193:45285)
0809 09:22:50.832644 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:50.832650 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:50.834934 (+ 2284us) server_negotiation.cc:407] Connection header received
0809 09:22:50.835193 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:50.835196 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:50.835243 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:50.835293 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:50.836308 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.837070 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.838783 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.839201 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.839274 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:50.843163 (+ 3889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:50.843172 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:50.843185 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:50.843209 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:50.845063 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:50.845517 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:50.845523 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:50.845525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:50.845603 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:50.845863 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:50.845866 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:50.845868 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:50.846155 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:50.846311 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:50.846745 (+ 434us) server_negotiation.cc:299] Negotiation successful
0809 09:22:50.846865 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260809 09:22:50.847931 13132 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57344
I20260809 09:22:50.863631 13529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:50.850996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43530 (local address 127.11.99.254:39507)
0809 09:22:50.851107 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:50.851111 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:50.854891 (+ 3780us) server_negotiation.cc:407] Connection header received
0809 09:22:50.855127 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:50.855130 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:50.855185 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:50.855312 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:50.856057 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.856868 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.857867 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:50.858255 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:50.858356 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:50.859929 (+ 1573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:50.859934 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:50.859937 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:50.859962 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:50.861683 (+ 1721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:50.862213 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:50.862216 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:50.862218 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:50.862321 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:50.862721 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:50.862724 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:50.862726 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:50.862928 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:50.863066 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:50.863345 (+ 279us) server_negotiation.cc:299] Negotiation successful
0809 09:22:50.863474 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260809 09:22:50.864123 12900 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43530
I20260809 09:22:50.865574 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 12986
I20260809 09:22:50.874481 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 13150
I20260809 09:22:50.884517 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 13306
I20260809 09:22:50.892035 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 12867
2026-08-09T09:22:50Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3397 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:22:50 dist-test-slave-pgkr krb5kdc[13577](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:22:50 dist-test-slave-pgkr krb5kdc[13577](info): set up 2 sockets
Aug 09 09:22:50 dist-test-slave-pgkr krb5kdc[13577](info): commencing operation
krb5kdc: starting...
W20260809 09:22:51.956302 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.040s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:22:52 dist-test-slave-pgkr krb5kdc[13577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267372, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:22:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:22:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:22:52.071424 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:44465
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:46019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:44465
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:22:52.175231 13591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:22:52.175537 13591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:22:52.175604 13591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:22:52.179131 13591 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:22:52.179212 13591 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 09:22:52.179251 13591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:22:52.179322 13591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:22:52.179359 13591 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:22:52.179391 13591 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:22:52.184101 13591 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:46019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:44465
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:44465
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13591
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:22:52.185015 13591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:22:52.185962 13591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:22:52.194015 13598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:52.193974 13601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:52.194111 13591 server_base.cc:1034] running on GCE node
W20260809 09:22:52.194031 13603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:52.194847 13591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:22:52.195938 13591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:22:52.197124 13591 hybrid_clock.cc:648] HybridClock initialized: now 1786267372197086 us; error 58 us; skew 500 ppm
Aug 09 09:22:52 dist-test-slave-pgkr krb5kdc[13577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267372, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:22:52.204694 13591 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:22:52.205605 13591 webserver.cc:460] Webserver started at http://127.11.99.254:39821/ using document root <none> and password file <none>
I20260809 09:22:52.206172 13591 fs_manager.cc:359] Metadata directory not provided
I20260809 09:22:52.206243 13591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:22:52.206415 13591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:22:52.208458 13591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "d22077d0e67e4285ac1e8be576e4ffe4"
format_stamp: "Formatted at 2026-08-09 09:22:52 on dist-test-slave-pgkr"
server_key: "7333e902870a553daa2da3de446dd244"
server_key_iv: "3c68fcd9e6e3af361c0d38001585c321"
server_key_version: "encryptionkey@0"
I20260809 09:22:52.208971 13591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "d22077d0e67e4285ac1e8be576e4ffe4"
format_stamp: "Formatted at 2026-08-09 09:22:52 on dist-test-slave-pgkr"
server_key: "7333e902870a553daa2da3de446dd244"
server_key_iv: "3c68fcd9e6e3af361c0d38001585c321"
server_key_version: "encryptionkey@0"
I20260809 09:22:52.212662 13591 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:22:52.214915 13610 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:52.216058 13591 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 09:22:52.216159 13591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "d22077d0e67e4285ac1e8be576e4ffe4"
format_stamp: "Formatted at 2026-08-09 09:22:52 on dist-test-slave-pgkr"
server_key: "7333e902870a553daa2da3de446dd244"
server_key_iv: "3c68fcd9e6e3af361c0d38001585c321"
server_key_version: "encryptionkey@0"
I20260809 09:22:52.216327 13591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:22:52.228683 13591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:22:52.231261 13591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:22:52.231393 13591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:22:52.239020 13591 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:44465
I20260809 09:22:52.239048 13681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:44465 every 8 connection(s)
I20260809 09:22:52.239867 13591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:22:52.242309 13682 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:52.246878 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 13591
I20260809 09:22:52.247004 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:22:52.247325 11663 external_mini_cluster.cc:1428] Setting key 5919c328ad207f17800789f46e47f86e
I20260809 09:22:52.247973 13682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4: Bootstrap starting.
I20260809 09:22:52.250257 13682 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:52.251013 13682 log.cc:824] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4: Log is configured to *not* fsync() on all Append() calls
I20260809 09:22:52.252637 13682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4: No bootstrap required, opened a new log
Aug 09 09:22:52 dist-test-slave-pgkr krb5kdc[13577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267372, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:22:52.255754 13682 raft_consensus.cc:348] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22077d0e67e4285ac1e8be576e4ffe4" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 44465 } }
I20260809 09:22:52.255990 13682 raft_consensus.cc:374] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:52.256058 13682 raft_consensus.cc:729] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22077d0e67e4285ac1e8be576e4ffe4, State: Initialized, Role: FOLLOWER
I20260809 09:22:52.256486 13682 consensus_queue.cc:260] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22077d0e67e4285ac1e8be576e4ffe4" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 44465 } }
I20260809 09:22:52.256644 13682 raft_consensus.cc:388] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:22:52.256701 13682 raft_consensus.cc:482] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:22:52.256799 13682 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:52.257833 13682 raft_consensus.cc:504] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22077d0e67e4285ac1e8be576e4ffe4" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 44465 } }
I20260809 09:22:52.258195 13682 leader_election.cc:302] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d22077d0e67e4285ac1e8be576e4ffe4; no voters:
I20260809 09:22:52.258541 13682 leader_election.cc:288] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:22:52.258665 13688 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:22:52.258890 13688 raft_consensus.cc:686] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4 [term 1 LEADER]: Becoming Leader. State: Replica: d22077d0e67e4285ac1e8be576e4ffe4, State: Running, Role: LEADER
I20260809 09:22:52.259267 13688 consensus_queue.cc:237] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22077d0e67e4285ac1e8be576e4ffe4" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 44465 } }
I20260809 09:22:52.259723 13682 sys_catalog.cc:564] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:22:52.261164 13691 sys_catalog.cc:455] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d22077d0e67e4285ac1e8be576e4ffe4. Latest consensus state: current_term: 1 leader_uuid: "d22077d0e67e4285ac1e8be576e4ffe4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22077d0e67e4285ac1e8be576e4ffe4" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 44465 } } }
I20260809 09:22:52.261164 13690 sys_catalog.cc:455] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d22077d0e67e4285ac1e8be576e4ffe4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22077d0e67e4285ac1e8be576e4ffe4" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 44465 } } }
I20260809 09:22:52.261397 13690 sys_catalog.cc:458] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4 [sys.catalog]: This master's current role is: LEADER
I20260809 09:22:52.261397 13691 sys_catalog.cc:458] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4 [sys.catalog]: This master's current role is: LEADER
I20260809 09:22:52.261909 13686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:52.248544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41540 (local address 127.11.99.254:44465)
0809 09:22:52.249164 (+ 620us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:52.249185 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:52.249228 (+ 43us) server_negotiation.cc:407] Connection header received
0809 09:22:52.249854 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:52.249868 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:52.250175 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:52.250501 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:52.251386 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.252293 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.253193 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.253651 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.253849 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:52.256178 (+ 2329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:52.256183 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:52.256195 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:52.256220 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:52.258103 (+ 1883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:52.258709 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:52.258717 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:52.258723 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:52.258877 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:52.259201 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:52.259205 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:52.259206 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:52.259680 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:52.259885 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:52.260508 (+ 623us) server_negotiation.cc:299] Negotiation successful
0809 09:22:52.260820 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":112,"threads_started":1}
W20260809 09:22:52.264554 13706 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 09:22:52.264616 13706 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 09:22:52.264695 13705 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:22:52.265364 13705 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:22:52.271121 13705 catalog_manager.cc:1347] Generated new cluster ID: 76c97aba37bc4962a17df013d28a92b7
I20260809 09:22:52.271180 13705 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:22:52.286165 13705 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:22:52.287317 13705 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:22:52.294052 13705 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4: Generated new TSK 0
I20260809 09:22:52.294754 13705 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.99.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
I20260809 09:22:52.323293 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:0
--local_ip_for_outbound_sockets=127.11.99.193
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:44465
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:46019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:22:52.430107 13712 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:22:52.430333 13712 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:22:52.430377 13712 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:22:52.434201 13712 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:22:52.434257 13712 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:22:52.434293 13712 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 09:22:52.434306 13712 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 09:22:52.434335 13712 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:22:52.439388 13712 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:46019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.99.254:44465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13712
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:22:52.440223 13712 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:22:52.441094 13712 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:22:52.449945 13718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:52.449982 13712 server_base.cc:1034] running on GCE node
W20260809 09:22:52.449942 13717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:52.449947 13720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:52.450547 13712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:22:52.451159 13712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:22:52.452315 13712 hybrid_clock.cc:648] HybridClock initialized: now 1786267372452304 us; error 31 us; skew 500 ppm
Aug 09 09:22:52 dist-test-slave-pgkr krb5kdc[13577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267372, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:22:52.455087 13712 init.cc:377] Logged in from keytab as kudu/127.11.99.193@KRBTEST.COM (short username kudu)
I20260809 09:22:52.455996 13712 webserver.cc:460] Webserver started at http://127.11.99.193:43229/ using document root <none> and password file <none>
I20260809 09:22:52.456544 13712 fs_manager.cc:359] Metadata directory not provided
I20260809 09:22:52.456605 13712 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:22:52.456830 13712 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:22:52.458847 13712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-0/data/instance:
uuid: "2dfed5e7f0054adf8bd349c94ae4f355"
format_stamp: "Formatted at 2026-08-09 09:22:52 on dist-test-slave-pgkr"
server_key: "1ea1776da69748a7c5dec13b650a314f"
server_key_iv: "1edd878104c9d0403efce76dfa625c6b"
server_key_version: "encryptionkey@0"
I20260809 09:22:52.459481 13712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance:
uuid: "2dfed5e7f0054adf8bd349c94ae4f355"
format_stamp: "Formatted at 2026-08-09 09:22:52 on dist-test-slave-pgkr"
server_key: "1ea1776da69748a7c5dec13b650a314f"
server_key_iv: "1edd878104c9d0403efce76dfa625c6b"
server_key_version: "encryptionkey@0"
I20260809 09:22:52.463084 13712 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 09:22:52.465225 13728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:52.466332 13712 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:22:52.466463 13712 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "2dfed5e7f0054adf8bd349c94ae4f355"
format_stamp: "Formatted at 2026-08-09 09:22:52 on dist-test-slave-pgkr"
server_key: "1ea1776da69748a7c5dec13b650a314f"
server_key_iv: "1edd878104c9d0403efce76dfa625c6b"
server_key_version: "encryptionkey@0"
I20260809 09:22:52.466569 13712 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:22:52.480778 13712 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:22:52.483901 13712 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:22:52.484092 13712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:22:52.485500 13712 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:22:52.485571 13712 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:52.485637 13712 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:22:52.485690 13712 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 09:22:52 dist-test-slave-pgkr krb5kdc[13577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267372, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:22:52.496340 13712 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:38125
I20260809 09:22:52.497495 13712 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:22:52.497481 13858 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:38125 every 8 connection(s)
I20260809 09:22:52.499097 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 13712
I20260809 09:22:52.499190 13686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:52.486146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:37557 (local address 127.11.99.254:44465)
0809 09:22:52.486309 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:52.486315 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:52.487601 (+ 1286us) server_negotiation.cc:407] Connection header received
0809 09:22:52.488976 (+ 1375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:52.488981 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:52.489046 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:52.489114 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:52.490685 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.491279 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.492455 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.492711 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.492825 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:52.495101 (+ 2276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:52.495105 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:52.495109 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:52.495137 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:52.496876 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:52.497530 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:52.497533 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:52.497535 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:52.497651 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:52.498021 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:52.498024 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:52.498026 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:52.498250 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:52.498338 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:52.498886 (+ 548us) server_negotiation.cc:299] Negotiation successful
0809 09:22:52.499016 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 09:22:52.499222 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance
I20260809 09:22:52.499511 11663 external_mini_cluster.cc:1428] Setting key 348b5d478cbd628deff4eb114f201b65
I20260809 09:22:52.499863 13738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:52.486959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:44465 (local address 127.11.99.193:37557)
0809 09:22:52.487444 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:52.487496 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:52.488716 (+ 1220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:52.489319 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:52.489327 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:52.489810 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:22:52.490502 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:52.490523 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.491407 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.491417 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:52.492322 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:52.492343 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.492871 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.492875 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:52.493023 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:52.493547 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:22:52.493562 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:22:52.494942 (+ 1380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:22:52.497020 (+ 2078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:52.497025 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:52.497037 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:52.497388 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:52.497761 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:52.497769 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:52.497771 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:52.497889 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:52.498356 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:22:52.498362 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:22:52.498587 (+ 225us) client_negotiation.cc:769] Sending connection context
0809 09:22:52.498800 (+ 213us) client_negotiation.cc:240] Negotiation successful
0809 09:22:52.499023 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":101,"threads_started":1}
I20260809 09:22:52.501106 13859 heartbeater.cc:347] Connected to a master server at 127.11.99.254:44465
I20260809 09:22:52.501283 13859 heartbeater.cc:464] Registering TS with master...
I20260809 09:22:52.501835 13859 heartbeater.cc:511] Master 127.11.99.254:44465 requested a full tablet report, sending...
I20260809 09:22:52.503432 13629 ts_manager.cc:194] Registered new tserver with Master: 2dfed5e7f0054adf8bd349c94ae4f355 (127.11.99.193:38125)
I20260809 09:22:52.504606 13629 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.193@KRBTEST.COM'} at 127.11.99.193:37557
WARNING: no policy specified for kudu/127.11.99.194@KRBTEST.COM; defaulting to no policy
I20260809 09:22:52.511710 13866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:52.503205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:44465 (local address 127.11.99.193:34961)
0809 09:22:52.503482 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:52.503500 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:52.503592 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:52.505452 (+ 1860us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:52.505458 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:52.505696 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:22:52.505843 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:52.505853 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.506812 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.506815 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:52.507340 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:52.507348 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.507799 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.507802 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:52.507892 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:52.508361 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:22:52.508372 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:22:52.508646 (+ 274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:22:52.510195 (+ 1549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:52.510199 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:52.510201 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:52.510390 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:52.510710 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:52.510713 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:52.510732 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:52.510816 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:52.511177 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:22:52.511181 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:22:52.511283 (+ 102us) client_negotiation.cc:769] Sending connection context
0809 09:22:52.511389 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 09:22:52.511552 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":86,"threads_started":1}
I20260809 09:22:52.511696 13686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:52.505141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:34961 (local address 127.11.99.254:44465)
0809 09:22:52.505256 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:52.505259 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:52.505270 (+ 11us) server_negotiation.cc:407] Connection header received
0809 09:22:52.505295 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:52.505297 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:52.505327 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:52.505435 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:52.505976 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.506687 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.507468 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.507685 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.507796 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:52.508780 (+ 984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:52.508784 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:52.508786 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:52.508808 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:52.510090 (+ 1282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:52.510492 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:52.510495 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:52.510497 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:52.510596 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:52.510909 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:52.510913 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:52.510915 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:52.511082 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:52.511187 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:52.511446 (+ 259us) server_negotiation.cc:299] Negotiation successful
0809 09:22:52.511551 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
I20260809 09:22:52.527961 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:0
--local_ip_for_outbound_sockets=127.11.99.194
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:44465
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:46019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:22:52.637066 13868 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:22:52.637290 13868 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:22:52.637384 13868 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:22:52.641412 13868 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:22:52.641458 13868 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:22:52.641528 13868 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 09:22:52.641542 13868 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 09:22:52.641571 13868 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:22:52.646421 13868 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:46019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.99.254:44465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13868
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:22:52.647297 13868 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:22:52.648211 13868 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:22:52.656962 13878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:52.657107 13868 server_base.cc:1034] running on GCE node
W20260809 09:22:52.656948 13875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:52.657054 13876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:52.657660 13868 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:22:52.658272 13868 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:22:52.659442 13868 hybrid_clock.cc:648] HybridClock initialized: now 1786267372659416 us; error 37 us; skew 500 ppm
Aug 09 09:22:52 dist-test-slave-pgkr krb5kdc[13577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267372, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:22:52.662181 13868 init.cc:377] Logged in from keytab as kudu/127.11.99.194@KRBTEST.COM (short username kudu)
I20260809 09:22:52.663018 13868 webserver.cc:460] Webserver started at http://127.11.99.194:38695/ using document root <none> and password file <none>
I20260809 09:22:52.663528 13868 fs_manager.cc:359] Metadata directory not provided
I20260809 09:22:52.663583 13868 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:22:52.663759 13868 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:22:52.665666 13868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-1/data/instance:
uuid: "78a41f52bfbd49c2bb83f6c11aa17a29"
format_stamp: "Formatted at 2026-08-09 09:22:52 on dist-test-slave-pgkr"
server_key: "aa7a244d55c691561411dece6d3b4632"
server_key_iv: "d1971fa0dbfea8072d2ee310677e12c9"
server_key_version: "encryptionkey@0"
I20260809 09:22:52.666144 13868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance:
uuid: "78a41f52bfbd49c2bb83f6c11aa17a29"
format_stamp: "Formatted at 2026-08-09 09:22:52 on dist-test-slave-pgkr"
server_key: "aa7a244d55c691561411dece6d3b4632"
server_key_iv: "d1971fa0dbfea8072d2ee310677e12c9"
server_key_version: "encryptionkey@0"
I20260809 09:22:52.669499 13868 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260809 09:22:52.671701 13886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:52.672811 13868 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 09:22:52.672921 13868 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "78a41f52bfbd49c2bb83f6c11aa17a29"
format_stamp: "Formatted at 2026-08-09 09:22:52 on dist-test-slave-pgkr"
server_key: "aa7a244d55c691561411dece6d3b4632"
server_key_iv: "d1971fa0dbfea8072d2ee310677e12c9"
server_key_version: "encryptionkey@0"
I20260809 09:22:52.673017 13868 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:22:52.694586 13868 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:22:52.697161 13868 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:22:52.697345 13868 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:22:52.698767 13868 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:22:52.698823 13868 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:52.698880 13868 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:22:52.698915 13868 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 09:22:52 dist-test-slave-pgkr krb5kdc[13577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267372, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:22:52.709337 13868 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:41589
I20260809 09:22:52.709393 14020 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:41589 every 8 connection(s)
I20260809 09:22:52.710131 13868 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:22:52.712174 13686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:52.699395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:55927 (local address 127.11.99.254:44465)
0809 09:22:52.699556 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:52.699563 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:52.700837 (+ 1274us) server_negotiation.cc:407] Connection header received
0809 09:22:52.702165 (+ 1328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:52.702167 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:52.702211 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:52.702282 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:52.703881 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.704494 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.705739 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.705956 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.706059 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:52.708690 (+ 2631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:52.708694 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:52.708696 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:52.708720 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:52.710266 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:52.710848 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:52.710851 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:52.710852 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:52.710943 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:52.711293 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:52.711296 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:52.711297 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:52.711468 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:52.711571 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:52.711967 (+ 396us) server_negotiation.cc:299] Negotiation successful
0809 09:22:52.712062 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 09:22:52.712874 13896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:52.700193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:44465 (local address 127.11.99.194:55927)
0809 09:22:52.700676 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:52.700733 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:52.701944 (+ 1211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:52.702512 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:52.702519 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:52.703061 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:22:52.703720 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:52.703742 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.704633 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.704638 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:52.705604 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:52.705614 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.706105 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.706109 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:52.706281 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:52.706850 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:22:52.706866 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:22:52.708532 (+ 1666us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:22:52.710366 (+ 1834us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:52.710372 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:52.710384 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:52.710730 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:52.711052 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:52.711055 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:52.711057 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:52.711189 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:52.711571 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:22:52.711576 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:22:52.711770 (+ 194us) client_negotiation.cc:769] Sending connection context
0809 09:22:52.711903 (+ 133us) client_negotiation.cc:240] Negotiation successful
0809 09:22:52.712116 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":104,"threads_started":1}
I20260809 09:22:52.713886 14021 heartbeater.cc:347] Connected to a master server at 127.11.99.254:44465
I20260809 09:22:52.714040 14021 heartbeater.cc:464] Registering TS with master...
I20260809 09:22:52.714047 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 13868
I20260809 09:22:52.714184 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance
I20260809 09:22:52.714507 11663 external_mini_cluster.cc:1428] Setting key 80500e677fecbb7c3e3bf4e447116c18
I20260809 09:22:52.714614 14021 heartbeater.cc:511] Master 127.11.99.254:44465 requested a full tablet report, sending...
I20260809 09:22:52.715636 13629 ts_manager.cc:194] Registered new tserver with Master: 78a41f52bfbd49c2bb83f6c11aa17a29 (127.11.99.194:41589)
I20260809 09:22:52.716325 13629 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.194@KRBTEST.COM'} at 127.11.99.194:55927
I20260809 09:22:52.723421 14027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:52.716087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:44465 (local address 127.11.99.194:56747)
0809 09:22:52.716416 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:52.716448 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:52.716536 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:52.716776 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:52.716779 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:52.716980 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:22:52.717079 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:52.717084 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.717804 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.717807 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:52.718338 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:52.718346 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.718952 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.718956 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:52.719044 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:52.719508 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:22:52.719528 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:22:52.719880 (+ 352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:22:52.721873 (+ 1993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:52.721876 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:52.721879 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:52.722107 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:52.722418 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:52.722420 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:52.722421 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:52.722493 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:52.723059 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:22:52.723061 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:22:52.723131 (+ 70us) client_negotiation.cc:769] Sending connection context
0809 09:22:52.723207 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 09:22:52.723302 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":79,"threads_started":1}
I20260809 09:22:52.723654 13686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:52.716183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:56747 (local address 127.11.99.254:44465)
0809 09:22:52.716271 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:52.716274 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:52.716504 (+ 230us) server_negotiation.cc:407] Connection header received
0809 09:22:52.716621 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:52.716623 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:52.716665 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:52.716736 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:52.717185 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.717674 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.718456 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.718829 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.718945 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:52.720022 (+ 1077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:52.720028 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:52.720034 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:52.720063 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:52.721736 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:52.722209 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:52.722213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:52.722215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:52.722320 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:52.722595 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:52.722601 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:52.722606 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:52.722936 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:52.723059 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:52.723307 (+ 248us) server_negotiation.cc:299] Negotiation successful
0809 09:22:52.723438 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
WARNING: no policy specified for kudu/127.11.99.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
I20260809 09:22:52.741658 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:0
--local_ip_for_outbound_sockets=127.11.99.195
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:44465
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:46019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:22:52.847039 14030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:22:52.847308 14030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:22:52.847402 14030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:22:52.851151 14030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:22:52.851234 14030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:22:52.851297 14030 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 09:22:52.851336 14030 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 09:22:52.851397 14030 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:22:52.856072 14030 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:46019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.99.254:44465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14030
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:22:52.857034 14030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:22:52.857954 14030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:22:52.867285 14040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:52.867308 14038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:52.867312 14037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:52.867722 14030 server_base.cc:1034] running on GCE node
I20260809 09:22:52.868110 14030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:22:52.868732 14030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:22:52.869910 14030 hybrid_clock.cc:648] HybridClock initialized: now 1786267372869903 us; error 31 us; skew 500 ppm
Aug 09 09:22:52 dist-test-slave-pgkr krb5kdc[13577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267372, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:22:52.872583 14030 init.cc:377] Logged in from keytab as kudu/127.11.99.195@KRBTEST.COM (short username kudu)
I20260809 09:22:52.873454 14030 webserver.cc:460] Webserver started at http://127.11.99.195:44715/ using document root <none> and password file <none>
I20260809 09:22:52.873996 14030 fs_manager.cc:359] Metadata directory not provided
I20260809 09:22:52.874087 14030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:22:52.874385 14030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:22:52.876421 14030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-2/data/instance:
uuid: "5856c5b740f04f5387bb65dc2ded4fb0"
format_stamp: "Formatted at 2026-08-09 09:22:52 on dist-test-slave-pgkr"
server_key: "f5e2aab6d064a916938f65b72254d605"
server_key_iv: "d01b346c4626d05e7755f2e35470b79e"
server_key_version: "encryptionkey@0"
I20260809 09:22:52.877068 14030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance:
uuid: "5856c5b740f04f5387bb65dc2ded4fb0"
format_stamp: "Formatted at 2026-08-09 09:22:52 on dist-test-slave-pgkr"
server_key: "f5e2aab6d064a916938f65b72254d605"
server_key_iv: "d01b346c4626d05e7755f2e35470b79e"
server_key_version: "encryptionkey@0"
I20260809 09:22:52.880661 14030 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:22:52.883273 14049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:52.884374 14030 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:22:52.884510 14030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "5856c5b740f04f5387bb65dc2ded4fb0"
format_stamp: "Formatted at 2026-08-09 09:22:52 on dist-test-slave-pgkr"
server_key: "f5e2aab6d064a916938f65b72254d605"
server_key_iv: "d01b346c4626d05e7755f2e35470b79e"
server_key_version: "encryptionkey@0"
I20260809 09:22:52.884634 14030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:22:52.894762 14030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:22:52.897204 14030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:22:52.897387 14030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:22:52.898765 14030 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:22:52.898841 14030 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:52.898901 14030 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:22:52.898932 14030 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 09:22:52 dist-test-slave-pgkr krb5kdc[13577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267372, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:22:52.910037 14030 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:35071
I20260809 09:22:52.910336 14176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:35071 every 8 connection(s)
I20260809 09:22:52.911119 14030 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:22:52.912905 13686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:52.899374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:42433 (local address 127.11.99.254:44465)
0809 09:22:52.899536 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:52.899543 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:52.900820 (+ 1277us) server_negotiation.cc:407] Connection header received
0809 09:22:52.902243 (+ 1423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:52.902247 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:52.902320 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:52.902410 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:52.904032 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.904627 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.905845 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.906133 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.906242 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:52.909172 (+ 2930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:52.909174 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:52.909176 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:52.909198 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:52.910874 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:52.911431 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:52.911434 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:52.911435 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:52.911571 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:52.911957 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:52.911960 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:52.911962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:52.912189 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:52.912281 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:52.912697 (+ 416us) server_negotiation.cc:299] Negotiation successful
0809 09:22:52.912793 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 09:22:52.913678 14058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:52.900164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:44465 (local address 127.11.99.195:42433)
0809 09:22:52.900639 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:52.900697 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:52.901979 (+ 1282us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:52.902601 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:52.902632 (+ 31us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:52.903132 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:22:52.903862 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:52.903884 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.904774 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.904780 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:52.905722 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:52.905731 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.906297 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.906301 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:52.906523 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:52.907177 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:22:52.907191 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:22:52.909000 (+ 1809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:22:52.910982 (+ 1982us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:52.910988 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:52.911000 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:52.911334 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:52.911687 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:52.911690 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:52.911692 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:52.911865 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:52.912289 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:22:52.912293 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:22:52.912489 (+ 196us) client_negotiation.cc:769] Sending connection context
0809 09:22:52.912644 (+ 155us) client_negotiation.cc:240] Negotiation successful
0809 09:22:52.912867 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":102,"threads_started":1}
I20260809 09:22:52.914882 14177 heartbeater.cc:347] Connected to a master server at 127.11.99.254:44465
I20260809 09:22:52.915035 14177 heartbeater.cc:464] Registering TS with master...
I20260809 09:22:52.915470 14177 heartbeater.cc:511] Master 127.11.99.254:44465 requested a full tablet report, sending...
I20260809 09:22:52.916455 13626 ts_manager.cc:194] Registered new tserver with Master: 5856c5b740f04f5387bb65dc2ded4fb0 (127.11.99.195:35071)
I20260809 09:22:52.917219 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 14030
I20260809 09:22:52.917243 13626 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.195@KRBTEST.COM'} at 127.11.99.195:42433
I20260809 09:22:52.917351 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance
I20260809 09:22:52.917656 11663 external_mini_cluster.cc:1428] Setting key dfc8809cfa4e833cb9a54f9d087efc2f
I20260809 09:22:52.919571 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 09:22:52.924566 13686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:52.917008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:57467 (local address 127.11.99.254:44465)
0809 09:22:52.917113 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:52.917117 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:52.917330 (+ 213us) server_negotiation.cc:407] Connection header received
0809 09:22:52.917479 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:52.917482 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:52.917532 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:52.917640 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:52.918104 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.918807 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.919709 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.919992 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.920083 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:52.921268 (+ 1185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:52.921271 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:52.921273 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:52.921293 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:52.923026 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:52.923416 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:52.923419 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:52.923421 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:52.923503 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:52.923834 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:52.923836 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:52.923838 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:52.924009 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:52.924089 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:52.924366 (+ 277us) server_negotiation.cc:299] Negotiation successful
0809 09:22:52.924447 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 09:22:52.924782 14184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:52.916931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:44465 (local address 127.11.99.195:57467)
0809 09:22:52.917251 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:52.917267 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:52.917388 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:52.917654 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:52.917656 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:52.917856 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:22:52.917961 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:52.917968 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.918910 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.918913 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:52.919570 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:52.919582 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.920114 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.920118 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:52.920207 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:52.920667 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:22:52.920685 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:22:52.921113 (+ 428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:22:52.923132 (+ 2019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:52.923135 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:52.923136 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:52.923318 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:52.923630 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:52.923635 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:52.923640 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:52.923742 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:52.924108 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:22:52.924113 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:22:52.924220 (+ 107us) client_negotiation.cc:769] Sending connection context
0809 09:22:52.924337 (+ 117us) client_negotiation.cc:240] Negotiation successful
0809 09:22:52.924497 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":96,"threads_started":1}
Aug 09 09:22:52 dist-test-slave-pgkr krb5kdc[13577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267372, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 09:22:52 dist-test-slave-pgkr krb5kdc[13577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267372, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:22:52.945626 13686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:52.938335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41556 (local address 127.11.99.254:44465)
0809 09:22:52.938442 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:52.938446 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:52.938456 (+ 10us) server_negotiation.cc:407] Connection header received
0809 09:22:52.938482 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:52.938484 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:52.938516 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:52.938589 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:52.939271 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.939744 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.940501 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.940689 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.940756 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:52.942964 (+ 2208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:52.942966 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:52.942968 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:52.942988 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:52.944379 (+ 1391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:52.944716 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:52.944719 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:52.944720 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:52.944786 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:52.945002 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:52.945004 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:52.945005 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:52.945149 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:52.945241 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:52.945430 (+ 189us) server_negotiation.cc:299] Negotiation successful
0809 09:22:52.945508 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 09:22:52.948220 13626 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41556:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 09:22:52.951119 13626 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:22:52.964956 14200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:52.959055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34564 (local address 127.11.99.193:38125)
0809 09:22:52.959477 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:52.959486 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:52.959733 (+ 247us) server_negotiation.cc:407] Connection header received
0809 09:22:52.959911 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:52.959916 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:52.960094 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:52.960226 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:22:52.960820 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.961757 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.963400 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.963996 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.964055 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:52.964157 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:52.964724 (+ 567us) server_negotiation.cc:299] Negotiation successful
0809 09:22:52.964821 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":118,"threads_started":1}
I20260809 09:22:52.965029 14202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:52.959445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52804 (local address 127.11.99.194:41589)
0809 09:22:52.959796 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:52.959807 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:52.960146 (+ 339us) server_negotiation.cc:407] Connection header received
0809 09:22:52.960218 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:52.960223 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:52.960426 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:52.960574 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:22:52.960862 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.961997 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.963574 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.964277 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.964393 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:52.964543 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:52.964820 (+ 277us) server_negotiation.cc:299] Negotiation successful
0809 09:22:52.964899 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":134,"threads_started":1}
I20260809 09:22:52.965128 14201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:52.958656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:38125 (local address 127.0.0.1:34564)
0809 09:22:52.959637 (+ 981us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:52.959652 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:52.959797 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:52.960426 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:52.960429 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:52.960447 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:22:52.960584 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:52.960592 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.961856 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.961861 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:52.963277 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:52.963286 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.964258 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.964261 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:52.964472 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:52.964572 (+ 100us) client_negotiation.cc:769] Sending connection context
0809 09:22:52.964675 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 09:22:52.964970 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":877,"mutex_wait_us":195,"thread_start_us":92,"threads_started":1}
I20260809 09:22:52.965406 14198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:52.958550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:35071 (local address 127.0.0.1:43674)
0809 09:22:52.959354 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:52.959400 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:52.959514 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:52.960254 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:52.960262 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:52.960290 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:22:52.960476 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:52.960483 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.962090 (+ 1607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.962093 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:52.963272 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:52.963281 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.964258 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.964261 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:52.964486 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:52.964572 (+ 86us) client_negotiation.cc:769] Sending connection context
0809 09:22:52.964675 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 09:22:52.964970 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"mutex_wait_us":404,"thread_start_us":91,"threads_started":1}
I20260809 09:22:52.965453 14199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:52.958693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43674 (local address 127.11.99.195:35071)
0809 09:22:52.959784 (+ 1091us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:52.959795 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:52.959816 (+ 21us) server_negotiation.cc:407] Connection header received
0809 09:22:52.959885 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:52.959891 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:52.960070 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:52.960657 (+ 587us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:22:52.960797 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.961982 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.963380 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.964127 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.964241 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:52.964402 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:52.965229 (+ 827us) server_negotiation.cc:299] Negotiation successful
0809 09:22:52.965318 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":994,"thread_start_us":136,"threads_started":1}
I20260809 09:22:52.966956 14197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:52.959233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:41589 (local address 127.0.0.1:52804)
0809 09:22:52.959972 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:52.959983 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:52.960061 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:52.960562 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:52.960564 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:52.960585 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:22:52.960709 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:52.960716 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.962408 (+ 1692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.962412 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:52.963442 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:52.963450 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:52.964478 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:52.964481 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:52.964618 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:52.964664 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 09:22:52.964747 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 09:22:52.966830 (+ 2083us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":690,"mutex_wait_us":2021,"thread_start_us":97,"threads_started":1}
I20260809 09:22:52.968003 13785 tablet_service.cc:1467] Processing CreateTablet for tablet 9a316a4cf4b442e8b7e307d14f7005ca (DEFAULT_TABLE table=test-table [id=7524c533b8f6434d9b7012958e7f3cb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:22:52.968024 14106 tablet_service.cc:1467] Processing CreateTablet for tablet 9a316a4cf4b442e8b7e307d14f7005ca (DEFAULT_TABLE table=test-table [id=7524c533b8f6434d9b7012958e7f3cb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:22:52.968926 13785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a316a4cf4b442e8b7e307d14f7005ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:52.969022 14106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a316a4cf4b442e8b7e307d14f7005ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:52.969354 13946 tablet_service.cc:1467] Processing CreateTablet for tablet 9a316a4cf4b442e8b7e307d14f7005ca (DEFAULT_TABLE table=test-table [id=7524c533b8f6434d9b7012958e7f3cb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:22:52.970281 13946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a316a4cf4b442e8b7e307d14f7005ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:52.976401 14203 tablet_bootstrap.cc:492] T 9a316a4cf4b442e8b7e307d14f7005ca P 2dfed5e7f0054adf8bd349c94ae4f355: Bootstrap starting.
I20260809 09:22:52.977345 14205 tablet_bootstrap.cc:492] T 9a316a4cf4b442e8b7e307d14f7005ca P 78a41f52bfbd49c2bb83f6c11aa17a29: Bootstrap starting.
I20260809 09:22:52.977448 14204 tablet_bootstrap.cc:492] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0: Bootstrap starting.
I20260809 09:22:52.978992 14204 tablet_bootstrap.cc:654] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:52.979032 14203 tablet_bootstrap.cc:654] T 9a316a4cf4b442e8b7e307d14f7005ca P 2dfed5e7f0054adf8bd349c94ae4f355: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:52.979174 14205 tablet_bootstrap.cc:654] T 9a316a4cf4b442e8b7e307d14f7005ca P 78a41f52bfbd49c2bb83f6c11aa17a29: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:52.979779 14204 log.cc:824] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0: Log is configured to *not* fsync() on all Append() calls
I20260809 09:22:52.979910 14205 log.cc:824] T 9a316a4cf4b442e8b7e307d14f7005ca P 78a41f52bfbd49c2bb83f6c11aa17a29: Log is configured to *not* fsync() on all Append() calls
I20260809 09:22:52.979910 14203 log.cc:824] T 9a316a4cf4b442e8b7e307d14f7005ca P 2dfed5e7f0054adf8bd349c94ae4f355: Log is configured to *not* fsync() on all Append() calls
I20260809 09:22:52.981443 14204 tablet_bootstrap.cc:492] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0: No bootstrap required, opened a new log
I20260809 09:22:52.981633 14204 ts_tablet_manager.cc:1397] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260809 09:22:52.981959 14203 tablet_bootstrap.cc:492] T 9a316a4cf4b442e8b7e307d14f7005ca P 2dfed5e7f0054adf8bd349c94ae4f355: No bootstrap required, opened a new log
I20260809 09:22:52.981959 14205 tablet_bootstrap.cc:492] T 9a316a4cf4b442e8b7e307d14f7005ca P 78a41f52bfbd49c2bb83f6c11aa17a29: No bootstrap required, opened a new log
I20260809 09:22:52.982129 14203 ts_tablet_manager.cc:1397] T 9a316a4cf4b442e8b7e307d14f7005ca P 2dfed5e7f0054adf8bd349c94ae4f355: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 09:22:52.982129 14205 ts_tablet_manager.cc:1397] T 9a316a4cf4b442e8b7e307d14f7005ca P 78a41f52bfbd49c2bb83f6c11aa17a29: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 09:22:52.984470 14204 raft_consensus.cc:348] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } } peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } }
I20260809 09:22:52.984676 14204 raft_consensus.cc:374] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:52.984724 14204 raft_consensus.cc:729] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5856c5b740f04f5387bb65dc2ded4fb0, State: Initialized, Role: FOLLOWER
I20260809 09:22:52.985145 14204 consensus_queue.cc:260] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } } peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } }
I20260809 09:22:52.985729 14203 raft_consensus.cc:348] T 9a316a4cf4b442e8b7e307d14f7005ca P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } } peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } }
I20260809 09:22:52.985740 14205 raft_consensus.cc:348] T 9a316a4cf4b442e8b7e307d14f7005ca P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } } peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } }
I20260809 09:22:52.985961 14203 raft_consensus.cc:374] T 9a316a4cf4b442e8b7e307d14f7005ca P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:52.985961 14205 raft_consensus.cc:374] T 9a316a4cf4b442e8b7e307d14f7005ca P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:52.986009 14205 raft_consensus.cc:729] T 9a316a4cf4b442e8b7e307d14f7005ca P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78a41f52bfbd49c2bb83f6c11aa17a29, State: Initialized, Role: FOLLOWER
I20260809 09:22:52.986008 14203 raft_consensus.cc:729] T 9a316a4cf4b442e8b7e307d14f7005ca P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dfed5e7f0054adf8bd349c94ae4f355, State: Initialized, Role: FOLLOWER
I20260809 09:22:52.986119 14204 ts_tablet_manager.cc:1428] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260809 09:22:52.986433 14177 heartbeater.cc:503] Master 127.11.99.254:44465 was elected leader, sending a full tablet report...
I20260809 09:22:52.986433 14203 consensus_queue.cc:260] T 9a316a4cf4b442e8b7e307d14f7005ca P 2dfed5e7f0054adf8bd349c94ae4f355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } } peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } }
I20260809 09:22:52.986433 14205 consensus_queue.cc:260] T 9a316a4cf4b442e8b7e307d14f7005ca P 78a41f52bfbd49c2bb83f6c11aa17a29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } } peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } }
I20260809 09:22:52.987025 13859 heartbeater.cc:503] Master 127.11.99.254:44465 was elected leader, sending a full tablet report...
I20260809 09:22:52.987277 14021 heartbeater.cc:503] Master 127.11.99.254:44465 was elected leader, sending a full tablet report...
I20260809 09:22:52.987809 14203 ts_tablet_manager.cc:1428] T 9a316a4cf4b442e8b7e307d14f7005ca P 2dfed5e7f0054adf8bd349c94ae4f355: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 09:22:52.987291 14205 ts_tablet_manager.cc:1428] T 9a316a4cf4b442e8b7e307d14f7005ca P 78a41f52bfbd49c2bb83f6c11aa17a29: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260809 09:22:52.998672 13860 tablet.cc:2369] T 9a316a4cf4b442e8b7e307d14f7005ca P 2dfed5e7f0054adf8bd349c94ae4f355: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:22:53.092947 14209 raft_consensus.cc:482] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:22:53.093233 14209 raft_consensus.cc:504] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } } peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } }
I20260809 09:22:53.094390 14209 leader_election.cc:288] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dfed5e7f0054adf8bd349c94ae4f355 (127.11.99.193:38125), 78a41f52bfbd49c2bb83f6c11aa17a29 (127.11.99.194:41589)
I20260809 09:22:53.098824 14200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:53.094717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:59325 (local address 127.11.99.193:38125)
0809 09:22:53.094857 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:53.094860 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:53.094894 (+ 34us) server_negotiation.cc:407] Connection header received
0809 09:22:53.095047 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:53.095053 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:53.095108 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:53.095209 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:22:53.095613 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.096402 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.097626 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.098248 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.098351 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:53.098391 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:53.098660 (+ 269us) server_negotiation.cc:299] Negotiation successful
0809 09:22:53.098725 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 09:22:53.098835 14058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:53.094641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:38125 (local address 127.11.99.195:59325)
0809 09:22:53.094771 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:53.094802 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:53.094916 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:53.095292 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:53.095297 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:53.095317 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:22:53.095469 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:53.095476 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.096514 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.096517 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:53.097488 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:53.097497 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.098374 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.098378 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:53.098483 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:53.098508 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 09:22:53.098589 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 09:22:53.098694 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 09:22:53.099527 14202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:53.095126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:59555 (local address 127.11.99.194:41589)
0809 09:22:53.095272 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:53.095277 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:53.095412 (+ 135us) server_negotiation.cc:407] Connection header received
0809 09:22:53.095494 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:53.095498 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:53.095553 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:53.095625 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:22:53.096300 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.096975 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.098200 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.098826 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.098973 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:53.099028 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:53.099352 (+ 324us) server_negotiation.cc:299] Negotiation successful
0809 09:22:53.099410 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 09:22:53.099530 14212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:53.094970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:41589 (local address 127.11.99.195:59555)
0809 09:22:53.095320 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:53.095333 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:53.095420 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:53.095652 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:53.095655 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:53.095671 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:22:53.096192 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:53.096201 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.097091 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.097093 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:53.098076 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:53.098086 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.099104 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.099110 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:53.099192 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:53.099246 (+ 54us) client_negotiation.cc:769] Sending connection context
0809 09:22:53.099327 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 09:22:53.099387 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":141,"threads_started":1}
I20260809 09:22:53.099526 13808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a316a4cf4b442e8b7e307d14f7005ca" candidate_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" is_pre_election: true
I20260809 09:22:53.099848 13808 raft_consensus.cc:2454] T 9a316a4cf4b442e8b7e307d14f7005ca P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5856c5b740f04f5387bb65dc2ded4fb0 in term 0.
I20260809 09:22:53.100159 13966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a316a4cf4b442e8b7e307d14f7005ca" candidate_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" is_pre_election: true
I20260809 09:22:53.100359 14051 leader_election.cc:302] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dfed5e7f0054adf8bd349c94ae4f355, 5856c5b740f04f5387bb65dc2ded4fb0; no voters:
I20260809 09:22:53.100419 13966 raft_consensus.cc:2454] T 9a316a4cf4b442e8b7e307d14f7005ca P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5856c5b740f04f5387bb65dc2ded4fb0 in term 0.
I20260809 09:22:53.100617 14209 raft_consensus.cc:2781] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:22:53.100715 14209 raft_consensus.cc:482] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:22:53.100772 14209 raft_consensus.cc:3037] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:53.101868 14209 raft_consensus.cc:504] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } } peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } }
I20260809 09:22:53.102167 14209 leader_election.cc:288] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0 [CANDIDATE]: Term 1 election: Requested vote from peers 2dfed5e7f0054adf8bd349c94ae4f355 (127.11.99.193:38125), 78a41f52bfbd49c2bb83f6c11aa17a29 (127.11.99.194:41589)
I20260809 09:22:53.102456 13808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a316a4cf4b442e8b7e307d14f7005ca" candidate_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dfed5e7f0054adf8bd349c94ae4f355"
I20260809 09:22:53.102543 13966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a316a4cf4b442e8b7e307d14f7005ca" candidate_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29"
I20260809 09:22:53.102607 13808 raft_consensus.cc:3037] T 9a316a4cf4b442e8b7e307d14f7005ca P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:53.102720 13966 raft_consensus.cc:3037] T 9a316a4cf4b442e8b7e307d14f7005ca P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:53.103641 13808 raft_consensus.cc:2454] T 9a316a4cf4b442e8b7e307d14f7005ca P 2dfed5e7f0054adf8bd349c94ae4f355 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5856c5b740f04f5387bb65dc2ded4fb0 in term 1.
I20260809 09:22:53.103791 13966 raft_consensus.cc:2454] T 9a316a4cf4b442e8b7e307d14f7005ca P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5856c5b740f04f5387bb65dc2ded4fb0 in term 1.
I20260809 09:22:53.103977 14051 leader_election.cc:302] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dfed5e7f0054adf8bd349c94ae4f355, 5856c5b740f04f5387bb65dc2ded4fb0; no voters:
I20260809 09:22:53.104169 14209 raft_consensus.cc:2781] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:22:53.104403 14209 raft_consensus.cc:686] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0 [term 1 LEADER]: Becoming Leader. State: Replica: 5856c5b740f04f5387bb65dc2ded4fb0, State: Running, Role: LEADER
I20260809 09:22:53.104701 14209 consensus_queue.cc:237] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } } peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } }
I20260809 09:22:53.107848 13629 catalog_manager.cc:5495] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5856c5b740f04f5387bb65dc2ded4fb0 (127.11.99.195). New cstate: current_term: 1 leader_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } health_report { overall_health: UNKNOWN } } }
Aug 09 09:22:53 dist-test-slave-pgkr krb5kdc[13577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267372, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:22:53.152177 14223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:53.144131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:44465 (local address 127.0.0.1:41558)
0809 09:22:53.144429 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:53.144441 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:53.144562 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:53.144804 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:53.144807 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:53.145219 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:22:53.145319 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:53.145338 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.146039 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.146042 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:53.146605 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:53.146612 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.147128 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.147131 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:53.147206 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:53.147728 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:22:53.147739 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:22:53.149152 (+ 1413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:22:53.150758 (+ 1606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:53.150769 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:53.150774 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:53.150979 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:53.151226 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:53.151230 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:53.151233 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:53.151307 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:53.151655 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:22:53.151662 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:22:53.151759 (+ 97us) client_negotiation.cc:769] Sending connection context
0809 09:22:53.151863 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 09:22:53.151996 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":125,"threads_started":1}
I20260809 09:22:53.152177 13686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:53.144199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41558 (local address 127.11.99.254:44465)
0809 09:22:53.144351 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:53.144355 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:53.144533 (+ 178us) server_negotiation.cc:407] Connection header received
0809 09:22:53.144664 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:53.144667 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:53.144708 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:53.144788 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:53.145456 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.145928 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.146825 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.147022 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.147126 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:53.149278 (+ 2152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:53.149282 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:53.149286 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:53.149309 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:53.150603 (+ 1294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:53.151069 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:53.151074 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:53.151076 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:53.151146 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:53.151400 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:53.151403 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:53.151404 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:53.151561 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:53.151657 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:53.151903 (+ 246us) server_negotiation.cc:299] Negotiation successful
0809 09:22:53.152045 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":53}
I20260809 09:22:53.155540 13629 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:41558:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 09:22:53.156201 13629 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:22:53.160815 13785 tablet_service.cc:1467] Processing CreateTablet for tablet 1c123e6e48d9413a9dd6f22b8f19010d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=898484251fe54e8e9e2e6ac916a470e5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 09:22:53.160966 14106 tablet_service.cc:1467] Processing CreateTablet for tablet 1c123e6e48d9413a9dd6f22b8f19010d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=898484251fe54e8e9e2e6ac916a470e5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 09:22:53.161551 14106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c123e6e48d9413a9dd6f22b8f19010d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:53.161550 13785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c123e6e48d9413a9dd6f22b8f19010d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:53.161238 13946 tablet_service.cc:1467] Processing CreateTablet for tablet 1c123e6e48d9413a9dd6f22b8f19010d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=898484251fe54e8e9e2e6ac916a470e5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 09:22:53.161934 13946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c123e6e48d9413a9dd6f22b8f19010d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260809 09:22:53.162091 14178 tablet.cc:2369] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:22:53.164382 14205 tablet_bootstrap.cc:492] T 1c123e6e48d9413a9dd6f22b8f19010d P 78a41f52bfbd49c2bb83f6c11aa17a29: Bootstrap starting.
I20260809 09:22:53.164386 14204 tablet_bootstrap.cc:492] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0: Bootstrap starting.
I20260809 09:22:53.164937 14203 tablet_bootstrap.cc:492] T 1c123e6e48d9413a9dd6f22b8f19010d P 2dfed5e7f0054adf8bd349c94ae4f355: Bootstrap starting.
I20260809 09:22:53.165370 14204 tablet_bootstrap.cc:654] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:53.165370 14205 tablet_bootstrap.cc:654] T 1c123e6e48d9413a9dd6f22b8f19010d P 78a41f52bfbd49c2bb83f6c11aa17a29: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:53.165743 14203 tablet_bootstrap.cc:654] T 1c123e6e48d9413a9dd6f22b8f19010d P 2dfed5e7f0054adf8bd349c94ae4f355: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:53.166888 14205 tablet_bootstrap.cc:492] T 1c123e6e48d9413a9dd6f22b8f19010d P 78a41f52bfbd49c2bb83f6c11aa17a29: No bootstrap required, opened a new log
I20260809 09:22:53.166888 14204 tablet_bootstrap.cc:492] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0: No bootstrap required, opened a new log
I20260809 09:22:53.166882 14203 tablet_bootstrap.cc:492] T 1c123e6e48d9413a9dd6f22b8f19010d P 2dfed5e7f0054adf8bd349c94ae4f355: No bootstrap required, opened a new log
I20260809 09:22:53.166966 14205 ts_tablet_manager.cc:1397] T 1c123e6e48d9413a9dd6f22b8f19010d P 78a41f52bfbd49c2bb83f6c11aa17a29: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260809 09:22:53.166966 14204 ts_tablet_manager.cc:1397] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 09:22:53.166975 14203 ts_tablet_manager.cc:1397] T 1c123e6e48d9413a9dd6f22b8f19010d P 2dfed5e7f0054adf8bd349c94ae4f355: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 09:22:53.167388 14204 raft_consensus.cc:348] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:53.167388 14205 raft_consensus.cc:348] T 1c123e6e48d9413a9dd6f22b8f19010d P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:53.167414 14203 raft_consensus.cc:348] T 1c123e6e48d9413a9dd6f22b8f19010d P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:53.167490 14205 raft_consensus.cc:374] T 1c123e6e48d9413a9dd6f22b8f19010d P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:53.167490 14204 raft_consensus.cc:374] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:53.167522 14204 raft_consensus.cc:729] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5856c5b740f04f5387bb65dc2ded4fb0, State: Initialized, Role: FOLLOWER
I20260809 09:22:53.167522 14205 raft_consensus.cc:729] T 1c123e6e48d9413a9dd6f22b8f19010d P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78a41f52bfbd49c2bb83f6c11aa17a29, State: Initialized, Role: FOLLOWER
I20260809 09:22:53.167519 14203 raft_consensus.cc:374] T 1c123e6e48d9413a9dd6f22b8f19010d P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:53.167560 14203 raft_consensus.cc:729] T 1c123e6e48d9413a9dd6f22b8f19010d P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dfed5e7f0054adf8bd349c94ae4f355, State: Initialized, Role: FOLLOWER
I20260809 09:22:53.167637 14205 consensus_queue.cc:260] T 1c123e6e48d9413a9dd6f22b8f19010d P 78a41f52bfbd49c2bb83f6c11aa17a29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:53.167637 14204 consensus_queue.cc:260] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:53.167677 14203 consensus_queue.cc:260] T 1c123e6e48d9413a9dd6f22b8f19010d P 2dfed5e7f0054adf8bd349c94ae4f355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:53.167886 14205 ts_tablet_manager.cc:1428] T 1c123e6e48d9413a9dd6f22b8f19010d P 78a41f52bfbd49c2bb83f6c11aa17a29: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 09:22:53.167886 14204 ts_tablet_manager.cc:1428] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 09:22:53.167963 14203 ts_tablet_manager.cc:1428] T 1c123e6e48d9413a9dd6f22b8f19010d P 2dfed5e7f0054adf8bd349c94ae4f355: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 09:22:53.167989 14210 tablet_replica.cc:439] T 1c123e6e48d9413a9dd6f22b8f19010d P 2dfed5e7f0054adf8bd349c94ae4f355: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } } }
I20260809 09:22:53.168105 14210 tablet_replica.cc:442] T 1c123e6e48d9413a9dd6f22b8f19010d P 2dfed5e7f0054adf8bd349c94ae4f355: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 09:22:53.168061 14209 tablet_replica.cc:439] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } } }
I20260809 09:22:53.168087 14211 tablet_replica.cc:439] T 1c123e6e48d9413a9dd6f22b8f19010d P 78a41f52bfbd49c2bb83f6c11aa17a29: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } } }
I20260809 09:22:53.168165 14209 tablet_replica.cc:442] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 09:22:53.168180 14211 tablet_replica.cc:442] T 1c123e6e48d9413a9dd6f22b8f19010d P 78a41f52bfbd49c2bb83f6c11aa17a29: This TxnStatusTablet replica's current role is: FOLLOWER
W20260809 09:22:53.211370 14022 tablet.cc:2369] T 1c123e6e48d9413a9dd6f22b8f19010d P 78a41f52bfbd49c2bb83f6c11aa17a29: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:22:53.347443 14209 raft_consensus.cc:482] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:22:53.347573 14209 raft_consensus.cc:504] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:53.347978 14209 leader_election.cc:288] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dfed5e7f0054adf8bd349c94ae4f355 (127.11.99.193:38125), 78a41f52bfbd49c2bb83f6c11aa17a29 (127.11.99.194:41589)
I20260809 09:22:53.348500 13966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c123e6e48d9413a9dd6f22b8f19010d" candidate_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" is_pre_election: true
I20260809 09:22:53.348500 13808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c123e6e48d9413a9dd6f22b8f19010d" candidate_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" is_pre_election: true
I20260809 09:22:53.348654 13808 raft_consensus.cc:2454] T 1c123e6e48d9413a9dd6f22b8f19010d P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5856c5b740f04f5387bb65dc2ded4fb0 in term 0.
I20260809 09:22:53.348654 13966 raft_consensus.cc:2454] T 1c123e6e48d9413a9dd6f22b8f19010d P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5856c5b740f04f5387bb65dc2ded4fb0 in term 0.
I20260809 09:22:53.348977 14051 leader_election.cc:302] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5856c5b740f04f5387bb65dc2ded4fb0, 78a41f52bfbd49c2bb83f6c11aa17a29; no voters:
I20260809 09:22:53.349208 14209 raft_consensus.cc:2781] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:22:53.349274 14209 raft_consensus.cc:482] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:22:53.349320 14209 raft_consensus.cc:3037] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:53.350467 14209 raft_consensus.cc:504] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:53.350826 14209 leader_election.cc:288] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0 [CANDIDATE]: Term 1 election: Requested vote from peers 2dfed5e7f0054adf8bd349c94ae4f355 (127.11.99.193:38125), 78a41f52bfbd49c2bb83f6c11aa17a29 (127.11.99.194:41589)
I20260809 09:22:53.351173 13808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c123e6e48d9413a9dd6f22b8f19010d" candidate_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dfed5e7f0054adf8bd349c94ae4f355"
I20260809 09:22:53.351213 13966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c123e6e48d9413a9dd6f22b8f19010d" candidate_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29"
I20260809 09:22:53.351308 13808 raft_consensus.cc:3037] T 1c123e6e48d9413a9dd6f22b8f19010d P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:53.351316 13966 raft_consensus.cc:3037] T 1c123e6e48d9413a9dd6f22b8f19010d P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:53.352438 13966 raft_consensus.cc:2454] T 1c123e6e48d9413a9dd6f22b8f19010d P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5856c5b740f04f5387bb65dc2ded4fb0 in term 1.
I20260809 09:22:53.352437 13808 raft_consensus.cc:2454] T 1c123e6e48d9413a9dd6f22b8f19010d P 2dfed5e7f0054adf8bd349c94ae4f355 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5856c5b740f04f5387bb65dc2ded4fb0 in term 1.
I20260809 09:22:53.352702 14051 leader_election.cc:302] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5856c5b740f04f5387bb65dc2ded4fb0, 78a41f52bfbd49c2bb83f6c11aa17a29; no voters:
I20260809 09:22:53.352859 14209 raft_consensus.cc:2781] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:22:53.352942 14209 raft_consensus.cc:686] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0 [term 1 LEADER]: Becoming Leader. State: Replica: 5856c5b740f04f5387bb65dc2ded4fb0, State: Running, Role: LEADER
I20260809 09:22:53.353080 14209 consensus_queue.cc:237] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:53.353713 14209 tablet_replica.cc:439] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0: TxnStatusTablet state changed. Reason: New leader 5856c5b740f04f5387bb65dc2ded4fb0. Latest consensus state: current_term: 1 leader_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } } }
I20260809 09:22:53.353808 14209 tablet_replica.cc:442] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0: This TxnStatusTablet replica's current role is: LEADER
I20260809 09:22:53.354105 14230 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 09:22:53.354357 14230 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 09:22:53.354871 13628 catalog_manager.cc:5495] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5856c5b740f04f5387bb65dc2ded4fb0 (127.11.99.195). New cstate: current_term: 1 leader_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } health_report { overall_health: HEALTHY } } }
I20260809 09:22:53.406214 14223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:53.401738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:35071 (local address 127.0.0.1:43676)
0809 09:22:53.401934 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:53.401950 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:53.402077 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:53.402458 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:53.402460 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:53.402466 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 09:22:53.402564 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:53.402568 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.403646 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.403649 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:53.404272 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:53.404279 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.405002 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.405005 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:53.405082 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:53.405131 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 09:22:53.405953 (+ 822us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 09:22:53.405968 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 09:22:53.406026 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 09:22:53.406095 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260809 09:22:53.406309 14199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:53.401839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43676 (local address 127.11.99.195:35071)
0809 09:22:53.402013 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:53.402018 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:53.402036 (+ 18us) server_negotiation.cc:407] Connection header received
0809 09:22:53.402264 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:53.402269 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:53.402336 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:53.402440 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:22:53.402732 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.403496 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.404523 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.404881 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.405008 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:53.405288 (+ 280us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:22:53.405834 (+ 546us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:22:53.405952 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:53.406070 (+ 118us) server_negotiation.cc:299] Negotiation successful
0809 09:22:53.406136 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 09:22:53.411543 13966 raft_consensus.cc:1261] T 1c123e6e48d9413a9dd6f22b8f19010d P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 1 FOLLOWER]: Refusing update from remote peer 5856c5b740f04f5387bb65dc2ded4fb0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:22:53.411669 13808 raft_consensus.cc:1261] T 1c123e6e48d9413a9dd6f22b8f19010d P 2dfed5e7f0054adf8bd349c94ae4f355 [term 1 FOLLOWER]: Refusing update from remote peer 5856c5b740f04f5387bb65dc2ded4fb0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:22:53.412292 14213 consensus_queue.cc:1035] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:22:53.412523 14209 consensus_queue.cc:1035] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:22:53.416098 14210 tablet_replica.cc:439] T 1c123e6e48d9413a9dd6f22b8f19010d P 2dfed5e7f0054adf8bd349c94ae4f355: TxnStatusTablet state changed. Reason: New leader 5856c5b740f04f5387bb65dc2ded4fb0. Latest consensus state: current_term: 1 leader_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } } }
I20260809 09:22:53.416227 14210 tablet_replica.cc:442] T 1c123e6e48d9413a9dd6f22b8f19010d P 2dfed5e7f0054adf8bd349c94ae4f355: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 09:22:53.416530 14211 tablet_replica.cc:439] T 1c123e6e48d9413a9dd6f22b8f19010d P 78a41f52bfbd49c2bb83f6c11aa17a29: TxnStatusTablet state changed. Reason: New leader 5856c5b740f04f5387bb65dc2ded4fb0. Latest consensus state: current_term: 1 leader_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } } }
I20260809 09:22:53.416635 14211 tablet_replica.cc:442] T 1c123e6e48d9413a9dd6f22b8f19010d P 78a41f52bfbd49c2bb83f6c11aa17a29: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 09:22:53.420511 14209 tablet_replica.cc:439] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } } }
I20260809 09:22:53.420645 14209 tablet_replica.cc:442] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0: This TxnStatusTablet replica's current role is: LEADER
I20260809 09:22:53.420774 14209 tablet_replica.cc:439] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } } }
I20260809 09:22:53.420849 14209 tablet_replica.cc:442] T 1c123e6e48d9413a9dd6f22b8f19010d P 5856c5b740f04f5387bb65dc2ded4fb0: This TxnStatusTablet replica's current role is: LEADER
I20260809 09:22:53.421242 14210 tablet_replica.cc:439] T 1c123e6e48d9413a9dd6f22b8f19010d P 2dfed5e7f0054adf8bd349c94ae4f355: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } } }
I20260809 09:22:53.421339 14210 tablet_replica.cc:442] T 1c123e6e48d9413a9dd6f22b8f19010d P 2dfed5e7f0054adf8bd349c94ae4f355: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 09:22:53.421587 14211 tablet_replica.cc:439] T 1c123e6e48d9413a9dd6f22b8f19010d P 78a41f52bfbd49c2bb83f6c11aa17a29: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } } }
I20260809 09:22:53.421648 14233 mvcc.cc:205] Tried to move back new op lower bound from 7316551161486749696 to 7316551161255526400. Current Snapshot: MvccSnapshot[applied={T|T < 7316551161486749696}]
I20260809 09:22:53.421706 14211 tablet_replica.cc:442] T 1c123e6e48d9413a9dd6f22b8f19010d P 78a41f52bfbd49c2bb83f6c11aa17a29: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 09:22:53.422184 14235 mvcc.cc:205] Tried to move back new op lower bound from 7316551161486749696 to 7316551161255526400. Current Snapshot: MvccSnapshot[applied={T|T < 7316551161486749696}]
I20260809 09:22:53.425686 14234 mvcc.cc:205] Tried to move back new op lower bound from 7316551161486749696 to 7316551161255526400. Current Snapshot: MvccSnapshot[applied={T|T < 7316551161486749696 or (T in {7316551161486749696})}]
I20260809 09:22:53.432366 14199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:53.428893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43688 (local address 127.11.99.195:35071)
0809 09:22:53.429011 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:53.429016 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:53.429033 (+ 17us) server_negotiation.cc:407] Connection header received
0809 09:22:53.429156 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:53.429159 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:53.429212 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:53.429302 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:22:53.429531 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.430262 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.431222 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.431572 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.431699 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:53.431910 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:22:53.431991 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:22:53.432069 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:53.432171 (+ 102us) server_negotiation.cc:299] Negotiation successful
0809 09:22:53.432223 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 09:22:53.442906 14246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:53.439397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:35071 (local address 127.11.99.195:49931)
0809 09:22:53.439714 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:53.439727 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:53.439839 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:53.440084 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:53.440087 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:53.440094 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 09:22:53.440233 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:53.440238 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.440948 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.440954 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:53.441566 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:53.441574 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.442061 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.442065 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:53.442151 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:53.442187 (+ 36us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 09:22:53.442534 (+ 347us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 09:22:53.442542 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 09:22:53.442657 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 09:22:53.442778 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"mutex_wait_us":43,"thread_start_us":134,"threads_started":1}
I20260809 09:22:53.442906 14199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:53.439716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:49931 (local address 127.11.99.195:35071)
0809 09:22:53.439833 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:53.439837 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:53.439851 (+ 14us) server_negotiation.cc:407] Connection header received
0809 09:22:53.439943 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:53.439947 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:53.439987 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:53.440076 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:22:53.440337 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.440837 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.441709 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.441950 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.442061 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:53.442340 (+ 279us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:22:53.442415 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:22:53.442531 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:53.442666 (+ 135us) server_negotiation.cc:299] Negotiation successful
0809 09:22:53.442748 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":55}
I20260809 09:22:53.450495 13966 raft_consensus.cc:1261] T 9a316a4cf4b442e8b7e307d14f7005ca P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 1 FOLLOWER]: Refusing update from remote peer 5856c5b740f04f5387bb65dc2ded4fb0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:22:53.450567 13808 raft_consensus.cc:1261] T 9a316a4cf4b442e8b7e307d14f7005ca P 2dfed5e7f0054adf8bd349c94ae4f355 [term 1 FOLLOWER]: Refusing update from remote peer 5856c5b740f04f5387bb65dc2ded4fb0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:22:53.450984 14213 consensus_queue.cc:1035] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:22:53.451138 14238 consensus_queue.cc:1035] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:22:53.492223 13626 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41556:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:22:53.492956 13626 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41556:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:22:53.495471 13626 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4: Sending DeleteTablet for 3 replicas of tablet 9a316a4cf4b442e8b7e307d14f7005ca
I20260809 09:22:53.496379 13785 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a316a4cf4b442e8b7e307d14f7005ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:22:53 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:34564
I20260809 09:22:53.496536 14106 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a316a4cf4b442e8b7e307d14f7005ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:22:53 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:43674
I20260809 09:22:53.496981 14254 tablet_replica.cc:330] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0: stopping tablet replica
I20260809 09:22:53.497119 13946 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a316a4cf4b442e8b7e307d14f7005ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:22:53 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:52804
I20260809 09:22:53.497418 14254 raft_consensus.cc:2229] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0 [term 1 LEADER]: Raft consensus shutting down.
I20260809 09:22:53.497685 14255 tablet_replica.cc:330] T 9a316a4cf4b442e8b7e307d14f7005ca P 78a41f52bfbd49c2bb83f6c11aa17a29: stopping tablet replica
I20260809 09:22:53.497885 14254 raft_consensus.cc:2258] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:22:53.497983 14255 raft_consensus.cc:2229] T 9a316a4cf4b442e8b7e307d14f7005ca P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:22:53.498206 14255 raft_consensus.cc:2258] T 9a316a4cf4b442e8b7e307d14f7005ca P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:22:53.499397 13626 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41556:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 09:22:53.499542 14255 ts_tablet_manager.cc:1905] T 9a316a4cf4b442e8b7e307d14f7005ca P 78a41f52bfbd49c2bb83f6c11aa17a29: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 09:22:53.499814 13626 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:22:53.500033 14254 ts_tablet_manager.cc:1905] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:22:53.502935 14255 ts_tablet_manager.cc:1918] T 9a316a4cf4b442e8b7e307d14f7005ca P 78a41f52bfbd49c2bb83f6c11aa17a29: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 09:22:53.503051 14255 log.cc:1196] T 9a316a4cf4b442e8b7e307d14f7005ca P 78a41f52bfbd49c2bb83f6c11aa17a29: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/9a316a4cf4b442e8b7e307d14f7005ca
I20260809 09:22:53.503439 14255 ts_tablet_manager.cc:1939] T 9a316a4cf4b442e8b7e307d14f7005ca P 78a41f52bfbd49c2bb83f6c11aa17a29: Deleting consensus metadata
I20260809 09:22:53.503470 14254 ts_tablet_manager.cc:1918] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 09:22:53.503729 14254 log.cc:1196] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/9a316a4cf4b442e8b7e307d14f7005ca
I20260809 09:22:53.504145 14254 ts_tablet_manager.cc:1939] T 9a316a4cf4b442e8b7e307d14f7005ca P 5856c5b740f04f5387bb65dc2ded4fb0: Deleting consensus metadata
I20260809 09:22:53.504668 13612 catalog_manager.cc:4841] TS 78a41f52bfbd49c2bb83f6c11aa17a29 (127.11.99.194:41589): tablet 9a316a4cf4b442e8b7e307d14f7005ca (table test-table [id=7524c533b8f6434d9b7012958e7f3cb0]) successfully deleted
I20260809 09:22:53.505558 13613 catalog_manager.cc:4841] TS 5856c5b740f04f5387bb65dc2ded4fb0 (127.11.99.195:35071): tablet 9a316a4cf4b442e8b7e307d14f7005ca (table test-table [id=7524c533b8f6434d9b7012958e7f3cb0]) successfully deleted
I20260809 09:22:53.505679 13946 tablet_service.cc:1467] Processing CreateTablet for tablet de4ce1f1cc6443f28911d347870177b1 (DEFAULT_TABLE table=test-table [id=c0ada0921dac4c3daec02541875f377d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:22:53.505702 14106 tablet_service.cc:1467] Processing CreateTablet for tablet de4ce1f1cc6443f28911d347870177b1 (DEFAULT_TABLE table=test-table [id=c0ada0921dac4c3daec02541875f377d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:22:53.505932 14106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de4ce1f1cc6443f28911d347870177b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:53.506104 13785 tablet_service.cc:1467] Processing CreateTablet for tablet de4ce1f1cc6443f28911d347870177b1 (DEFAULT_TABLE table=test-table [id=c0ada0921dac4c3daec02541875f377d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:22:53.506237 13946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de4ce1f1cc6443f28911d347870177b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:53.506402 13785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de4ce1f1cc6443f28911d347870177b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:53.508116 14204 tablet_bootstrap.cc:492] T de4ce1f1cc6443f28911d347870177b1 P 5856c5b740f04f5387bb65dc2ded4fb0: Bootstrap starting.
I20260809 09:22:53.508556 14205 tablet_bootstrap.cc:492] T de4ce1f1cc6443f28911d347870177b1 P 78a41f52bfbd49c2bb83f6c11aa17a29: Bootstrap starting.
I20260809 09:22:53.508965 14203 tablet_bootstrap.cc:492] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355: Bootstrap starting.
I20260809 09:22:53.509084 14204 tablet_bootstrap.cc:654] T de4ce1f1cc6443f28911d347870177b1 P 5856c5b740f04f5387bb65dc2ded4fb0: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:53.509531 14205 tablet_bootstrap.cc:654] T de4ce1f1cc6443f28911d347870177b1 P 78a41f52bfbd49c2bb83f6c11aa17a29: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:53.509944 14203 tablet_bootstrap.cc:654] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:53.510658 14204 tablet_bootstrap.cc:492] T de4ce1f1cc6443f28911d347870177b1 P 5856c5b740f04f5387bb65dc2ded4fb0: No bootstrap required, opened a new log
I20260809 09:22:53.510748 14204 ts_tablet_manager.cc:1397] T de4ce1f1cc6443f28911d347870177b1 P 5856c5b740f04f5387bb65dc2ded4fb0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 09:22:53.510883 14253 tablet_replica.cc:330] T 9a316a4cf4b442e8b7e307d14f7005ca P 2dfed5e7f0054adf8bd349c94ae4f355: stopping tablet replica
I20260809 09:22:53.511178 14253 raft_consensus.cc:2229] T 9a316a4cf4b442e8b7e307d14f7005ca P 2dfed5e7f0054adf8bd349c94ae4f355 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:22:53.511147 14204 raft_consensus.cc:348] T de4ce1f1cc6443f28911d347870177b1 P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:53.511289 14204 raft_consensus.cc:374] T de4ce1f1cc6443f28911d347870177b1 P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:53.511327 14204 raft_consensus.cc:729] T de4ce1f1cc6443f28911d347870177b1 P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5856c5b740f04f5387bb65dc2ded4fb0, State: Initialized, Role: FOLLOWER
I20260809 09:22:53.511463 14204 consensus_queue.cc:260] T de4ce1f1cc6443f28911d347870177b1 P 5856c5b740f04f5387bb65dc2ded4fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:53.511698 14253 raft_consensus.cc:2258] T 9a316a4cf4b442e8b7e307d14f7005ca P 2dfed5e7f0054adf8bd349c94ae4f355 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:22:53.511745 14204 ts_tablet_manager.cc:1428] T de4ce1f1cc6443f28911d347870177b1 P 5856c5b740f04f5387bb65dc2ded4fb0: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 09:22:53.513161 14253 ts_tablet_manager.cc:1905] T 9a316a4cf4b442e8b7e307d14f7005ca P 2dfed5e7f0054adf8bd349c94ae4f355: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:22:53.514935 14203 tablet_bootstrap.cc:492] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355: No bootstrap required, opened a new log
I20260809 09:22:53.515026 14203 ts_tablet_manager.cc:1397] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.002s
I20260809 09:22:53.515455 14203 raft_consensus.cc:348] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:53.515616 14203 raft_consensus.cc:374] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:53.515654 14203 raft_consensus.cc:729] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dfed5e7f0054adf8bd349c94ae4f355, State: Initialized, Role: FOLLOWER
I20260809 09:22:53.515761 14203 consensus_queue.cc:260] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:53.516047 14203 ts_tablet_manager.cc:1428] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 09:22:53.517449 14205 tablet_bootstrap.cc:492] T de4ce1f1cc6443f28911d347870177b1 P 78a41f52bfbd49c2bb83f6c11aa17a29: No bootstrap required, opened a new log
I20260809 09:22:53.517572 14205 ts_tablet_manager.cc:1397] T de4ce1f1cc6443f28911d347870177b1 P 78a41f52bfbd49c2bb83f6c11aa17a29: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20260809 09:22:53.518034 14253 ts_tablet_manager.cc:1918] T 9a316a4cf4b442e8b7e307d14f7005ca P 2dfed5e7f0054adf8bd349c94ae4f355: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 09:22:53.518002 14205 raft_consensus.cc:348] T de4ce1f1cc6443f28911d347870177b1 P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:53.518112 14205 raft_consensus.cc:374] T de4ce1f1cc6443f28911d347870177b1 P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:53.518157 14205 raft_consensus.cc:729] T de4ce1f1cc6443f28911d347870177b1 P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78a41f52bfbd49c2bb83f6c11aa17a29, State: Initialized, Role: FOLLOWER
I20260809 09:22:53.518281 14253 log.cc:1196] T 9a316a4cf4b442e8b7e307d14f7005ca P 2dfed5e7f0054adf8bd349c94ae4f355: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-0/wal/wals/9a316a4cf4b442e8b7e307d14f7005ca
I20260809 09:22:53.518285 14205 consensus_queue.cc:260] T de4ce1f1cc6443f28911d347870177b1 P 78a41f52bfbd49c2bb83f6c11aa17a29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:53.518596 14205 ts_tablet_manager.cc:1428] T de4ce1f1cc6443f28911d347870177b1 P 78a41f52bfbd49c2bb83f6c11aa17a29: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 09:22:53.518854 14253 ts_tablet_manager.cc:1939] T 9a316a4cf4b442e8b7e307d14f7005ca P 2dfed5e7f0054adf8bd349c94ae4f355: Deleting consensus metadata
I20260809 09:22:53.520159 13612 catalog_manager.cc:4841] TS 2dfed5e7f0054adf8bd349c94ae4f355 (127.11.99.193:38125): tablet 9a316a4cf4b442e8b7e307d14f7005ca (table test-table [id=7524c533b8f6434d9b7012958e7f3cb0]) successfully deleted
I20260809 09:22:53.567715 14210 raft_consensus.cc:482] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:22:53.567881 14210 raft_consensus.cc:504] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:53.569144 14210 leader_election.cc:288] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78a41f52bfbd49c2bb83f6c11aa17a29 (127.11.99.194:41589), 5856c5b740f04f5387bb65dc2ded4fb0 (127.11.99.195:35071)
I20260809 09:22:53.573793 14199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:53.569679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:46571 (local address 127.11.99.195:35071)
0809 09:22:53.569816 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:53.569823 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:53.570179 (+ 356us) server_negotiation.cc:407] Connection header received
0809 09:22:53.570362 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:53.570365 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:53.570409 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:53.570473 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:22:53.570731 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.571418 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.572673 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.573128 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.573235 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:53.573297 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:53.573620 (+ 323us) server_negotiation.cc:299] Negotiation successful
0809 09:22:53.573695 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 09:22:53.573839 14202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:53.569559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:52631 (local address 127.11.99.194:41589)
0809 09:22:53.569708 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:53.569714 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:53.570003 (+ 289us) server_negotiation.cc:407] Connection header received
0809 09:22:53.570227 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:53.570231 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:53.570277 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:53.570363 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:22:53.570667 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.571199 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.572633 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.573214 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.573321 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:53.573367 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:53.573654 (+ 287us) server_negotiation.cc:299] Negotiation successful
0809 09:22:53.573729 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 09:22:53.574206 14259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:53.569346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:41589 (local address 127.11.99.193:52631)
0809 09:22:53.569900 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:53.569915 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:53.570098 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:53.570393 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:53.570395 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:53.570409 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:22:53.570523 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:53.570529 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.571303 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.571308 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:53.572505 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:53.572515 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.573434 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.573438 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:53.573532 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:53.573552 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 09:22:53.573996 (+ 444us) client_negotiation.cc:240] Negotiation successful
0809 09:22:53.574068 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"mutex_wait_us":1,"thread_start_us":81,"threads_started":1}
I20260809 09:22:53.574213 14260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:53.569346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:35071 (local address 127.11.99.193:46571)
0809 09:22:53.570067 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:53.570093 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:53.570244 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:53.570493 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:53.570496 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:53.570511 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:22:53.570615 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:53.570639 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.571536 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.571539 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:53.572531 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:53.572539 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.573374 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.573378 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:53.573482 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:53.573508 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 09:22:53.574001 (+ 493us) client_negotiation.cc:240] Negotiation successful
0809 09:22:53.574073 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":651,"mutex_wait_us":414,"thread_start_us":102,"threads_started":1}
I20260809 09:22:53.574615 13966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de4ce1f1cc6443f28911d347870177b1" candidate_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" is_pre_election: true
I20260809 09:22:53.574791 13966 raft_consensus.cc:2454] T de4ce1f1cc6443f28911d347870177b1 P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dfed5e7f0054adf8bd349c94ae4f355 in term 0.
I20260809 09:22:53.574757 14130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de4ce1f1cc6443f28911d347870177b1" candidate_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" is_pre_election: true
I20260809 09:22:53.574985 14130 raft_consensus.cc:2454] T de4ce1f1cc6443f28911d347870177b1 P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dfed5e7f0054adf8bd349c94ae4f355 in term 0.
I20260809 09:22:53.575117 13730 leader_election.cc:302] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dfed5e7f0054adf8bd349c94ae4f355, 78a41f52bfbd49c2bb83f6c11aa17a29; no voters:
I20260809 09:22:53.575353 14210 raft_consensus.cc:2781] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:22:53.575412 14210 raft_consensus.cc:482] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:22:53.575451 14210 raft_consensus.cc:3037] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:53.577055 14210 raft_consensus.cc:504] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:53.577378 14210 leader_election.cc:288] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355 [CANDIDATE]: Term 1 election: Requested vote from peers 78a41f52bfbd49c2bb83f6c11aa17a29 (127.11.99.194:41589), 5856c5b740f04f5387bb65dc2ded4fb0 (127.11.99.195:35071)
I20260809 09:22:53.577692 14130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de4ce1f1cc6443f28911d347870177b1" candidate_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5856c5b740f04f5387bb65dc2ded4fb0"
I20260809 09:22:53.577811 14130 raft_consensus.cc:3037] T de4ce1f1cc6443f28911d347870177b1 P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:53.577836 13966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de4ce1f1cc6443f28911d347870177b1" candidate_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29"
I20260809 09:22:53.577946 13966 raft_consensus.cc:3037] T de4ce1f1cc6443f28911d347870177b1 P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:53.578768 14130 raft_consensus.cc:2454] T de4ce1f1cc6443f28911d347870177b1 P 5856c5b740f04f5387bb65dc2ded4fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dfed5e7f0054adf8bd349c94ae4f355 in term 1.
I20260809 09:22:53.579032 13966 raft_consensus.cc:2454] T de4ce1f1cc6443f28911d347870177b1 P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dfed5e7f0054adf8bd349c94ae4f355 in term 1.
I20260809 09:22:53.579047 13731 leader_election.cc:302] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dfed5e7f0054adf8bd349c94ae4f355, 5856c5b740f04f5387bb65dc2ded4fb0; no voters:
I20260809 09:22:53.579239 14210 raft_consensus.cc:2781] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:22:53.579463 14210 raft_consensus.cc:686] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355 [term 1 LEADER]: Becoming Leader. State: Replica: 2dfed5e7f0054adf8bd349c94ae4f355, State: Running, Role: LEADER
I20260809 09:22:53.579689 14210 consensus_queue.cc:237] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:53.581707 13628 catalog_manager.cc:5495] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2dfed5e7f0054adf8bd349c94ae4f355 (127.11.99.193). New cstate: current_term: 1 leader_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } health_report { overall_health: UNKNOWN } } }
I20260809 09:22:53.601590 14200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:53.597655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34580 (local address 127.11.99.193:38125)
0809 09:22:53.597756 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:53.597760 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:53.597824 (+ 64us) server_negotiation.cc:407] Connection header received
0809 09:22:53.597967 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:53.597970 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:53.598027 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:53.598132 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:22:53.598379 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.599181 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.599924 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.600243 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.600345 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:53.600711 (+ 366us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:22:53.601236 (+ 525us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:22:53.601347 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:53.601383 (+ 36us) server_negotiation.cc:299] Negotiation successful
0809 09:22:53.601431 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 09:22:53.611321 14266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:53.608005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:35071 (local address 127.11.99.193:50651)
0809 09:22:53.608346 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:53.608356 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:53.608433 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:53.608645 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:53.608647 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:53.608652 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 09:22:53.608739 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:53.608743 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.609641 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.609643 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:53.610161 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:53.610168 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.610726 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.610728 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:53.610794 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:53.610832 (+ 38us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 09:22:53.611102 (+ 270us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 09:22:53.611106 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 09:22:53.611152 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 09:22:53.611211 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":111,"threads_started":1}
I20260809 09:22:53.611326 14199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:53.608123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:50651 (local address 127.11.99.195:35071)
0809 09:22:53.608251 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:53.608255 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:53.608420 (+ 165us) server_negotiation.cc:407] Connection header received
0809 09:22:53.608497 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:53.608499 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:53.608552 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:53.608628 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:22:53.608831 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.609547 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.610260 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.610603 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.610728 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:53.610945 (+ 217us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:22:53.611017 (+ 72us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:22:53.611084 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:53.611163 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 09:22:53.611207 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 09:22:53.616765 13966 raft_consensus.cc:1261] T de4ce1f1cc6443f28911d347870177b1 P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 1 FOLLOWER]: Refusing update from remote peer 2dfed5e7f0054adf8bd349c94ae4f355: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:22:53.616858 14130 raft_consensus.cc:1261] T de4ce1f1cc6443f28911d347870177b1 P 5856c5b740f04f5387bb65dc2ded4fb0 [term 1 FOLLOWER]: Refusing update from remote peer 2dfed5e7f0054adf8bd349c94ae4f355: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:22:53.617229 14210 consensus_queue.cc:1035] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:22:53.617414 14262 consensus_queue.cc:1035] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:22:53.634284 14246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:53.630971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:38125 (local address 127.11.99.195:59979)
0809 09:22:53.631103 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:53.631117 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:53.631188 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:53.631514 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:53.631518 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:53.631524 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 09:22:53.631612 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:53.631617 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.632551 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.632554 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:53.633105 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:53.633113 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.633653 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.633656 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:53.633727 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:53.633751 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 09:22:53.634028 (+ 277us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 09:22:53.634035 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 09:22:53.634097 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 09:22:53.634180 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 09:22:53.634281 14200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:53.631148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:59979 (local address 127.11.99.193:38125)
0809 09:22:53.631232 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:53.631235 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:53.631246 (+ 11us) server_negotiation.cc:407] Connection header received
0809 09:22:53.631283 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:53.631285 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:53.631324 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:53.631406 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:22:53.631736 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.632444 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.633224 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:53.633542 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:53.633641 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:53.633865 (+ 224us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:22:53.633939 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:22:53.634018 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:53.634107 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 09:22:53.634154 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260809 09:22:53.635113 14234 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 09:22:55.193816 13626 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41556:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:22:55.193958 13626 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41556:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:22:55.196118 13626 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4: Sending DeleteTablet for 3 replicas of tablet de4ce1f1cc6443f28911d347870177b1
I20260809 09:22:55.196604 13785 tablet_service.cc:1514] Processing DeleteTablet for tablet de4ce1f1cc6443f28911d347870177b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:22:55 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:34564
I20260809 09:22:55.196645 13946 tablet_service.cc:1514] Processing DeleteTablet for tablet de4ce1f1cc6443f28911d347870177b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:22:55 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:52804
I20260809 09:22:55.196885 14294 tablet_replica.cc:330] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355: stopping tablet replica
I20260809 09:22:55.196872 14106 tablet_service.cc:1514] Processing DeleteTablet for tablet de4ce1f1cc6443f28911d347870177b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:22:55 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:43674
I20260809 09:22:55.196993 14294 raft_consensus.cc:2229] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355 [term 1 LEADER]: Raft consensus shutting down.
I20260809 09:22:55.197261 14294 raft_consensus.cc:2258] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:22:55.197423 14296 tablet_replica.cc:330] T de4ce1f1cc6443f28911d347870177b1 P 5856c5b740f04f5387bb65dc2ded4fb0: stopping tablet replica
I20260809 09:22:55.197556 14296 raft_consensus.cc:2229] T de4ce1f1cc6443f28911d347870177b1 P 5856c5b740f04f5387bb65dc2ded4fb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:22:55.197669 14296 raft_consensus.cc:2258] T de4ce1f1cc6443f28911d347870177b1 P 5856c5b740f04f5387bb65dc2ded4fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:22:55.198035 14294 ts_tablet_manager.cc:1905] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:22:55.198203 14296 ts_tablet_manager.cc:1905] T de4ce1f1cc6443f28911d347870177b1 P 5856c5b740f04f5387bb65dc2ded4fb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:22:55.200985 14296 ts_tablet_manager.cc:1918] T de4ce1f1cc6443f28911d347870177b1 P 5856c5b740f04f5387bb65dc2ded4fb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 09:22:55.201089 14296 log.cc:1196] T de4ce1f1cc6443f28911d347870177b1 P 5856c5b740f04f5387bb65dc2ded4fb0: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/de4ce1f1cc6443f28911d347870177b1
I20260809 09:22:55.201125 14295 tablet_replica.cc:330] T de4ce1f1cc6443f28911d347870177b1 P 78a41f52bfbd49c2bb83f6c11aa17a29: stopping tablet replica
I20260809 09:22:55.201292 14295 raft_consensus.cc:2229] T de4ce1f1cc6443f28911d347870177b1 P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:22:55.201427 14295 raft_consensus.cc:2258] T de4ce1f1cc6443f28911d347870177b1 P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:22:55.201529 14294 ts_tablet_manager.cc:1918] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 09:22:55.201612 14294 log.cc:1196] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-0/wal/wals/de4ce1f1cc6443f28911d347870177b1
I20260809 09:22:55.201947 14294 ts_tablet_manager.cc:1939] T de4ce1f1cc6443f28911d347870177b1 P 2dfed5e7f0054adf8bd349c94ae4f355: Deleting consensus metadata
I20260809 09:22:55.202147 14295 ts_tablet_manager.cc:1905] T de4ce1f1cc6443f28911d347870177b1 P 78a41f52bfbd49c2bb83f6c11aa17a29: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:22:55.202661 13612 catalog_manager.cc:4841] TS 2dfed5e7f0054adf8bd349c94ae4f355 (127.11.99.193:38125): tablet de4ce1f1cc6443f28911d347870177b1 (table test-table [id=c0ada0921dac4c3daec02541875f377d]) successfully deleted
I20260809 09:22:55.202907 14296 ts_tablet_manager.cc:1939] T de4ce1f1cc6443f28911d347870177b1 P 5856c5b740f04f5387bb65dc2ded4fb0: Deleting consensus metadata
I20260809 09:22:55.203663 13613 catalog_manager.cc:4841] TS 5856c5b740f04f5387bb65dc2ded4fb0 (127.11.99.195:35071): tablet de4ce1f1cc6443f28911d347870177b1 (table test-table [id=c0ada0921dac4c3daec02541875f377d]) successfully deleted
I20260809 09:22:55.204762 14295 ts_tablet_manager.cc:1918] T de4ce1f1cc6443f28911d347870177b1 P 78a41f52bfbd49c2bb83f6c11aa17a29: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 09:22:55.204849 14295 log.cc:1196] T de4ce1f1cc6443f28911d347870177b1 P 78a41f52bfbd49c2bb83f6c11aa17a29: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/de4ce1f1cc6443f28911d347870177b1
I20260809 09:22:55.205181 14295 ts_tablet_manager.cc:1939] T de4ce1f1cc6443f28911d347870177b1 P 78a41f52bfbd49c2bb83f6c11aa17a29: Deleting consensus metadata
I20260809 09:22:55.206101 13612 catalog_manager.cc:4841] TS 78a41f52bfbd49c2bb83f6c11aa17a29 (127.11.99.194:41589): tablet de4ce1f1cc6443f28911d347870177b1 (table test-table [id=c0ada0921dac4c3daec02541875f377d]) successfully deleted
Aug 09 09:22:55 dist-test-slave-pgkr krb5kdc[13577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267375, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 09:22:55 dist-test-slave-pgkr krb5kdc[13577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267375, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:22:55.226980 14304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:55.217886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41570 (local address 127.11.99.254:44465)
0809 09:22:55.218144 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:55.218155 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:55.218248 (+ 93us) server_negotiation.cc:407] Connection header received
0809 09:22:55.218404 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:55.218407 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:55.218479 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:55.218581 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:55.219570 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:55.220255 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:55.221112 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:55.221357 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:55.221484 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:55.223934 (+ 2450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:55.223937 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:55.223940 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:55.223964 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:55.225279 (+ 1315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:55.225681 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:55.225685 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:55.225687 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:55.225774 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:55.226060 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:55.226063 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:55.226065 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:55.226245 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:55.226383 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:55.226679 (+ 296us) server_negotiation.cc:299] Negotiation successful
0809 09:22:55.226815 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":98,"threads_started":1}
I20260809 09:22:55.229264 13626 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41570:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 09:22:55.229704 13626 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:22:55.234010 13946 tablet_service.cc:1467] Processing CreateTablet for tablet 24b2aea9200741fcb3e08c22da4793cc (DEFAULT_TABLE table=test-table [id=554510193b084245b1035911d8841a4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:22:55.234009 13785 tablet_service.cc:1467] Processing CreateTablet for tablet 24b2aea9200741fcb3e08c22da4793cc (DEFAULT_TABLE table=test-table [id=554510193b084245b1035911d8841a4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:22:55.234244 14106 tablet_service.cc:1467] Processing CreateTablet for tablet 24b2aea9200741fcb3e08c22da4793cc (DEFAULT_TABLE table=test-table [id=554510193b084245b1035911d8841a4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:22:55.234323 13946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24b2aea9200741fcb3e08c22da4793cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:55.234323 13785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24b2aea9200741fcb3e08c22da4793cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:55.234545 14106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24b2aea9200741fcb3e08c22da4793cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:55.236948 14307 tablet_bootstrap.cc:492] T 24b2aea9200741fcb3e08c22da4793cc P 2dfed5e7f0054adf8bd349c94ae4f355: Bootstrap starting.
I20260809 09:22:55.237277 14308 tablet_bootstrap.cc:492] T 24b2aea9200741fcb3e08c22da4793cc P 78a41f52bfbd49c2bb83f6c11aa17a29: Bootstrap starting.
I20260809 09:22:55.237493 14305 tablet_bootstrap.cc:492] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0: Bootstrap starting.
I20260809 09:22:55.237865 14307 tablet_bootstrap.cc:654] T 24b2aea9200741fcb3e08c22da4793cc P 2dfed5e7f0054adf8bd349c94ae4f355: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:55.238281 14308 tablet_bootstrap.cc:654] T 24b2aea9200741fcb3e08c22da4793cc P 78a41f52bfbd49c2bb83f6c11aa17a29: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:55.238350 14305 tablet_bootstrap.cc:654] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:55.239218 14307 tablet_bootstrap.cc:492] T 24b2aea9200741fcb3e08c22da4793cc P 2dfed5e7f0054adf8bd349c94ae4f355: No bootstrap required, opened a new log
I20260809 09:22:55.239362 14307 ts_tablet_manager.cc:1397] T 24b2aea9200741fcb3e08c22da4793cc P 2dfed5e7f0054adf8bd349c94ae4f355: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 09:22:55.239607 14305 tablet_bootstrap.cc:492] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0: No bootstrap required, opened a new log
I20260809 09:22:55.239710 14305 ts_tablet_manager.cc:1397] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 09:22:55.239729 14307 raft_consensus.cc:348] T 24b2aea9200741fcb3e08c22da4793cc P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:55.239849 14307 raft_consensus.cc:374] T 24b2aea9200741fcb3e08c22da4793cc P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:55.239914 14307 raft_consensus.cc:729] T 24b2aea9200741fcb3e08c22da4793cc P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dfed5e7f0054adf8bd349c94ae4f355, State: Initialized, Role: FOLLOWER
I20260809 09:22:55.240051 14307 consensus_queue.cc:260] T 24b2aea9200741fcb3e08c22da4793cc P 2dfed5e7f0054adf8bd349c94ae4f355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:55.240149 14305 raft_consensus.cc:348] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:55.240260 14305 raft_consensus.cc:374] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:55.240301 14305 raft_consensus.cc:729] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5856c5b740f04f5387bb65dc2ded4fb0, State: Initialized, Role: FOLLOWER
I20260809 09:22:55.240427 14305 consensus_queue.cc:260] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:55.240644 14307 ts_tablet_manager.cc:1428] T 24b2aea9200741fcb3e08c22da4793cc P 2dfed5e7f0054adf8bd349c94ae4f355: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 09:22:55.240717 14305 ts_tablet_manager.cc:1428] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 09:22:55.243055 14308 tablet_bootstrap.cc:492] T 24b2aea9200741fcb3e08c22da4793cc P 78a41f52bfbd49c2bb83f6c11aa17a29: No bootstrap required, opened a new log
I20260809 09:22:55.243157 14308 ts_tablet_manager.cc:1397] T 24b2aea9200741fcb3e08c22da4793cc P 78a41f52bfbd49c2bb83f6c11aa17a29: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260809 09:22:55.243530 14308 raft_consensus.cc:348] T 24b2aea9200741fcb3e08c22da4793cc P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:55.243640 14308 raft_consensus.cc:374] T 24b2aea9200741fcb3e08c22da4793cc P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:55.243682 14308 raft_consensus.cc:729] T 24b2aea9200741fcb3e08c22da4793cc P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78a41f52bfbd49c2bb83f6c11aa17a29, State: Initialized, Role: FOLLOWER
I20260809 09:22:55.243803 14308 consensus_queue.cc:260] T 24b2aea9200741fcb3e08c22da4793cc P 78a41f52bfbd49c2bb83f6c11aa17a29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:55.244200 14308 ts_tablet_manager.cc:1428] T 24b2aea9200741fcb3e08c22da4793cc P 78a41f52bfbd49c2bb83f6c11aa17a29: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 09:22:55.364853 14273 raft_consensus.cc:482] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:22:55.365000 14273 raft_consensus.cc:504] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:55.365343 14273 leader_election.cc:288] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dfed5e7f0054adf8bd349c94ae4f355 (127.11.99.193:38125), 78a41f52bfbd49c2bb83f6c11aa17a29 (127.11.99.194:41589)
I20260809 09:22:55.365845 13807 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24b2aea9200741fcb3e08c22da4793cc" candidate_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" is_pre_election: true
I20260809 09:22:55.365845 13962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24b2aea9200741fcb3e08c22da4793cc" candidate_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" is_pre_election: true
I20260809 09:22:55.366009 13962 raft_consensus.cc:2454] T 24b2aea9200741fcb3e08c22da4793cc P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5856c5b740f04f5387bb65dc2ded4fb0 in term 0.
I20260809 09:22:55.366009 13807 raft_consensus.cc:2454] T 24b2aea9200741fcb3e08c22da4793cc P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5856c5b740f04f5387bb65dc2ded4fb0 in term 0.
I20260809 09:22:55.366349 14051 leader_election.cc:302] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dfed5e7f0054adf8bd349c94ae4f355, 5856c5b740f04f5387bb65dc2ded4fb0; no voters:
I20260809 09:22:55.366506 14273 raft_consensus.cc:2781] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:22:55.366572 14273 raft_consensus.cc:482] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:22:55.366660 14273 raft_consensus.cc:3037] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:55.367661 14273 raft_consensus.cc:504] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:55.367978 14273 leader_election.cc:288] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0 [CANDIDATE]: Term 1 election: Requested vote from peers 2dfed5e7f0054adf8bd349c94ae4f355 (127.11.99.193:38125), 78a41f52bfbd49c2bb83f6c11aa17a29 (127.11.99.194:41589)
I20260809 09:22:55.368319 13807 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24b2aea9200741fcb3e08c22da4793cc" candidate_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dfed5e7f0054adf8bd349c94ae4f355"
I20260809 09:22:55.368453 13807 raft_consensus.cc:3037] T 24b2aea9200741fcb3e08c22da4793cc P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:55.368417 13962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24b2aea9200741fcb3e08c22da4793cc" candidate_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29"
I20260809 09:22:55.368566 13962 raft_consensus.cc:3037] T 24b2aea9200741fcb3e08c22da4793cc P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:55.369493 13807 raft_consensus.cc:2454] T 24b2aea9200741fcb3e08c22da4793cc P 2dfed5e7f0054adf8bd349c94ae4f355 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5856c5b740f04f5387bb65dc2ded4fb0 in term 1.
I20260809 09:22:55.369803 13962 raft_consensus.cc:2454] T 24b2aea9200741fcb3e08c22da4793cc P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5856c5b740f04f5387bb65dc2ded4fb0 in term 1.
I20260809 09:22:55.370112 14051 leader_election.cc:302] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dfed5e7f0054adf8bd349c94ae4f355, 5856c5b740f04f5387bb65dc2ded4fb0; no voters:
I20260809 09:22:55.370301 14273 raft_consensus.cc:2781] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:22:55.370397 14273 raft_consensus.cc:686] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0 [term 1 LEADER]: Becoming Leader. State: Replica: 5856c5b740f04f5387bb65dc2ded4fb0, State: Running, Role: LEADER
I20260809 09:22:55.370530 14273 consensus_queue.cc:237] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:55.371981 13628 catalog_manager.cc:5495] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5856c5b740f04f5387bb65dc2ded4fb0 (127.11.99.195). New cstate: current_term: 1 leader_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } health_report { overall_health: HEALTHY } } }
I20260809 09:22:55.395314 14316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:55.392484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47704 (local address 127.11.99.195:35071)
0809 09:22:55.392697 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:55.392704 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:55.392714 (+ 10us) server_negotiation.cc:407] Connection header received
0809 09:22:55.392753 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:55.392756 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:55.392790 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:55.392856 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:22:55.393067 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:55.393595 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:55.394320 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:55.394560 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:55.394687 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:55.394898 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:22:55.394965 (+ 67us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:22:55.395019 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:55.395095 (+ 76us) server_negotiation.cc:299] Negotiation successful
0809 09:22:55.395136 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":88,"threads_started":1}
I20260809 09:22:55.400880 13962 raft_consensus.cc:1261] T 24b2aea9200741fcb3e08c22da4793cc P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 1 FOLLOWER]: Refusing update from remote peer 5856c5b740f04f5387bb65dc2ded4fb0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:22:55.400866 13807 raft_consensus.cc:1261] T 24b2aea9200741fcb3e08c22da4793cc P 2dfed5e7f0054adf8bd349c94ae4f355 [term 1 FOLLOWER]: Refusing update from remote peer 5856c5b740f04f5387bb65dc2ded4fb0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:22:55.401264 14278 consensus_queue.cc:1035] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:22:55.401374 14209 consensus_queue.cc:1035] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:22:55.433959 13626 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41570:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:22:55.434099 13626 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41570:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:22:55.436058 13626 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4: Sending DeleteTablet for 3 replicas of tablet 24b2aea9200741fcb3e08c22da4793cc
I20260809 09:22:55.436533 13785 tablet_service.cc:1514] Processing DeleteTablet for tablet 24b2aea9200741fcb3e08c22da4793cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:22:55 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:34564
I20260809 09:22:55.436599 13946 tablet_service.cc:1514] Processing DeleteTablet for tablet 24b2aea9200741fcb3e08c22da4793cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:22:55 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:52804
I20260809 09:22:55.436712 14294 tablet_replica.cc:330] T 24b2aea9200741fcb3e08c22da4793cc P 2dfed5e7f0054adf8bd349c94ae4f355: stopping tablet replica
I20260809 09:22:55.436829 14294 raft_consensus.cc:2229] T 24b2aea9200741fcb3e08c22da4793cc P 2dfed5e7f0054adf8bd349c94ae4f355 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:22:55.436952 14294 raft_consensus.cc:2258] T 24b2aea9200741fcb3e08c22da4793cc P 2dfed5e7f0054adf8bd349c94ae4f355 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:22:55.436980 14295 tablet_replica.cc:330] T 24b2aea9200741fcb3e08c22da4793cc P 78a41f52bfbd49c2bb83f6c11aa17a29: stopping tablet replica
I20260809 09:22:55.437089 14295 raft_consensus.cc:2229] T 24b2aea9200741fcb3e08c22da4793cc P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:22:55.437239 14295 raft_consensus.cc:2258] T 24b2aea9200741fcb3e08c22da4793cc P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:22:55.437331 13626 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41570:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 09:22:55.437450 14106 tablet_service.cc:1514] Processing DeleteTablet for tablet 24b2aea9200741fcb3e08c22da4793cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:22:55 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:43674
I20260809 09:22:55.437609 14296 tablet_replica.cc:330] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0: stopping tablet replica
I20260809 09:22:55.437711 14296 raft_consensus.cc:2229] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0 [term 1 LEADER]: Raft consensus shutting down.
I20260809 09:22:55.437783 14294 ts_tablet_manager.cc:1905] T 24b2aea9200741fcb3e08c22da4793cc P 2dfed5e7f0054adf8bd349c94ae4f355: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:22:55.437870 14296 raft_consensus.cc:2258] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260809 09:22:55.437863 13626 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:22:55.437911 14295 ts_tablet_manager.cc:1905] T 24b2aea9200741fcb3e08c22da4793cc P 78a41f52bfbd49c2bb83f6c11aa17a29: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:22:55.438675 14296 ts_tablet_manager.cc:1905] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:22:55.440476 14294 ts_tablet_manager.cc:1918] T 24b2aea9200741fcb3e08c22da4793cc P 2dfed5e7f0054adf8bd349c94ae4f355: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 09:22:55.440487 14295 ts_tablet_manager.cc:1918] T 24b2aea9200741fcb3e08c22da4793cc P 78a41f52bfbd49c2bb83f6c11aa17a29: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 09:22:55.440553 14294 log.cc:1196] T 24b2aea9200741fcb3e08c22da4793cc P 2dfed5e7f0054adf8bd349c94ae4f355: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-0/wal/wals/24b2aea9200741fcb3e08c22da4793cc
I20260809 09:22:55.440575 14295 log.cc:1196] T 24b2aea9200741fcb3e08c22da4793cc P 78a41f52bfbd49c2bb83f6c11aa17a29: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/24b2aea9200741fcb3e08c22da4793cc
I20260809 09:22:55.440816 14294 ts_tablet_manager.cc:1939] T 24b2aea9200741fcb3e08c22da4793cc P 2dfed5e7f0054adf8bd349c94ae4f355: Deleting consensus metadata
I20260809 09:22:55.440832 14295 ts_tablet_manager.cc:1939] T 24b2aea9200741fcb3e08c22da4793cc P 78a41f52bfbd49c2bb83f6c11aa17a29: Deleting consensus metadata
I20260809 09:22:55.441344 14296 ts_tablet_manager.cc:1918] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 09:22:55.441412 14296 log.cc:1196] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/24b2aea9200741fcb3e08c22da4793cc
I20260809 09:22:55.441445 13612 catalog_manager.cc:4841] TS 2dfed5e7f0054adf8bd349c94ae4f355 (127.11.99.193:38125): tablet 24b2aea9200741fcb3e08c22da4793cc (table test-table [id=554510193b084245b1035911d8841a4c]) successfully deleted
I20260809 09:22:55.441676 14296 ts_tablet_manager.cc:1939] T 24b2aea9200741fcb3e08c22da4793cc P 5856c5b740f04f5387bb65dc2ded4fb0: Deleting consensus metadata
I20260809 09:22:55.441704 13612 catalog_manager.cc:4841] TS 78a41f52bfbd49c2bb83f6c11aa17a29 (127.11.99.194:41589): tablet 24b2aea9200741fcb3e08c22da4793cc (table test-table [id=554510193b084245b1035911d8841a4c]) successfully deleted
I20260809 09:22:55.442297 13946 tablet_service.cc:1467] Processing CreateTablet for tablet 0935b512ec48431c878dbb7f62faa658 (DEFAULT_TABLE table=test-table [id=4c0c01ce9d0d42388faea1a4a7f8bb2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:22:55.442301 13785 tablet_service.cc:1467] Processing CreateTablet for tablet 0935b512ec48431c878dbb7f62faa658 (DEFAULT_TABLE table=test-table [id=4c0c01ce9d0d42388faea1a4a7f8bb2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:22:55.442548 13785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0935b512ec48431c878dbb7f62faa658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:55.442561 13946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0935b512ec48431c878dbb7f62faa658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:55.444769 14308 tablet_bootstrap.cc:492] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29: Bootstrap starting.
I20260809 09:22:55.444782 13613 catalog_manager.cc:4841] TS 5856c5b740f04f5387bb65dc2ded4fb0 (127.11.99.195:35071): tablet 24b2aea9200741fcb3e08c22da4793cc (table test-table [id=554510193b084245b1035911d8841a4c]) successfully deleted
I20260809 09:22:55.445039 14106 tablet_service.cc:1467] Processing CreateTablet for tablet 0935b512ec48431c878dbb7f62faa658 (DEFAULT_TABLE table=test-table [id=4c0c01ce9d0d42388faea1a4a7f8bb2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:22:55.445266 14106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0935b512ec48431c878dbb7f62faa658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:55.445283 14307 tablet_bootstrap.cc:492] T 0935b512ec48431c878dbb7f62faa658 P 2dfed5e7f0054adf8bd349c94ae4f355: Bootstrap starting.
I20260809 09:22:55.445817 14308 tablet_bootstrap.cc:654] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:55.446201 14307 tablet_bootstrap.cc:654] T 0935b512ec48431c878dbb7f62faa658 P 2dfed5e7f0054adf8bd349c94ae4f355: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:55.447057 14305 tablet_bootstrap.cc:492] T 0935b512ec48431c878dbb7f62faa658 P 5856c5b740f04f5387bb65dc2ded4fb0: Bootstrap starting.
I20260809 09:22:55.447183 14308 tablet_bootstrap.cc:492] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29: No bootstrap required, opened a new log
I20260809 09:22:55.447263 14308 ts_tablet_manager.cc:1397] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 09:22:55.447738 14308 raft_consensus.cc:348] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:55.447854 14308 raft_consensus.cc:374] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:55.447860 14305 tablet_bootstrap.cc:654] T 0935b512ec48431c878dbb7f62faa658 P 5856c5b740f04f5387bb65dc2ded4fb0: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:55.447906 14308 raft_consensus.cc:729] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78a41f52bfbd49c2bb83f6c11aa17a29, State: Initialized, Role: FOLLOWER
I20260809 09:22:55.447978 14307 tablet_bootstrap.cc:492] T 0935b512ec48431c878dbb7f62faa658 P 2dfed5e7f0054adf8bd349c94ae4f355: No bootstrap required, opened a new log
I20260809 09:22:55.448055 14307 ts_tablet_manager.cc:1397] T 0935b512ec48431c878dbb7f62faa658 P 2dfed5e7f0054adf8bd349c94ae4f355: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260809 09:22:55.448035 14308 consensus_queue.cc:260] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:55.448294 14308 ts_tablet_manager.cc:1428] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 09:22:55.448442 14307 raft_consensus.cc:348] T 0935b512ec48431c878dbb7f62faa658 P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:55.448571 14307 raft_consensus.cc:374] T 0935b512ec48431c878dbb7f62faa658 P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:55.448632 14307 raft_consensus.cc:729] T 0935b512ec48431c878dbb7f62faa658 P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dfed5e7f0054adf8bd349c94ae4f355, State: Initialized, Role: FOLLOWER
I20260809 09:22:55.448768 14307 consensus_queue.cc:260] T 0935b512ec48431c878dbb7f62faa658 P 2dfed5e7f0054adf8bd349c94ae4f355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:55.449016 14307 ts_tablet_manager.cc:1428] T 0935b512ec48431c878dbb7f62faa658 P 2dfed5e7f0054adf8bd349c94ae4f355: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 09:22:55.449479 14305 tablet_bootstrap.cc:492] T 0935b512ec48431c878dbb7f62faa658 P 5856c5b740f04f5387bb65dc2ded4fb0: No bootstrap required, opened a new log
I20260809 09:22:55.449568 14305 ts_tablet_manager.cc:1397] T 0935b512ec48431c878dbb7f62faa658 P 5856c5b740f04f5387bb65dc2ded4fb0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 09:22:55.449944 14305 raft_consensus.cc:348] T 0935b512ec48431c878dbb7f62faa658 P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:55.450040 14305 raft_consensus.cc:374] T 0935b512ec48431c878dbb7f62faa658 P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:55.450078 14305 raft_consensus.cc:729] T 0935b512ec48431c878dbb7f62faa658 P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5856c5b740f04f5387bb65dc2ded4fb0, State: Initialized, Role: FOLLOWER
I20260809 09:22:55.450191 14305 consensus_queue.cc:260] T 0935b512ec48431c878dbb7f62faa658 P 5856c5b740f04f5387bb65dc2ded4fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:55.450455 14305 ts_tablet_manager.cc:1428] T 0935b512ec48431c878dbb7f62faa658 P 5856c5b740f04f5387bb65dc2ded4fb0: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 09:22:55.665759 14312 raft_consensus.cc:482] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:22:55.666042 14312 raft_consensus.cc:504] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:55.667264 14312 leader_election.cc:288] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dfed5e7f0054adf8bd349c94ae4f355 (127.11.99.193:38125), 5856c5b740f04f5387bb65dc2ded4fb0 (127.11.99.195:35071)
I20260809 09:22:55.671423 14327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:55.667603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:36331 (local address 127.11.99.193:38125)
0809 09:22:55.667870 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:55.667887 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:55.667911 (+ 24us) server_negotiation.cc:407] Connection header received
0809 09:22:55.668090 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:55.668094 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:55.668152 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:55.668233 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:22:55.668573 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:55.669111 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:55.670293 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:55.670818 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:55.670964 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:55.671018 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:55.671193 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 09:22:55.671272 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":75,"threads_started":1}
I20260809 09:22:55.671427 14316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:55.667789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:36081 (local address 127.11.99.195:35071)
0809 09:22:55.667918 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:55.667923 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:55.668092 (+ 169us) server_negotiation.cc:407] Connection header received
0809 09:22:55.668206 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:55.668228 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:55.668284 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:55.668356 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:22:55.668660 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:55.669135 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:55.670344 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:55.670883 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:55.670996 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:55.671054 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:55.671242 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 09:22:55.671319 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 09:22:55.671442 14328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:55.667594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:35071 (local address 127.11.99.194:36081)
0809 09:22:55.667962 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:55.667980 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:55.668100 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:55.668386 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:55.668389 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:55.668402 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:22:55.668550 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:55.668558 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:55.669299 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:55.669303 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:55.670200 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:55.670209 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:55.670985 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:55.670988 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:55.671104 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:55.671121 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 09:22:55.671212 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 09:22:55.671271 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"mutex_wait_us":36,"thread_start_us":124,"threads_started":1}
I20260809 09:22:55.671576 14326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:55.667472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:38125 (local address 127.11.99.194:36331)
0809 09:22:55.667836 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:55.667853 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:55.667973 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:55.668274 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:55.668277 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:55.668293 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:22:55.668452 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:55.668459 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:55.669257 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:55.669261 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:55.670174 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:55.670184 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:55.670966 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:55.670969 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:55.671060 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:55.671088 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 09:22:55.671157 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 09:22:55.671252 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"mutex_wait_us":4,"thread_start_us":90,"threads_started":1}
I20260809 09:22:55.671929 14130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0935b512ec48431c878dbb7f62faa658" candidate_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" is_pre_election: true
I20260809 09:22:55.672005 13808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0935b512ec48431c878dbb7f62faa658" candidate_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" is_pre_election: true
I20260809 09:22:55.672086 14130 raft_consensus.cc:2454] T 0935b512ec48431c878dbb7f62faa658 P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78a41f52bfbd49c2bb83f6c11aa17a29 in term 0.
I20260809 09:22:55.672129 13808 raft_consensus.cc:2454] T 0935b512ec48431c878dbb7f62faa658 P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78a41f52bfbd49c2bb83f6c11aa17a29 in term 0.
I20260809 09:22:55.672519 13889 leader_election.cc:302] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2dfed5e7f0054adf8bd349c94ae4f355, 5856c5b740f04f5387bb65dc2ded4fb0, 78a41f52bfbd49c2bb83f6c11aa17a29; no voters:
I20260809 09:22:55.672799 14312 raft_consensus.cc:2781] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:22:55.672873 14312 raft_consensus.cc:482] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:22:55.672927 14312 raft_consensus.cc:3037] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:55.673972 14312 raft_consensus.cc:504] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:55.674299 14312 leader_election.cc:288] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29 [CANDIDATE]: Term 1 election: Requested vote from peers 2dfed5e7f0054adf8bd349c94ae4f355 (127.11.99.193:38125), 5856c5b740f04f5387bb65dc2ded4fb0 (127.11.99.195:35071)
I20260809 09:22:55.674657 14130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0935b512ec48431c878dbb7f62faa658" candidate_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5856c5b740f04f5387bb65dc2ded4fb0"
I20260809 09:22:55.674679 13808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0935b512ec48431c878dbb7f62faa658" candidate_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dfed5e7f0054adf8bd349c94ae4f355"
I20260809 09:22:55.674796 14130 raft_consensus.cc:3037] T 0935b512ec48431c878dbb7f62faa658 P 5856c5b740f04f5387bb65dc2ded4fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:55.674830 13808 raft_consensus.cc:3037] T 0935b512ec48431c878dbb7f62faa658 P 2dfed5e7f0054adf8bd349c94ae4f355 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:55.675756 13808 raft_consensus.cc:2454] T 0935b512ec48431c878dbb7f62faa658 P 2dfed5e7f0054adf8bd349c94ae4f355 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78a41f52bfbd49c2bb83f6c11aa17a29 in term 1.
I20260809 09:22:55.676005 14130 raft_consensus.cc:2454] T 0935b512ec48431c878dbb7f62faa658 P 5856c5b740f04f5387bb65dc2ded4fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78a41f52bfbd49c2bb83f6c11aa17a29 in term 1.
I20260809 09:22:55.676092 13889 leader_election.cc:302] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dfed5e7f0054adf8bd349c94ae4f355, 78a41f52bfbd49c2bb83f6c11aa17a29; no voters:
I20260809 09:22:55.676283 14312 raft_consensus.cc:2781] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:22:55.676513 14312 raft_consensus.cc:686] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 1 LEADER]: Becoming Leader. State: Replica: 78a41f52bfbd49c2bb83f6c11aa17a29, State: Running, Role: LEADER
I20260809 09:22:55.676805 14312 consensus_queue.cc:237] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } }
I20260809 09:22:55.679147 13626 catalog_manager.cc:5495] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 78a41f52bfbd49c2bb83f6c11aa17a29 (127.11.99.194). New cstate: current_term: 1 leader_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78a41f52bfbd49c2bb83f6c11aa17a29" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 } health_report { overall_health: UNKNOWN } } }
I20260809 09:22:55.748839 14331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:55.745475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49810 (local address 127.11.99.194:41589)
0809 09:22:55.745751 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:55.745758 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:55.745770 (+ 12us) server_negotiation.cc:407] Connection header received
0809 09:22:55.745837 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:55.745839 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:55.745888 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:55.745988 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:22:55.746179 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:55.746801 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:55.747490 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:55.747703 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:55.747782 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:55.747987 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:22:55.748422 (+ 435us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:22:55.748529 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:55.748591 (+ 62us) server_negotiation.cc:299] Negotiation successful
0809 09:22:55.748635 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":120,"threads_started":1}
I20260809 09:22:55.757769 14316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:55.755035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:33979 (local address 127.11.99.195:35071)
0809 09:22:55.755236 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:55.755239 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:55.755274 (+ 35us) server_negotiation.cc:407] Connection header received
0809 09:22:55.755380 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:55.755382 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:55.755423 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:55.755479 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:22:55.755675 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:55.756121 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:55.756919 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:55.757114 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:55.757189 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:55.757434 (+ 245us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:22:55.757492 (+ 58us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:22:55.757544 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:55.757620 (+ 76us) server_negotiation.cc:299] Negotiation successful
0809 09:22:55.757663 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137}
I20260809 09:22:55.757790 14335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:55.754931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:35071 (local address 127.11.99.194:33979)
0809 09:22:55.755212 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:55.755223 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:55.755307 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:55.755497 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:55.755499 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:55.755509 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 09:22:55.755591 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:55.755595 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:55.756209 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:55.756211 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:55.756818 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:55.756826 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:55.757210 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:55.757213 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:55.757288 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:55.757325 (+ 37us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 09:22:55.757562 (+ 237us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 09:22:55.757566 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 09:22:55.757613 (+ 47us) client_negotiation.cc:240] Negotiation successful
0809 09:22:55.757671 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":89,"threads_started":1}
I20260809 09:22:55.763157 13808 raft_consensus.cc:1261] T 0935b512ec48431c878dbb7f62faa658 P 2dfed5e7f0054adf8bd349c94ae4f355 [term 1 FOLLOWER]: Refusing update from remote peer 78a41f52bfbd49c2bb83f6c11aa17a29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:22:55.763254 14130 raft_consensus.cc:1261] T 0935b512ec48431c878dbb7f62faa658 P 5856c5b740f04f5387bb65dc2ded4fb0 [term 1 FOLLOWER]: Refusing update from remote peer 78a41f52bfbd49c2bb83f6c11aa17a29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:22:55.763612 14312 consensus_queue.cc:1035] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dfed5e7f0054adf8bd349c94ae4f355" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:22:55.763819 14329 consensus_queue.cc:1035] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5856c5b740f04f5387bb65dc2ded4fb0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:22:55.780087 14343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:55.776828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:41589 (local address 127.11.99.195:52447)
0809 09:22:55.777084 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:55.777098 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:55.777228 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:55.777517 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:55.777520 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:55.777529 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 09:22:55.777638 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:55.777643 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:55.778269 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:55.778271 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:55.778958 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:55.778971 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:55.779424 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:55.779427 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:55.779519 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:55.779545 (+ 26us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 09:22:55.779854 (+ 309us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 09:22:55.779859 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 09:22:55.779921 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 09:22:55.779981 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":109,"threads_started":1}
I20260809 09:22:55.780104 14331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:55.776935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:52447 (local address 127.11.99.194:41589)
0809 09:22:55.777038 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:55.777043 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:55.777180 (+ 137us) server_negotiation.cc:407] Connection header received
0809 09:22:55.777318 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:55.777326 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:55.777365 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:55.777422 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:22:55.777715 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:55.778184 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:55.779074 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:55.779313 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:55.779423 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:55.779682 (+ 259us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:22:55.779744 (+ 62us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:22:55.779841 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:55.779933 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 09:22:55.779984 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260809 09:22:55.780741 14274 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 09:22:57.337829 13626 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41570:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:22:57.337998 13626 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41570:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:22:57.340301 13626 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d22077d0e67e4285ac1e8be576e4ffe4: Sending DeleteTablet for 3 replicas of tablet 0935b512ec48431c878dbb7f62faa658
I20260809 09:22:57.340824 13946 tablet_service.cc:1514] Processing DeleteTablet for tablet 0935b512ec48431c878dbb7f62faa658 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:22:57 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:52804
I20260809 09:22:57.340839 13785 tablet_service.cc:1514] Processing DeleteTablet for tablet 0935b512ec48431c878dbb7f62faa658 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:22:57 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:34564
I20260809 09:22:57.340921 14106 tablet_service.cc:1514] Processing DeleteTablet for tablet 0935b512ec48431c878dbb7f62faa658 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:22:57 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:43674
I20260809 09:22:57.341205 14369 tablet_replica.cc:330] T 0935b512ec48431c878dbb7f62faa658 P 2dfed5e7f0054adf8bd349c94ae4f355: stopping tablet replica
I20260809 09:22:57.341228 14370 tablet_replica.cc:330] T 0935b512ec48431c878dbb7f62faa658 P 5856c5b740f04f5387bb65dc2ded4fb0: stopping tablet replica
I20260809 09:22:57.341327 14370 raft_consensus.cc:2229] T 0935b512ec48431c878dbb7f62faa658 P 5856c5b740f04f5387bb65dc2ded4fb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:22:57.341324 14369 raft_consensus.cc:2229] T 0935b512ec48431c878dbb7f62faa658 P 2dfed5e7f0054adf8bd349c94ae4f355 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:22:57.341508 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 13712
I20260809 09:22:57.343532 14370 raft_consensus.cc:2258] T 0935b512ec48431c878dbb7f62faa658 P 5856c5b740f04f5387bb65dc2ded4fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:22:57.343989 14368 tablet_replica.cc:330] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29: stopping tablet replica
I20260809 09:22:57.344137 14370 ts_tablet_manager.cc:1905] T 0935b512ec48431c878dbb7f62faa658 P 5856c5b740f04f5387bb65dc2ded4fb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:22:57.344233 14368 raft_consensus.cc:2229] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 1 LEADER]: Raft consensus shutting down.
I20260809 09:22:57.344518 14368 raft_consensus.cc:2258] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:22:57.345124 14368 ts_tablet_manager.cc:1905] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:22:57.346684 14370 ts_tablet_manager.cc:1918] T 0935b512ec48431c878dbb7f62faa658 P 5856c5b740f04f5387bb65dc2ded4fb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 09:22:57.346769 14370 log.cc:1196] T 0935b512ec48431c878dbb7f62faa658 P 5856c5b740f04f5387bb65dc2ded4fb0: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/0935b512ec48431c878dbb7f62faa658
I20260809 09:22:57.347031 14370 ts_tablet_manager.cc:1939] T 0935b512ec48431c878dbb7f62faa658 P 5856c5b740f04f5387bb65dc2ded4fb0: Deleting consensus metadata
I20260809 09:22:57.347678 13613 catalog_manager.cc:4841] TS 5856c5b740f04f5387bb65dc2ded4fb0 (127.11.99.195:35071): tablet 0935b512ec48431c878dbb7f62faa658 (table test-table [id=4c0c01ce9d0d42388faea1a4a7f8bb2d]) successfully deleted
I20260809 09:22:57.348439 14368 ts_tablet_manager.cc:1918] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 09:22:57.348542 14368 log.cc:1196] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/0935b512ec48431c878dbb7f62faa658
I20260809 09:22:57.348881 14368 ts_tablet_manager.cc:1939] T 0935b512ec48431c878dbb7f62faa658 P 78a41f52bfbd49c2bb83f6c11aa17a29: Deleting consensus metadata
I20260809 09:22:57.349640 13612 catalog_manager.cc:4841] TS 78a41f52bfbd49c2bb83f6c11aa17a29 (127.11.99.194:41589): tablet 0935b512ec48431c878dbb7f62faa658 (table test-table [id=4c0c01ce9d0d42388faea1a4a7f8bb2d]) successfully deleted
W20260809 09:22:57.351910 13612 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.99.193:38125 (error 108)
I20260809 09:22:57.352124 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 13868
I20260809 09:22:57.354614 14372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:57.354052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:38125 (local address 127.0.0.1:42252)
0809 09:22:57.354354 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:57.354457 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.193:38125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":71,"threads_started":1}
W20260809 09:22:57.354848 13612 catalog_manager.cc:4584] TS 2dfed5e7f0054adf8bd349c94ae4f355 (127.11.99.193:38125): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0935b512ec48431c878dbb7f62faa658: Network error: Client connection negotiation failed: client connection to 127.11.99.193:38125: connect: Connection refused (error 111)
I20260809 09:22:57.362201 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 14030
I20260809 09:22:57.371101 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 13591
2026-08-09T09:22:57Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6478 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:22:57 dist-test-slave-pgkr krb5kdc[14376](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:22:57 dist-test-slave-pgkr krb5kdc[14376](info): set up 2 sockets
Aug 09 09:22:57 dist-test-slave-pgkr krb5kdc[14376](info): commencing operation
krb5kdc: starting...
W20260809 09:22:58.552722 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260809 09:22:58.718736 11663 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.166s user 0.000s sys 0.003s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260809 09:22:58.877236 11663 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.158s user 0.000s sys 0.002s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260809 09:22:58.978472 11663 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.101s user 0.000s sys 0.002s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/test-user.keytab.
W20260809 09:22:59.225492 11663 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.247s user 0.000s sys 0.002s
Aug 09 09:22:59 dist-test-slave-pgkr krb5kdc[14376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267379, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:22:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:22:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:22:59.272907 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:40535
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:36293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:40535
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:22:59.379451 14389 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:22:59.379679 14389 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:22:59.379765 14389 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:22:59.383270 14389 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:22:59.383311 14389 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:22:59.383327 14389 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:22:59.383363 14389 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:22:59.383392 14389 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:22:59.387760 14389 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:36293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:40535
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:40535
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14389
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:22:59.388592 14389 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:22:59.389547 14389 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:22:59.397260 14399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:59.397269 14398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:59.397358 14401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:59.397403 14389 server_base.cc:1034] running on GCE node
I20260809 09:22:59.398063 14389 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:22:59.399096 14389 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:22:59.400347 14389 hybrid_clock.cc:648] HybridClock initialized: now 1786267379400324 us; error 37 us; skew 500 ppm
Aug 09 09:22:59 dist-test-slave-pgkr krb5kdc[14376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267379, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:22:59.403009 14389 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:22:59.403833 14389 webserver.cc:460] Webserver started at http://127.11.99.254:34471/ using document root <none> and password file <none>
I20260809 09:22:59.404376 14389 fs_manager.cc:359] Metadata directory not provided
I20260809 09:22:59.404434 14389 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:22:59.404585 14389 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:22:59.406473 14389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "c6a7b47a83cb455c97d09e9bd87dd9ed"
format_stamp: "Formatted at 2026-08-09 09:22:59 on dist-test-slave-pgkr"
server_key: "cfdc4995804b186f5ff4ef136cbd21f0"
server_key_iv: "3e8a2ab3eee0a3688651fc097874122a"
server_key_version: "encryptionkey@0"
I20260809 09:22:59.407074 14389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "c6a7b47a83cb455c97d09e9bd87dd9ed"
format_stamp: "Formatted at 2026-08-09 09:22:59 on dist-test-slave-pgkr"
server_key: "cfdc4995804b186f5ff4ef136cbd21f0"
server_key_iv: "3e8a2ab3eee0a3688651fc097874122a"
server_key_version: "encryptionkey@0"
I20260809 09:22:59.410526 14389 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 09:22:59.412744 14413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:59.413877 14389 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:22:59.414019 14389 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "c6a7b47a83cb455c97d09e9bd87dd9ed"
format_stamp: "Formatted at 2026-08-09 09:22:59 on dist-test-slave-pgkr"
server_key: "cfdc4995804b186f5ff4ef136cbd21f0"
server_key_iv: "3e8a2ab3eee0a3688651fc097874122a"
server_key_version: "encryptionkey@0"
I20260809 09:22:59.414117 14389 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:22:59.429035 14389 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:22:59.431823 14389 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:22:59.432009 14389 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:22:59.438831 14389 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:40535
I20260809 09:22:59.438874 14470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:40535 every 8 connection(s)
I20260809 09:22:59.439710 14389 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:22:59.442195 14471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:22:59.447285 14471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6a7b47a83cb455c97d09e9bd87dd9ed: Bootstrap starting.
I20260809 09:22:59.448348 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 14389
I20260809 09:22:59.448436 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:22:59.448691 11663 external_mini_cluster.cc:1428] Setting key e5f663bfaa61324575dec53946970bda
I20260809 09:22:59.449766 14471 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c6a7b47a83cb455c97d09e9bd87dd9ed: Neither blocks nor log segments found. Creating new log.
I20260809 09:22:59.450637 14471 log.cc:824] T 00000000000000000000000000000000 P c6a7b47a83cb455c97d09e9bd87dd9ed: Log is configured to *not* fsync() on all Append() calls
I20260809 09:22:59.452725 14471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6a7b47a83cb455c97d09e9bd87dd9ed: No bootstrap required, opened a new log
I20260809 09:22:59.456636 14471 raft_consensus.cc:348] T 00000000000000000000000000000000 P c6a7b47a83cb455c97d09e9bd87dd9ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6a7b47a83cb455c97d09e9bd87dd9ed" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 40535 } }
I20260809 09:22:59.456830 14471 raft_consensus.cc:374] T 00000000000000000000000000000000 P c6a7b47a83cb455c97d09e9bd87dd9ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:22:59.456881 14471 raft_consensus.cc:729] T 00000000000000000000000000000000 P c6a7b47a83cb455c97d09e9bd87dd9ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a7b47a83cb455c97d09e9bd87dd9ed, State: Initialized, Role: FOLLOWER
I20260809 09:22:59.457301 14471 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6a7b47a83cb455c97d09e9bd87dd9ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6a7b47a83cb455c97d09e9bd87dd9ed" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 40535 } }
I20260809 09:22:59.457449 14471 raft_consensus.cc:388] T 00000000000000000000000000000000 P c6a7b47a83cb455c97d09e9bd87dd9ed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:22:59.457537 14471 raft_consensus.cc:482] T 00000000000000000000000000000000 P c6a7b47a83cb455c97d09e9bd87dd9ed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
Aug 09 09:22:59 dist-test-slave-pgkr krb5kdc[14376](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267379, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:22:59.457651 14471 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c6a7b47a83cb455c97d09e9bd87dd9ed [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:22:59.458662 14471 raft_consensus.cc:504] T 00000000000000000000000000000000 P c6a7b47a83cb455c97d09e9bd87dd9ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6a7b47a83cb455c97d09e9bd87dd9ed" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 40535 } }
I20260809 09:22:59.459059 14471 leader_election.cc:302] T 00000000000000000000000000000000 P c6a7b47a83cb455c97d09e9bd87dd9ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c6a7b47a83cb455c97d09e9bd87dd9ed; no voters:
I20260809 09:22:59.459411 14471 leader_election.cc:288] T 00000000000000000000000000000000 P c6a7b47a83cb455c97d09e9bd87dd9ed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:22:59.459517 14476 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c6a7b47a83cb455c97d09e9bd87dd9ed [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:22:59.459729 14476 raft_consensus.cc:686] T 00000000000000000000000000000000 P c6a7b47a83cb455c97d09e9bd87dd9ed [term 1 LEADER]: Becoming Leader. State: Replica: c6a7b47a83cb455c97d09e9bd87dd9ed, State: Running, Role: LEADER
I20260809 09:22:59.460049 14476 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6a7b47a83cb455c97d09e9bd87dd9ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6a7b47a83cb455c97d09e9bd87dd9ed" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 40535 } }
I20260809 09:22:59.460637 14471 sys_catalog.cc:564] T 00000000000000000000000000000000 P c6a7b47a83cb455c97d09e9bd87dd9ed [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:22:59.461239 14476 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6a7b47a83cb455c97d09e9bd87dd9ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6a7b47a83cb455c97d09e9bd87dd9ed. Latest consensus state: current_term: 1 leader_uuid: "c6a7b47a83cb455c97d09e9bd87dd9ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6a7b47a83cb455c97d09e9bd87dd9ed" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 40535 } } }
I20260809 09:22:59.461478 14476 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6a7b47a83cb455c97d09e9bd87dd9ed [sys.catalog]: This master's current role is: LEADER
I20260809 09:22:59.461654 14477 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6a7b47a83cb455c97d09e9bd87dd9ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c6a7b47a83cb455c97d09e9bd87dd9ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6a7b47a83cb455c97d09e9bd87dd9ed" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 40535 } } }
I20260809 09:22:59.461814 14477 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6a7b47a83cb455c97d09e9bd87dd9ed [sys.catalog]: This master's current role is: LEADER
I20260809 09:22:59.461923 14486 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:22:59.463802 14474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:59.449728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34996 (local address 127.11.99.254:40535)
0809 09:22:59.450175 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:59.450192 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:59.450229 (+ 37us) server_negotiation.cc:407] Connection header received
0809 09:22:59.451084 (+ 855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:59.451100 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:59.451413 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:59.451738 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:59.452465 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:59.453886 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:59.454749 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:59.455501 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:59.455707 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:59.458263 (+ 2556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:59.458268 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:59.458279 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:59.458305 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:59.460335 (+ 2030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:59.460822 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:59.460828 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:59.460833 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:59.460968 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:59.461283 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:59.461303 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:59.461307 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:59.461834 (+ 527us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:59.462017 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:59.462746 (+ 729us) server_negotiation.cc:299] Negotiation successful
0809 09:22:59.462969 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":145,"threads_started":1}
I20260809 09:22:59.465006 14486 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:22:59.471346 14486 catalog_manager.cc:1347] Generated new cluster ID: ee28352de1a745d9bf435e354fb72070
I20260809 09:22:59.471410 14486 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:22:59.479008 14486 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:22:59.480232 14486 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:22:59.488304 14486 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c6a7b47a83cb455c97d09e9bd87dd9ed: Generated new TSK 0
I20260809 09:22:59.489005 14486 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.99.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
I20260809 09:22:59.523733 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:0
--local_ip_for_outbound_sockets=127.11.99.193
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:40535
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:36293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:22:59.628865 14500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:22:59.629082 14500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:22:59.629145 14500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:22:59.633052 14500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:22:59.633104 14500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:22:59.633206 14500 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:22:59.638576 14500 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:36293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:40535
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:22:59.639505 14500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:22:59.640439 14500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:22:59.649432 14505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:59.649462 14506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:59.649538 14500 server_base.cc:1034] running on GCE node
W20260809 09:22:59.649773 14508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:59.650187 14500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:22:59.650872 14500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:22:59.652016 14500 hybrid_clock.cc:648] HybridClock initialized: now 1786267379651990 us; error 38 us; skew 500 ppm
Aug 09 09:22:59 dist-test-slave-pgkr krb5kdc[14376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267379, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:22:59.654703 14500 init.cc:377] Logged in from keytab as kudu/127.11.99.193@KRBTEST.COM (short username kudu)
I20260809 09:22:59.655524 14500 webserver.cc:460] Webserver started at http://127.11.99.193:40179/ using document root <none> and password file <none>
I20260809 09:22:59.656140 14500 fs_manager.cc:359] Metadata directory not provided
I20260809 09:22:59.656239 14500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:22:59.656536 14500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:22:59.658483 14500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/data/instance:
uuid: "063b5f5e6d014a85ad3e9e6c0d16f527"
format_stamp: "Formatted at 2026-08-09 09:22:59 on dist-test-slave-pgkr"
server_key: "be22ca438bfebed51b59509e94ea184c"
server_key_iv: "ebe9b0f877a0e886884648fabbde4d32"
server_key_version: "encryptionkey@0"
I20260809 09:22:59.659101 14500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance:
uuid: "063b5f5e6d014a85ad3e9e6c0d16f527"
format_stamp: "Formatted at 2026-08-09 09:22:59 on dist-test-slave-pgkr"
server_key: "be22ca438bfebed51b59509e94ea184c"
server_key_iv: "ebe9b0f877a0e886884648fabbde4d32"
server_key_version: "encryptionkey@0"
I20260809 09:22:59.662817 14500 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 09:22:59.664956 14517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:59.665989 14500 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:22:59.666103 14500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "063b5f5e6d014a85ad3e9e6c0d16f527"
format_stamp: "Formatted at 2026-08-09 09:22:59 on dist-test-slave-pgkr"
server_key: "be22ca438bfebed51b59509e94ea184c"
server_key_iv: "ebe9b0f877a0e886884648fabbde4d32"
server_key_version: "encryptionkey@0"
I20260809 09:22:59.666203 14500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:22:59.684873 14500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:22:59.687963 14500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:22:59.688156 14500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:22:59.688676 14500 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:22:59.689440 14500 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:22:59.689505 14500 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:59.689574 14500 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:22:59.689610 14500 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:59.698685 14500 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:41937
I20260809 09:22:59.698711 14646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:41937 every 8 connection(s)
I20260809 09:22:59.699502 14500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
Aug 09 09:22:59 dist-test-slave-pgkr krb5kdc[14376](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267379, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:22:59.709568 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 14500
I20260809 09:22:59.709712 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance
I20260809 09:22:59.710110 11663 external_mini_cluster.cc:1428] Setting key 9408e069a1d494ff31737ab4bec03266
I20260809 09:22:59.713400 14474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:59.701281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:39529 (local address 127.11.99.254:40535)
0809 09:22:59.701416 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:59.701419 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:59.702218 (+ 799us) server_negotiation.cc:407] Connection header received
0809 09:22:59.703375 (+ 1157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:59.703378 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:59.703428 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:59.703545 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:59.704608 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:59.705163 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:59.706347 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:59.706678 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:59.706796 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:59.709214 (+ 2418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:59.709217 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:59.709219 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:59.709266 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:59.711066 (+ 1800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:59.711636 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:59.711642 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:59.711644 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:59.711755 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:59.712112 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:59.712116 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:59.712118 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:59.712394 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:59.712523 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:59.712951 (+ 428us) server_negotiation.cc:299] Negotiation successful
0809 09:22:59.713119 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 09:22:59.713858 14650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:59.701649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:40535 (local address 127.11.99.193:39529)
0809 09:22:59.702074 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:59.702112 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:59.703188 (+ 1076us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:59.703703 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:59.703709 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:59.704021 (+ 312us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:22:59.704436 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:59.704448 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:59.705291 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:59.705294 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:59.706202 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:59.706212 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:59.706843 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:59.706846 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:59.706977 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:59.707538 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:22:59.707572 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:22:59.709056 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:22:59.711182 (+ 2126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:59.711187 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:59.711199 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:59.711530 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:59.711879 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:59.711881 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:59.711883 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:59.712011 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:59.712505 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:22:59.712509 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:22:59.712715 (+ 206us) client_negotiation.cc:769] Sending connection context
0809 09:22:59.712859 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 09:22:59.713076 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":129,"threads_started":1}
I20260809 09:22:59.715181 14647 heartbeater.cc:347] Connected to a master server at 127.11.99.254:40535
I20260809 09:22:59.715440 14647 heartbeater.cc:464] Registering TS with master...
I20260809 09:22:59.716024 14647 heartbeater.cc:511] Master 127.11.99.254:40535 requested a full tablet report, sending...
I20260809 09:22:59.717607 14433 ts_manager.cc:194] Registered new tserver with Master: 063b5f5e6d014a85ad3e9e6c0d16f527 (127.11.99.193:41937)
I20260809 09:22:59.718736 14433 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.193@KRBTEST.COM'} at 127.11.99.193:39529
WARNING: no policy specified for kudu/127.11.99.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
I20260809 09:22:59.738355 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:0
--local_ip_for_outbound_sockets=127.11.99.194
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:40535
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:36293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:22:59.840857 14653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:22:59.841058 14653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:22:59.841094 14653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:22:59.844704 14653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:22:59.844748 14653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:22:59.844796 14653 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:22:59.849591 14653 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:36293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:40535
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14653
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:22:59.850378 14653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:22:59.851269 14653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:22:59.859876 14660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:22:59.859905 14659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:59.859974 14653 server_base.cc:1034] running on GCE node
W20260809 09:22:59.859920 14663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:22:59.860502 14653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:22:59.861122 14653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:22:59.862291 14653 hybrid_clock.cc:648] HybridClock initialized: now 1786267379862276 us; error 25 us; skew 500 ppm
Aug 09 09:22:59 dist-test-slave-pgkr krb5kdc[14376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267379, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:22:59.864953 14653 init.cc:377] Logged in from keytab as kudu/127.11.99.194@KRBTEST.COM (short username kudu)
I20260809 09:22:59.866065 14653 webserver.cc:460] Webserver started at http://127.11.99.194:46203/ using document root <none> and password file <none>
I20260809 09:22:59.866726 14653 fs_manager.cc:359] Metadata directory not provided
I20260809 09:22:59.866814 14653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:22:59.866978 14653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:22:59.868885 14653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/data/instance:
uuid: "b61488b039ef4c24a6275d59cd5fede0"
format_stamp: "Formatted at 2026-08-09 09:22:59 on dist-test-slave-pgkr"
server_key: "dbc47a6604368802594016acfb816440"
server_key_iv: "efbd0fc98b6e36673fedb122970dd207"
server_key_version: "encryptionkey@0"
I20260809 09:22:59.869336 14653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance:
uuid: "b61488b039ef4c24a6275d59cd5fede0"
format_stamp: "Formatted at 2026-08-09 09:22:59 on dist-test-slave-pgkr"
server_key: "dbc47a6604368802594016acfb816440"
server_key_iv: "efbd0fc98b6e36673fedb122970dd207"
server_key_version: "encryptionkey@0"
I20260809 09:22:59.872859 14653 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:22:59.875020 14670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:59.876124 14653 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:22:59.876250 14653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "b61488b039ef4c24a6275d59cd5fede0"
format_stamp: "Formatted at 2026-08-09 09:22:59 on dist-test-slave-pgkr"
server_key: "dbc47a6604368802594016acfb816440"
server_key_iv: "efbd0fc98b6e36673fedb122970dd207"
server_key_version: "encryptionkey@0"
I20260809 09:22:59.876350 14653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:22:59.887346 14653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:22:59.889775 14653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:22:59.890003 14653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:22:59.890784 14653 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:22:59.891601 14653 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:22:59.891647 14653 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:59.891683 14653 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:22:59.891703 14653 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:22:59.899979 14653 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:41659
I20260809 09:22:59.900027 14804 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:41659 every 8 connection(s)
I20260809 09:22:59.900761 14653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:22:59.903807 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 14653
I20260809 09:22:59.903946 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance
I20260809 09:22:59.904268 11663 external_mini_cluster.cc:1428] Setting key f1ee504c2e1ca228736a3c86d1ab4e6a
Aug 09 09:22:59 dist-test-slave-pgkr krb5kdc[14376](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267379, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:22:59.914335 14474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:59.902357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:59219 (local address 127.11.99.254:40535)
0809 09:22:59.902483 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 09:22:59.902487 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:22:59.903310 (+ 823us) server_negotiation.cc:407] Connection header received
0809 09:22:59.904941 (+ 1631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:22:59.904943 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:22:59.904988 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:22:59.905115 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:22:59.906289 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:59.906839 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:59.907956 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:22:59.908184 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:22:59.908291 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:59.910524 (+ 2233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:22:59.910531 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:22:59.910537 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:22:59.910568 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:22:59.912254 (+ 1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:59.912781 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:59.912787 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:59.912792 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:59.912892 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:22:59.913216 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:22:59.913220 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:22:59.913223 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:22:59.913472 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:22:59.913583 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 09:22:59.914005 (+ 422us) server_negotiation.cc:299] Negotiation successful
0809 09:22:59.914158 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
WARNING: no policy specified for kudu/127.11.99.195@KRBTEST.COM; defaulting to no policy
I20260809 09:22:59.914933 14809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:22:59.902750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:40535 (local address 127.11.99.194:59219)
0809 09:22:59.903157 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0809 09:22:59.903197 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 09:22:59.904722 (+ 1525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:22:59.905274 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:22:59.905280 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:22:59.905711 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:22:59.906160 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:59.906172 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:59.906987 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:59.906990 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:59.907834 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:22:59.907843 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:22:59.908322 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:22:59.908326 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:22:59.908485 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:22:59.909029 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:22:59.909044 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:22:59.910370 (+ 1326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:22:59.912389 (+ 2019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:59.912395 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:59.912411 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:59.912671 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:59.912986 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:22:59.912988 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:22:59.912989 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:22:59.913110 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:22:59.913577 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:22:59.913581 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:22:59.913772 (+ 191us) client_negotiation.cc:769] Sending connection context
0809 09:22:59.913910 (+ 138us) client_negotiation.cc:240] Negotiation successful
0809 09:22:59.914143 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":107,"threads_started":1}
I20260809 09:22:59.916046 14806 heartbeater.cc:347] Connected to a master server at 127.11.99.254:40535
I20260809 09:22:59.916249 14806 heartbeater.cc:464] Registering TS with master...
I20260809 09:22:59.916683 14806 heartbeater.cc:511] Master 127.11.99.254:40535 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.195@KRBTEST.COM" created.
I20260809 09:22:59.917847 14433 ts_manager.cc:194] Registered new tserver with Master: b61488b039ef4c24a6275d59cd5fede0 (127.11.99.194:41659)
I20260809 09:22:59.918715 14433 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.194@KRBTEST.COM'} at 127.11.99.194:59219
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
I20260809 09:22:59.931087 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:0
--local_ip_for_outbound_sockets=127.11.99.195
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:40535
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:36293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:00.037453 14813 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:00.037714 14813 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:00.037798 14813 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:00.041527 14813 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:00.041603 14813 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:00.041687 14813 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:23:00.046304 14813 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:36293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:40535
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14813
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:00.047302 14813 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:00.048219 14813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 09:23:00.057263 14813 server_base.cc:1034] running on GCE node
W20260809 09:23:00.057268 14820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:00.057319 14819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:00.057269 14822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:00.057888 14813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:00.058468 14813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:00.059636 14813 hybrid_clock.cc:648] HybridClock initialized: now 1786267380059615 us; error 38 us; skew 500 ppm
Aug 09 09:23:00 dist-test-slave-pgkr krb5kdc[14376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267380, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:00.062194 14813 init.cc:377] Logged in from keytab as kudu/127.11.99.195@KRBTEST.COM (short username kudu)
I20260809 09:23:00.063067 14813 webserver.cc:460] Webserver started at http://127.11.99.195:37019/ using document root <none> and password file <none>
I20260809 09:23:00.063580 14813 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:00.063663 14813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:00.063927 14813 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:00.065769 14813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/data/instance:
uuid: "638c65b0912f4809836eaccd199b4116"
format_stamp: "Formatted at 2026-08-09 09:23:00 on dist-test-slave-pgkr"
server_key: "0fb1df1415d97e0128d5123425368aa2"
server_key_iv: "efce057c773d5709c1c54a222ca59bdd"
server_key_version: "encryptionkey@0"
I20260809 09:23:00.066361 14813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance:
uuid: "638c65b0912f4809836eaccd199b4116"
format_stamp: "Formatted at 2026-08-09 09:23:00 on dist-test-slave-pgkr"
server_key: "0fb1df1415d97e0128d5123425368aa2"
server_key_iv: "efce057c773d5709c1c54a222ca59bdd"
server_key_version: "encryptionkey@0"
I20260809 09:23:00.069907 14813 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 09:23:00.072227 14830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:00.073387 14813 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 09:23:00.073518 14813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "638c65b0912f4809836eaccd199b4116"
format_stamp: "Formatted at 2026-08-09 09:23:00 on dist-test-slave-pgkr"
server_key: "0fb1df1415d97e0128d5123425368aa2"
server_key_iv: "efce057c773d5709c1c54a222ca59bdd"
server_key_version: "encryptionkey@0"
I20260809 09:23:00.073619 14813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:00.094944 14813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:00.097507 14813 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:00.097697 14813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:00.098245 14813 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:00.099083 14813 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:00.099151 14813 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:00.099218 14813 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:00.099260 14813 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:00.108458 14813 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:45889
I20260809 09:23:00.108485 14956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:45889 every 8 connection(s)
I20260809 09:23:00.109329 14813 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:23:00.117192 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 14813
I20260809 09:23:00.117300 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance
I20260809 09:23:00.117586 11663 external_mini_cluster.cc:1428] Setting key 259bf53e3ff3542b02ff381e0f1ca088
Aug 09 09:23:00 dist-test-slave-pgkr krb5kdc[14376](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267380, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:23:00.122355 14474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:00.111062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:45977 (local address 127.11.99.254:40535)
0809 09:23:00.111205 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:00.111209 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:00.111963 (+ 754us) server_negotiation.cc:407] Connection header received
0809 09:23:00.113154 (+ 1191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:00.113157 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:00.113203 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:00.113282 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:00.114317 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:00.114871 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:00.115882 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:00.116096 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:00.116171 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:00.119163 (+ 2992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:00.119166 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:00.119168 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:00.119190 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:00.120748 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:00.121203 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:00.121205 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:00.121206 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:00.121288 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:00.121541 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:00.121543 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:00.121544 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:00.121695 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:00.121778 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:00.122152 (+ 374us) server_negotiation.cc:299] Negotiation successful
0809 09:23:00.122248 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 09:23:00.123112 14959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:00.111398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:40535 (local address 127.11.99.195:45977)
0809 09:23:00.111822 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:00.111860 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:00.112962 (+ 1102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:00.113431 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:00.113437 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:00.113777 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:00.114203 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:00.114214 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:00.114965 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:00.114967 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:00.115786 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:00.115794 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:00.116267 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:00.116271 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:00.116412 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:00.117194 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:00.117241 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:00.118987 (+ 1746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:00.120843 (+ 1856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:00.120847 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:00.120856 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:00.121100 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:00.121356 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:00.121358 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:00.121359 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:00.121474 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:00.121784 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:00.121788 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:00.121976 (+ 188us) client_negotiation.cc:769] Sending connection context
0809 09:23:00.122110 (+ 134us) client_negotiation.cc:240] Negotiation successful
0809 09:23:00.122317 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":107,"threads_started":1}
I20260809 09:23:00.124058 14957 heartbeater.cc:347] Connected to a master server at 127.11.99.254:40535
I20260809 09:23:00.124274 14957 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:00.124722 14957 heartbeater.cc:511] Master 127.11.99.254:40535 requested a full tablet report, sending...
I20260809 09:23:00.125664 14433 ts_manager.cc:194] Registered new tserver with Master: 638c65b0912f4809836eaccd199b4116 (127.11.99.195:45889)
I20260809 09:23:00.126196 14433 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.195@KRBTEST.COM'} at 127.11.99.195:45977
I20260809 09:23:00.131259 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 09:23:00.144753 14474 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:00.143390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35002 (local address 127.11.99.254:40535)
0809 09:23:00.143543 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:00.143548 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:00.143677 (+ 129us) server_negotiation.cc:407] Connection header received
0809 09:23:00.143801 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:00.143803 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:00.143842 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:00.143899 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:00.144590 (+ 691us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35002: BlockingRecv error: recv got EOF from 127.0.0.1:35002 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 09:23:00.145699 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 14500
I20260809 09:23:00.154413 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 14653
I20260809 09:23:00.162434 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 14813
I20260809 09:23:00.169296 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 14389
2026-08-09T09:23:00Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2796 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:23:00 dist-test-slave-pgkr krb5kdc[14971](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:23:00 dist-test-slave-pgkr krb5kdc[14971](info): set up 2 sockets
Aug 09 09:23:00 dist-test-slave-pgkr krb5kdc[14971](info): commencing operation
krb5kdc: starting...
W20260809 09:23:01.218226 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.027s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:23:01 dist-test-slave-pgkr krb5kdc[14971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267381, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:23:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:23:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:23:01.338379 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:34551
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:40749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:34551
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:01.443150 14985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:01.443456 14985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:01.443542 14985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:01.449692 14985 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:23:01.449787 14985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:01.449843 14985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:01.449885 14985 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:23:01.449926 14985 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:23:01.458827 14985 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:40749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:34551
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:34551
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:01.460227 14985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:01.461668 14985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:01.471643 14993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:01.471879 14996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:01.471625 14992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:01.473315 14985 server_base.cc:1034] running on GCE node
I20260809 09:23:01.473901 14985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:01.475203 14985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:01.476390 14985 hybrid_clock.cc:648] HybridClock initialized: now 1786267381476370 us; error 39 us; skew 500 ppm
Aug 09 09:23:01 dist-test-slave-pgkr krb5kdc[14971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267381, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:01.480010 14985 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:23:01.481050 14985 webserver.cc:460] Webserver started at http://127.11.99.254:40343/ using document root <none> and password file <none>
I20260809 09:23:01.481597 14985 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:01.481657 14985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:01.481920 14985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:01.484452 14985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "21323070251f423881db6753eefdb53f"
format_stamp: "Formatted at 2026-08-09 09:23:01 on dist-test-slave-pgkr"
server_key: "18a67e9e91b127ca261728df4caecd7f"
server_key_iv: "94af08385d4c3326ec45b7039b2a6210"
server_key_version: "encryptionkey@0"
I20260809 09:23:01.485073 14985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "21323070251f423881db6753eefdb53f"
format_stamp: "Formatted at 2026-08-09 09:23:01 on dist-test-slave-pgkr"
server_key: "18a67e9e91b127ca261728df4caecd7f"
server_key_iv: "94af08385d4c3326ec45b7039b2a6210"
server_key_version: "encryptionkey@0"
I20260809 09:23:01.488829 14985 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:23:01.491245 15003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:01.492739 14985 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 09:23:01.492885 14985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "21323070251f423881db6753eefdb53f"
format_stamp: "Formatted at 2026-08-09 09:23:01 on dist-test-slave-pgkr"
server_key: "18a67e9e91b127ca261728df4caecd7f"
server_key_iv: "94af08385d4c3326ec45b7039b2a6210"
server_key_version: "encryptionkey@0"
I20260809 09:23:01.492998 14985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:01.505246 14985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:01.507916 14985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:01.508098 14985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:01.515069 14985 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:34551
I20260809 09:23:01.515348 15061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:34551 every 8 connection(s)
I20260809 09:23:01.515969 14985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:23:01.518443 15062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:01.523828 15062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21323070251f423881db6753eefdb53f: Bootstrap starting.
I20260809 09:23:01.524226 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 14985
I20260809 09:23:01.524348 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:23:01.524631 11663 external_mini_cluster.cc:1428] Setting key 328c54b4bb9b0de00c3d02f56684e755
I20260809 09:23:01.526342 15062 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 21323070251f423881db6753eefdb53f: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:01.527096 15062 log.cc:824] T 00000000000000000000000000000000 P 21323070251f423881db6753eefdb53f: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:01.529116 15062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21323070251f423881db6753eefdb53f: No bootstrap required, opened a new log
Aug 09 09:23:01 dist-test-slave-pgkr krb5kdc[14971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267381, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:23:01.533530 15062 raft_consensus.cc:348] T 00000000000000000000000000000000 P 21323070251f423881db6753eefdb53f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21323070251f423881db6753eefdb53f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34551 } }
I20260809 09:23:01.533767 15062 raft_consensus.cc:374] T 00000000000000000000000000000000 P 21323070251f423881db6753eefdb53f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:01.533831 15062 raft_consensus.cc:729] T 00000000000000000000000000000000 P 21323070251f423881db6753eefdb53f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21323070251f423881db6753eefdb53f, State: Initialized, Role: FOLLOWER
I20260809 09:23:01.534228 15062 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21323070251f423881db6753eefdb53f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21323070251f423881db6753eefdb53f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34551 } }
I20260809 09:23:01.534361 15062 raft_consensus.cc:388] T 00000000000000000000000000000000 P 21323070251f423881db6753eefdb53f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:23:01.534423 15062 raft_consensus.cc:482] T 00000000000000000000000000000000 P 21323070251f423881db6753eefdb53f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:23:01.534525 15062 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 21323070251f423881db6753eefdb53f [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:01.535637 15062 raft_consensus.cc:504] T 00000000000000000000000000000000 P 21323070251f423881db6753eefdb53f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21323070251f423881db6753eefdb53f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34551 } }
I20260809 09:23:01.535986 15062 leader_election.cc:302] T 00000000000000000000000000000000 P 21323070251f423881db6753eefdb53f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 21323070251f423881db6753eefdb53f; no voters:
I20260809 09:23:01.536290 15062 leader_election.cc:288] T 00000000000000000000000000000000 P 21323070251f423881db6753eefdb53f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:23:01.536403 15068 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 21323070251f423881db6753eefdb53f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:23:01.536653 15068 raft_consensus.cc:686] T 00000000000000000000000000000000 P 21323070251f423881db6753eefdb53f [term 1 LEADER]: Becoming Leader. State: Replica: 21323070251f423881db6753eefdb53f, State: Running, Role: LEADER
I20260809 09:23:01.536999 15068 consensus_queue.cc:237] T 00000000000000000000000000000000 P 21323070251f423881db6753eefdb53f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21323070251f423881db6753eefdb53f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34551 } }
I20260809 09:23:01.537513 15062 sys_catalog.cc:564] T 00000000000000000000000000000000 P 21323070251f423881db6753eefdb53f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:23:01.538285 15069 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21323070251f423881db6753eefdb53f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21323070251f423881db6753eefdb53f. Latest consensus state: current_term: 1 leader_uuid: "21323070251f423881db6753eefdb53f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21323070251f423881db6753eefdb53f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34551 } } }
I20260809 09:23:01.538440 15069 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21323070251f423881db6753eefdb53f [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:01.538969 15070 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21323070251f423881db6753eefdb53f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "21323070251f423881db6753eefdb53f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21323070251f423881db6753eefdb53f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34551 } } }
I20260809 09:23:01.539091 15070 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21323070251f423881db6753eefdb53f [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:01.540086 15065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:01.525785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47238 (local address 127.11.99.254:34551)
0809 09:23:01.526166 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:01.526181 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:01.526214 (+ 33us) server_negotiation.cc:407] Connection header received
0809 09:23:01.526904 (+ 690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:01.526920 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:01.527281 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:01.527615 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:01.528490 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:01.529499 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:01.530678 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:01.531111 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:01.531225 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:01.534070 (+ 2845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:01.534074 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:01.534085 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:01.534109 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:01.536041 (+ 1932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:01.536629 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:01.536636 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:01.536643 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:01.536811 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:01.537157 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:01.537160 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:01.537162 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:01.537655 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:01.537858 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:01.538642 (+ 784us) server_negotiation.cc:299] Negotiation successful
0809 09:23:01.538942 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":129,"threads_started":1}
W20260809 09:23:01.542954 15086 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 21323070251f423881db6753eefdb53f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 09:23:01.543028 15086 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 09:23:01.543103 15078 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:23:01.543123 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 09:23:01.543982 15078 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:23:01.549957 15078 catalog_manager.cc:1347] Generated new cluster ID: 189956c0da7446d4bd459d63e13930a2
I20260809 09:23:01.550031 15078 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:23:01.556056 15078 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:23:01.557238 15078 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:23:01.561517 15065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:01.555775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47252 (local address 127.11.99.254:34551)
0809 09:23:01.555872 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:01.555878 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:01.556435 (+ 557us) server_negotiation.cc:407] Connection header received
0809 09:23:01.556596 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:01.556599 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:01.556648 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:01.556729 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:01.557310 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:01.558008 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:01.559178 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:01.559576 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:01.559668 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:01.560544 (+ 876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:01.560547 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:01.560550 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:23:01.561065 (+ 515us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:01.561097 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:23:01.561114 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:01.561199 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:01.561318 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 09:23:01.561387 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 09:23:01.567106 15078 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 21323070251f423881db6753eefdb53f: Generated new TSK 0
I20260809 09:23:01.567771 15078 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:23:01.576546 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 14985
2026-08-09T09:23:01Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1406 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:23:01 dist-test-slave-pgkr krb5kdc[15102](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:23:01 dist-test-slave-pgkr krb5kdc[15102](info): set up 2 sockets
Aug 09 09:23:01 dist-test-slave-pgkr krb5kdc[15102](info): commencing operation
krb5kdc: starting...
W20260809 09:23:02.605497 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.007s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:23:02 dist-test-slave-pgkr krb5kdc[15102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:23:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:23:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:23:02.721275 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:35085
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:35265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:35085
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:02.824376 15116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:02.824615 15116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:02.824654 15116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:02.828691 15116 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:23:02.828745 15116 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:02.828764 15116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:02.828779 15116 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:23:02.828824 15116 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:23:02.833734 15116 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:35265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:35085
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:35085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15116
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:02.834659 15116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:02.835601 15116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:02.843575 15122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:02.843600 15121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:02.843645 15116 server_base.cc:1034] running on GCE node
W20260809 09:23:02.843593 15124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:02.844304 15116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:02.845337 15116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:02.846490 15116 hybrid_clock.cc:648] HybridClock initialized: now 1786267382846468 us; error 34 us; skew 500 ppm
Aug 09 09:23:02 dist-test-slave-pgkr krb5kdc[15102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267382, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:02.853107 15116 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:23:02.853904 15116 webserver.cc:460] Webserver started at http://127.11.99.254:43657/ using document root <none> and password file <none>
I20260809 09:23:02.854418 15116 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:02.854475 15116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:02.854730 15116 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:02.856734 15116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "e3b3ed0ba3424054aad29935df4db906"
format_stamp: "Formatted at 2026-08-09 09:23:02 on dist-test-slave-pgkr"
server_key: "3f738cde5f24e57f0eda9c1852a30e1f"
server_key_iv: "b32179ced34efa8b397cc5edba6d00e2"
server_key_version: "encryptionkey@0"
I20260809 09:23:02.857292 15116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "e3b3ed0ba3424054aad29935df4db906"
format_stamp: "Formatted at 2026-08-09 09:23:02 on dist-test-slave-pgkr"
server_key: "3f738cde5f24e57f0eda9c1852a30e1f"
server_key_iv: "b32179ced34efa8b397cc5edba6d00e2"
server_key_version: "encryptionkey@0"
I20260809 09:23:02.860690 15116 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:23:02.862936 15132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:02.864084 15116 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 09:23:02.864274 15116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "e3b3ed0ba3424054aad29935df4db906"
format_stamp: "Formatted at 2026-08-09 09:23:02 on dist-test-slave-pgkr"
server_key: "3f738cde5f24e57f0eda9c1852a30e1f"
server_key_iv: "b32179ced34efa8b397cc5edba6d00e2"
server_key_version: "encryptionkey@0"
I20260809 09:23:02.864389 15116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:02.881979 15116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:02.884610 15116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:02.884795 15116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:02.891433 15116 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:35085
I20260809 09:23:02.891700 15193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:35085 every 8 connection(s)
I20260809 09:23:02.892328 15116 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:23:02.894857 15194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:02.896795 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 15116
I20260809 09:23:02.896924 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:23:02.897190 11663 external_mini_cluster.cc:1428] Setting key 1559a6f4750ecf5524f0b63278892435
I20260809 09:23:02.901302 15194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3b3ed0ba3424054aad29935df4db906: Bootstrap starting.
I20260809 09:23:02.903671 15194 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e3b3ed0ba3424054aad29935df4db906: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:02.904455 15194 log.cc:824] T 00000000000000000000000000000000 P e3b3ed0ba3424054aad29935df4db906: Log is configured to *not* fsync() on all Append() calls
Aug 09 09:23:02 dist-test-slave-pgkr krb5kdc[15102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:23:02.906504 15194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3b3ed0ba3424054aad29935df4db906: No bootstrap required, opened a new log
I20260809 09:23:02.909298 15194 raft_consensus.cc:348] T 00000000000000000000000000000000 P e3b3ed0ba3424054aad29935df4db906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3b3ed0ba3424054aad29935df4db906" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35085 } }
I20260809 09:23:02.909545 15194 raft_consensus.cc:374] T 00000000000000000000000000000000 P e3b3ed0ba3424054aad29935df4db906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:02.909616 15194 raft_consensus.cc:729] T 00000000000000000000000000000000 P e3b3ed0ba3424054aad29935df4db906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b3ed0ba3424054aad29935df4db906, State: Initialized, Role: FOLLOWER
I20260809 09:23:02.910066 15194 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3b3ed0ba3424054aad29935df4db906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3b3ed0ba3424054aad29935df4db906" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35085 } }
I20260809 09:23:02.910193 15194 raft_consensus.cc:388] T 00000000000000000000000000000000 P e3b3ed0ba3424054aad29935df4db906 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:23:02.910295 15194 raft_consensus.cc:482] T 00000000000000000000000000000000 P e3b3ed0ba3424054aad29935df4db906 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:23:02.910398 15194 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e3b3ed0ba3424054aad29935df4db906 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:02.911384 15194 raft_consensus.cc:504] T 00000000000000000000000000000000 P e3b3ed0ba3424054aad29935df4db906 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3b3ed0ba3424054aad29935df4db906" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35085 } }
I20260809 09:23:02.911713 15194 leader_election.cc:302] T 00000000000000000000000000000000 P e3b3ed0ba3424054aad29935df4db906 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e3b3ed0ba3424054aad29935df4db906; no voters:
I20260809 09:23:02.911914 15197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:02.898421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56086 (local address 127.11.99.254:35085)
0809 09:23:02.898821 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:02.898838 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:02.898877 (+ 39us) server_negotiation.cc:407] Connection header received
0809 09:23:02.899591 (+ 714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:02.899612 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:02.899992 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:02.900352 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:02.900930 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:02.902215 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:02.903234 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:02.903916 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:02.904060 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:02.906862 (+ 2802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:02.906867 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:02.906877 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:02.906901 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:02.908896 (+ 1995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:02.909429 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:02.909433 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:02.909437 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:02.909560 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:02.909896 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:02.909899 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:02.909900 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:02.910365 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:02.910572 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:02.910856 (+ 284us) server_negotiation.cc:299] Negotiation successful
0809 09:23:02.911122 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":145,"threads_started":1}
I20260809 09:23:02.912009 15194 leader_election.cc:288] T 00000000000000000000000000000000 P e3b3ed0ba3424054aad29935df4db906 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:23:02.912077 15199 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e3b3ed0ba3424054aad29935df4db906 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:23:02.912322 15199 raft_consensus.cc:686] T 00000000000000000000000000000000 P e3b3ed0ba3424054aad29935df4db906 [term 1 LEADER]: Becoming Leader. State: Replica: e3b3ed0ba3424054aad29935df4db906, State: Running, Role: LEADER
I20260809 09:23:02.912595 15199 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3b3ed0ba3424054aad29935df4db906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3b3ed0ba3424054aad29935df4db906" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35085 } }
I20260809 09:23:02.913264 15194 sys_catalog.cc:564] T 00000000000000000000000000000000 P e3b3ed0ba3424054aad29935df4db906 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:23:02.915062 15201 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3b3ed0ba3424054aad29935df4db906 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3b3ed0ba3424054aad29935df4db906. Latest consensus state: current_term: 1 leader_uuid: "e3b3ed0ba3424054aad29935df4db906" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3b3ed0ba3424054aad29935df4db906" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35085 } } }
I20260809 09:23:02.915196 15201 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3b3ed0ba3424054aad29935df4db906 [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:02.915329 15202 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3b3ed0ba3424054aad29935df4db906 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e3b3ed0ba3424054aad29935df4db906" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3b3ed0ba3424054aad29935df4db906" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35085 } } }
I20260809 09:23:02.915782 15202 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3b3ed0ba3424054aad29935df4db906 [sys.catalog]: This master's current role is: LEADER
W20260809 09:23:02.917539 15216 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e3b3ed0ba3424054aad29935df4db906: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 09:23:02.917603 15216 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 09:23:02.917672 15215 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:23:02.918295 15215 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:23:02.923172 15215 catalog_manager.cc:1347] Generated new cluster ID: faa7bda7daf34042a19c46d5f9551029
I20260809 09:23:02.923246 15215 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:23:02.952344 15215 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:23:02.953480 15215 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:23:02.960729 15215 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e3b3ed0ba3424054aad29935df4db906: Generated new TSK 0
I20260809 09:23:02.961311 15215 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.99.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
I20260809 09:23:02.991585 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:0
--local_ip_for_outbound_sockets=127.11.99.193
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:35085
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:35265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:03.097395 15221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:03.097612 15221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:03.097647 15221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:03.101486 15221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:03.101537 15221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:03.101588 15221 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:23:03.106264 15221 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:35265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:35085
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15221
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:03.107151 15221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:03.108011 15221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:03.117285 15229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:03.117313 15228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:03.117403 15221 server_base.cc:1034] running on GCE node
W20260809 09:23:03.117296 15231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:03.117969 15221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:03.118532 15221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:03.119681 15221 hybrid_clock.cc:648] HybridClock initialized: now 1786267383119669 us; error 25 us; skew 500 ppm
Aug 09 09:23:03 dist-test-slave-pgkr krb5kdc[15102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267383, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:03.122305 15221 init.cc:377] Logged in from keytab as kudu/127.11.99.193@KRBTEST.COM (short username kudu)
I20260809 09:23:03.123145 15221 webserver.cc:460] Webserver started at http://127.11.99.193:34451/ using document root <none> and password file <none>
I20260809 09:23:03.123687 15221 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:03.123751 15221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:03.123986 15221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:03.125857 15221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/data/instance:
uuid: "2fe223c1d44c4553bac76f29d280b089"
format_stamp: "Formatted at 2026-08-09 09:23:03 on dist-test-slave-pgkr"
server_key: "7cb14a9432e3084c4cd50d9c34e904c1"
server_key_iv: "5560f42c0cecace8f845de47391d5ebf"
server_key_version: "encryptionkey@0"
I20260809 09:23:03.126441 15221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance:
uuid: "2fe223c1d44c4553bac76f29d280b089"
format_stamp: "Formatted at 2026-08-09 09:23:03 on dist-test-slave-pgkr"
server_key: "7cb14a9432e3084c4cd50d9c34e904c1"
server_key_iv: "5560f42c0cecace8f845de47391d5ebf"
server_key_version: "encryptionkey@0"
I20260809 09:23:03.130010 15221 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 09:23:03.132190 15240 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:03.133325 15221 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260809 09:23:03.133450 15221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "2fe223c1d44c4553bac76f29d280b089"
format_stamp: "Formatted at 2026-08-09 09:23:03 on dist-test-slave-pgkr"
server_key: "7cb14a9432e3084c4cd50d9c34e904c1"
server_key_iv: "5560f42c0cecace8f845de47391d5ebf"
server_key_version: "encryptionkey@0"
I20260809 09:23:03.133549 15221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:03.142958 15221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:03.145875 15221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:03.146049 15221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:03.146553 15221 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:03.147284 15221 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:03.147367 15221 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:03.147451 15221 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:03.147516 15221 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:03.156015 15221 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:33823
I20260809 09:23:03.156042 15365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:33823 every 8 connection(s)
I20260809 09:23:03.156793 15221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:23:03.156985 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 15221
I20260809 09:23:03.157090 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance
I20260809 09:23:03.157416 11663 external_mini_cluster.cc:1428] Setting key 569b60be18c9226666ff27b61ec32eeb
Aug 09 09:23:03 dist-test-slave-pgkr krb5kdc[15102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267383, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.99.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.194@KRBTEST.COM" created.
I20260809 09:23:03.170943 15197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:03.158397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:59235 (local address 127.11.99.254:35085)
0809 09:23:03.158513 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:03.158517 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:03.159547 (+ 1030us) server_negotiation.cc:407] Connection header received
0809 09:23:03.161061 (+ 1514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:03.161063 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:03.161106 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:03.161176 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:03.162585 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:03.163498 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:03.164652 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:03.165075 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:03.165223 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:03.167549 (+ 2326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:03.167552 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:03.167555 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:03.167585 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:03.168945 (+ 1360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:03.169371 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:03.169373 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:03.169374 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:03.169447 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:03.169860 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:03.169862 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:03.169864 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:03.170052 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:03.170128 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:03.170718 (+ 590us) server_negotiation.cc:299] Negotiation successful
0809 09:23:03.170821 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 09:23:03.172137 15369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:03.158902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:35085 (local address 127.11.99.193:59235)
0809 09:23:03.159363 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:03.159418 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:03.160799 (+ 1381us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:03.161351 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:03.161360 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:03.161886 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:03.162444 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:03.162458 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:03.163694 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:03.163697 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:03.164531 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:03.164540 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:03.165217 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:03.165219 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:03.165376 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:03.165940 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:03.165956 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:03.167391 (+ 1435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:03.169030 (+ 1639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:03.169034 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:03.169043 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:03.169288 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:03.169504 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:03.169506 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:03.169507 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:03.169773 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:03.170170 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:03.170179 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:03.170440 (+ 261us) client_negotiation.cc:769] Sending connection context
0809 09:23:03.170674 (+ 234us) client_negotiation.cc:240] Negotiation successful
0809 09:23:03.171042 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":135,"threads_started":1}
I20260809 09:23:03.173377 15367 heartbeater.cc:347] Connected to a master server at 127.11.99.254:35085
I20260809 09:23:03.173630 15367 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:03.174191 15367 heartbeater.cc:511] Master 127.11.99.254:35085 requested a full tablet report, sending...
I20260809 09:23:03.175782 15153 ts_manager.cc:194] Registered new tserver with Master: 2fe223c1d44c4553bac76f29d280b089 (127.11.99.193:33823)
I20260809 09:23:03.176865 15153 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.193@KRBTEST.COM'} at 127.11.99.193:59235
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
I20260809 09:23:03.185711 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:0
--local_ip_for_outbound_sockets=127.11.99.194
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:35085
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:35265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:03.296705 15373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:03.296914 15373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:03.296972 15373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:03.300982 15373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:03.301030 15373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:03.301080 15373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:23:03.305625 15373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:35265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:35085
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15373
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:03.306474 15373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:03.307399 15373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:03.316442 15384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:03.316418 15380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:03.316497 15373 server_base.cc:1034] running on GCE node
W20260809 09:23:03.316450 15381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:03.317071 15373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:03.317574 15373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:03.318746 15373 hybrid_clock.cc:648] HybridClock initialized: now 1786267383318728 us; error 35 us; skew 500 ppm
Aug 09 09:23:03 dist-test-slave-pgkr krb5kdc[15102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267383, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:03.321311 15373 init.cc:377] Logged in from keytab as kudu/127.11.99.194@KRBTEST.COM (short username kudu)
I20260809 09:23:03.322144 15373 webserver.cc:460] Webserver started at http://127.11.99.194:34943/ using document root <none> and password file <none>
I20260809 09:23:03.322682 15373 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:03.322751 15373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:03.322919 15373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:03.324746 15373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/data/instance:
uuid: "64a6b4d36d32486987f2f58e113398d3"
format_stamp: "Formatted at 2026-08-09 09:23:03 on dist-test-slave-pgkr"
server_key: "415ed5d1b5003c305fc3082a7c848787"
server_key_iv: "4a1970f495d4e3dbf168b26c00f317f8"
server_key_version: "encryptionkey@0"
I20260809 09:23:03.325227 15373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance:
uuid: "64a6b4d36d32486987f2f58e113398d3"
format_stamp: "Formatted at 2026-08-09 09:23:03 on dist-test-slave-pgkr"
server_key: "415ed5d1b5003c305fc3082a7c848787"
server_key_iv: "4a1970f495d4e3dbf168b26c00f317f8"
server_key_version: "encryptionkey@0"
I20260809 09:23:03.328677 15373 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:23:03.330777 15393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:03.331866 15373 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:23:03.331962 15373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "64a6b4d36d32486987f2f58e113398d3"
format_stamp: "Formatted at 2026-08-09 09:23:03 on dist-test-slave-pgkr"
server_key: "415ed5d1b5003c305fc3082a7c848787"
server_key_iv: "4a1970f495d4e3dbf168b26c00f317f8"
server_key_version: "encryptionkey@0"
I20260809 09:23:03.332036 15373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:03.347304 15373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:03.349737 15373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:03.349875 15373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:03.350337 15373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:03.351135 15373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:03.351181 15373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:03.351218 15373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:03.351243 15373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:03.359944 15373 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:40131
I20260809 09:23:03.359972 15520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:40131 every 8 connection(s)
I20260809 09:23:03.360679 15373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:23:03.366247 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 15373
I20260809 09:23:03.366357 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance
I20260809 09:23:03.366662 11663 external_mini_cluster.cc:1428] Setting key 6b74fffb9f2a161a75e9220056aeadad
Aug 09 09:23:03 dist-test-slave-pgkr krb5kdc[15102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267383, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:23:03.374782 15197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:03.362302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:56877 (local address 127.11.99.254:35085)
0809 09:23:03.362447 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:03.362451 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:03.363303 (+ 852us) server_negotiation.cc:407] Connection header received
0809 09:23:03.364576 (+ 1273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:03.364579 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:03.364635 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:03.364703 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:03.365755 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:03.366383 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:03.367666 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:03.367956 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:03.368061 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:03.370832 (+ 2771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:03.370836 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:03.370838 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:03.370880 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:03.372610 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:03.373133 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:03.373141 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:03.373145 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:03.373254 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:03.373591 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:03.373595 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:03.373597 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:03.373825 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:03.373935 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:03.374351 (+ 416us) server_negotiation.cc:299] Negotiation successful
0809 09:23:03.374512 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 09:23:03.375221 15525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:03.362724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:35085 (local address 127.11.99.194:56877)
0809 09:23:03.363155 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:03.363195 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:03.364383 (+ 1188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:03.364841 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:03.364846 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:03.365187 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:03.365602 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:03.365614 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:03.366505 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:03.366508 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:03.367540 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:03.367549 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:03.368110 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:03.368114 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:03.368289 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:03.368805 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:03.368828 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:03.370640 (+ 1812us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:03.372746 (+ 2106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:03.372750 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:03.372773 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:03.373006 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:03.373360 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:03.373362 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:03.373363 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:03.373490 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:03.373922 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:03.373925 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:03.374103 (+ 178us) client_negotiation.cc:769] Sending connection context
0809 09:23:03.374249 (+ 146us) client_negotiation.cc:240] Negotiation successful
0809 09:23:03.374451 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":104,"threads_started":1}
I20260809 09:23:03.376245 15522 heartbeater.cc:347] Connected to a master server at 127.11.99.254:35085
I20260809 09:23:03.376471 15522 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:03.377055 15522 heartbeater.cc:511] Master 127.11.99.254:35085 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.99.195@KRBTEST.COM; defaulting to no policy
I20260809 09:23:03.378123 15153 ts_manager.cc:194] Registered new tserver with Master: 64a6b4d36d32486987f2f58e113398d3 (127.11.99.194:40131)
I20260809 09:23:03.378762 15153 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.194@KRBTEST.COM'} at 127.11.99.194:56877
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
I20260809 09:23:03.393513 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:0
--local_ip_for_outbound_sockets=127.11.99.195
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:35085
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:35265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:03.496603 15528 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:03.496824 15528 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:03.496897 15528 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:03.500716 15528 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:03.500769 15528 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:03.500876 15528 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:23:03.505576 15528 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:35265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:35085
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15528
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:03.506783 15528 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:03.507740 15528 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:03.516927 15534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:03.516935 15533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:03.516947 15536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:03.517278 15528 server_base.cc:1034] running on GCE node
I20260809 09:23:03.517591 15528 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:03.518136 15528 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:03.519323 15528 hybrid_clock.cc:648] HybridClock initialized: now 1786267383519307 us; error 27 us; skew 500 ppm
Aug 09 09:23:03 dist-test-slave-pgkr krb5kdc[15102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267383, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:03.521787 15528 init.cc:377] Logged in from keytab as kudu/127.11.99.195@KRBTEST.COM (short username kudu)
I20260809 09:23:03.522558 15528 webserver.cc:460] Webserver started at http://127.11.99.195:43363/ using document root <none> and password file <none>
I20260809 09:23:03.523115 15528 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:03.523196 15528 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:03.523411 15528 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:03.525228 15528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/data/instance:
uuid: "24fb63a40ace4bec9c762807bdef2778"
format_stamp: "Formatted at 2026-08-09 09:23:03 on dist-test-slave-pgkr"
server_key: "fee4951df39aa5ea47ae1af43500a7de"
server_key_iv: "c2ceb3c6228c2372734c276244dcc1e6"
server_key_version: "encryptionkey@0"
I20260809 09:23:03.525722 15528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance:
uuid: "24fb63a40ace4bec9c762807bdef2778"
format_stamp: "Formatted at 2026-08-09 09:23:03 on dist-test-slave-pgkr"
server_key: "fee4951df39aa5ea47ae1af43500a7de"
server_key_iv: "c2ceb3c6228c2372734c276244dcc1e6"
server_key_version: "encryptionkey@0"
I20260809 09:23:03.529103 15528 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 09:23:03.531198 15543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:03.532266 15528 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 09:23:03.532374 15528 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "24fb63a40ace4bec9c762807bdef2778"
format_stamp: "Formatted at 2026-08-09 09:23:03 on dist-test-slave-pgkr"
server_key: "fee4951df39aa5ea47ae1af43500a7de"
server_key_iv: "c2ceb3c6228c2372734c276244dcc1e6"
server_key_version: "encryptionkey@0"
I20260809 09:23:03.532464 15528 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:03.542291 15528 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:03.544692 15528 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:03.544857 15528 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:03.545334 15528 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:03.546030 15528 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:03.546073 15528 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:03.546128 15528 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:03.546159 15528 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:03.554504 15528 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:36197
I20260809 09:23:03.554527 15671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:36197 every 8 connection(s)
I20260809 09:23:03.555390 15528 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:23:03.558422 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 15528
I20260809 09:23:03.558539 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance
I20260809 09:23:03.558806 11663 external_mini_cluster.cc:1428] Setting key d4cebf37d9b08fc06d8430de1f2a8df4
Aug 09 09:23:03 dist-test-slave-pgkr krb5kdc[15102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267383, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:23:03.567672 15197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:03.557114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:43463 (local address 127.11.99.254:35085)
0809 09:23:03.557251 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:03.557255 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:03.557944 (+ 689us) server_negotiation.cc:407] Connection header received
0809 09:23:03.559368 (+ 1424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:03.559371 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:03.559430 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:03.559539 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:03.560540 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:03.561016 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:03.562014 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:03.562231 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:03.562333 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:03.564468 (+ 2135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:03.564471 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:03.564473 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:03.564500 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:03.565725 (+ 1225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:03.566202 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:03.566205 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:03.566207 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:03.566282 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:03.566601 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:03.566606 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:03.566607 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:03.566842 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:03.566940 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:03.567384 (+ 444us) server_negotiation.cc:299] Negotiation successful
0809 09:23:03.567499 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 09:23:03.568290 15675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:03.557414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:35085 (local address 127.11.99.195:43463)
0809 09:23:03.557811 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:03.557847 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:03.559152 (+ 1305us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:03.559690 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:03.559696 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:03.560020 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:03.560407 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:03.560418 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:03.561125 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:03.561133 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:03.561895 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:03.561903 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:03.562364 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:03.562368 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:03.562525 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:03.563045 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:03.563059 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:03.564325 (+ 1266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:03.565831 (+ 1506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:03.565836 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:03.565848 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:03.566102 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:03.566369 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:03.566373 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:03.566375 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:03.566509 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:03.566949 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:03.566958 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:03.567167 (+ 209us) client_negotiation.cc:769] Sending connection context
0809 09:23:03.567330 (+ 163us) client_negotiation.cc:240] Negotiation successful
0809 09:23:03.567602 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":106,"threads_started":1}
I20260809 09:23:03.569257 15673 heartbeater.cc:347] Connected to a master server at 127.11.99.254:35085
I20260809 09:23:03.569487 15673 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:03.570078 15673 heartbeater.cc:511] Master 127.11.99.254:35085 requested a full tablet report, sending...
I20260809 09:23:03.571233 15153 ts_manager.cc:194] Registered new tserver with Master: 24fb63a40ace4bec9c762807bdef2778 (127.11.99.195:36197)
I20260809 09:23:03.571964 15153 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.195@KRBTEST.COM'} at 127.11.99.195:43463
I20260809 09:23:03.572369 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 09:23:03 dist-test-slave-pgkr krb5kdc[15102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267383, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 09 09:23:03 dist-test-slave-pgkr krb5kdc[15102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267383, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:23:03.596885 15197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:03.589405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56090 (local address 127.11.99.254:35085)
0809 09:23:03.589520 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:03.589536 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:03.589607 (+ 71us) server_negotiation.cc:407] Connection header received
0809 09:23:03.589708 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:03.589710 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:03.589747 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:03.589815 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:03.590457 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:03.590994 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:03.591797 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:03.591987 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:03.592056 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:03.594261 (+ 2205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:03.594263 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:03.594265 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:03.594286 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:03.595626 (+ 1340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:03.595973 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:03.595975 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:03.595976 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:03.596045 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:03.596251 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:03.596253 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:03.596254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:03.596443 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:03.596554 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:03.596693 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 09:23:03.596775 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260809 09:23:03.597322 15153 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:56090
I20260809 09:23:03.598218 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 15221
I20260809 09:23:03.606812 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 15373
I20260809 09:23:03.613695 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 15528
I20260809 09:23:03.620958 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 15116
2026-08-09T09:23:03Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2044 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:23:03 dist-test-slave-pgkr krb5kdc[15689](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:23:03 dist-test-slave-pgkr krb5kdc[15689](info): set up 2 sockets
Aug 09 09:23:03 dist-test-slave-pgkr krb5kdc[15689](info): commencing operation
krb5kdc: starting...
W20260809 09:23:04.649945 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.007s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:23:04 dist-test-slave-pgkr krb5kdc[15689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:23:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:23:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:23:04.761268 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:43517
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:41677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:43517
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:04.863878 15705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:04.864137 15705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:04.864203 15705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:04.868016 15705 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:23:04.868098 15705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:04.868135 15705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:04.868185 15705 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:23:04.868248 15705 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:23:04.873178 15705 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:41677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:43517
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:43517
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15705
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:04.874086 15705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:04.875069 15705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:04.882807 15716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:04.882797 15714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:04.882797 15711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:04.883015 15705 server_base.cc:1034] running on GCE node
I20260809 09:23:04.883651 15705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:04.884609 15705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:04.885794 15705 hybrid_clock.cc:648] HybridClock initialized: now 1786267384885768 us; error 37 us; skew 500 ppm
Aug 09 09:23:04 dist-test-slave-pgkr krb5kdc[15689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267384, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:04.888404 15705 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:23:04.889192 15705 webserver.cc:460] Webserver started at http://127.11.99.254:36589/ using document root <none> and password file <none>
I20260809 09:23:04.889696 15705 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:04.889782 15705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:04.890007 15705 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:04.891968 15705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "d387c67def72458fa7c4ea23d9ae94ba"
format_stamp: "Formatted at 2026-08-09 09:23:04 on dist-test-slave-pgkr"
server_key: "0c1b12b42dcd3f6798c8d9286b39926d"
server_key_iv: "bc692e724b9f9b39c4ec9d0b590b8cd9"
server_key_version: "encryptionkey@0"
I20260809 09:23:04.892606 15705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "d387c67def72458fa7c4ea23d9ae94ba"
format_stamp: "Formatted at 2026-08-09 09:23:04 on dist-test-slave-pgkr"
server_key: "0c1b12b42dcd3f6798c8d9286b39926d"
server_key_iv: "bc692e724b9f9b39c4ec9d0b590b8cd9"
server_key_version: "encryptionkey@0"
I20260809 09:23:04.896202 15705 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:23:04.898420 15723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:04.899560 15705 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:23:04.899704 15705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "d387c67def72458fa7c4ea23d9ae94ba"
format_stamp: "Formatted at 2026-08-09 09:23:04 on dist-test-slave-pgkr"
server_key: "0c1b12b42dcd3f6798c8d9286b39926d"
server_key_iv: "bc692e724b9f9b39c4ec9d0b590b8cd9"
server_key_version: "encryptionkey@0"
I20260809 09:23:04.899808 15705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:04.917064 15705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:04.919691 15705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:04.919888 15705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:04.926878 15705 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:43517
I20260809 09:23:04.926906 15784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:43517 every 8 connection(s)
I20260809 09:23:04.927719 15705 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:23:04.930249 15785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:04.935298 15785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d387c67def72458fa7c4ea23d9ae94ba: Bootstrap starting.
I20260809 09:23:04.936611 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 15705
I20260809 09:23:04.936704 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:23:04.936956 11663 external_mini_cluster.cc:1428] Setting key 2631389e07e7154db2e2f3024113b847
I20260809 09:23:04.937682 15785 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d387c67def72458fa7c4ea23d9ae94ba: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:04.938467 15785 log.cc:824] T 00000000000000000000000000000000 P d387c67def72458fa7c4ea23d9ae94ba: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:04.940537 15785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d387c67def72458fa7c4ea23d9ae94ba: No bootstrap required, opened a new log
I20260809 09:23:04.944551 15785 raft_consensus.cc:348] T 00000000000000000000000000000000 P d387c67def72458fa7c4ea23d9ae94ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d387c67def72458fa7c4ea23d9ae94ba" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 43517 } }
I20260809 09:23:04.944746 15785 raft_consensus.cc:374] T 00000000000000000000000000000000 P d387c67def72458fa7c4ea23d9ae94ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:04.944809 15785 raft_consensus.cc:729] T 00000000000000000000000000000000 P d387c67def72458fa7c4ea23d9ae94ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d387c67def72458fa7c4ea23d9ae94ba, State: Initialized, Role: FOLLOWER
I20260809 09:23:04.945247 15785 consensus_queue.cc:260] T 00000000000000000000000000000000 P d387c67def72458fa7c4ea23d9ae94ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d387c67def72458fa7c4ea23d9ae94ba" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 43517 } }
I20260809 09:23:04.945398 15785 raft_consensus.cc:388] T 00000000000000000000000000000000 P d387c67def72458fa7c4ea23d9ae94ba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:23:04.945475 15785 raft_consensus.cc:482] T 00000000000000000000000000000000 P d387c67def72458fa7c4ea23d9ae94ba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:23:04.945585 15785 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d387c67def72458fa7c4ea23d9ae94ba [term 0 FOLLOWER]: Advancing to term 1
Aug 09 09:23:04 dist-test-slave-pgkr krb5kdc[15689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:23:04.946539 15785 raft_consensus.cc:504] T 00000000000000000000000000000000 P d387c67def72458fa7c4ea23d9ae94ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d387c67def72458fa7c4ea23d9ae94ba" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 43517 } }
I20260809 09:23:04.946925 15785 leader_election.cc:302] T 00000000000000000000000000000000 P d387c67def72458fa7c4ea23d9ae94ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d387c67def72458fa7c4ea23d9ae94ba; no voters:
I20260809 09:23:04.947294 15785 leader_election.cc:288] T 00000000000000000000000000000000 P d387c67def72458fa7c4ea23d9ae94ba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:23:04.947381 15792 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d387c67def72458fa7c4ea23d9ae94ba [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:23:04.947657 15792 raft_consensus.cc:686] T 00000000000000000000000000000000 P d387c67def72458fa7c4ea23d9ae94ba [term 1 LEADER]: Becoming Leader. State: Replica: d387c67def72458fa7c4ea23d9ae94ba, State: Running, Role: LEADER
I20260809 09:23:04.947971 15792 consensus_queue.cc:237] T 00000000000000000000000000000000 P d387c67def72458fa7c4ea23d9ae94ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d387c67def72458fa7c4ea23d9ae94ba" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 43517 } }
I20260809 09:23:04.948567 15785 sys_catalog.cc:564] T 00000000000000000000000000000000 P d387c67def72458fa7c4ea23d9ae94ba [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:23:04.949117 15792 sys_catalog.cc:455] T 00000000000000000000000000000000 P d387c67def72458fa7c4ea23d9ae94ba [sys.catalog]: SysCatalogTable state changed. Reason: New leader d387c67def72458fa7c4ea23d9ae94ba. Latest consensus state: current_term: 1 leader_uuid: "d387c67def72458fa7c4ea23d9ae94ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d387c67def72458fa7c4ea23d9ae94ba" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 43517 } } }
I20260809 09:23:04.949225 15792 sys_catalog.cc:458] T 00000000000000000000000000000000 P d387c67def72458fa7c4ea23d9ae94ba [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:04.949501 15793 sys_catalog.cc:455] T 00000000000000000000000000000000 P d387c67def72458fa7c4ea23d9ae94ba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d387c67def72458fa7c4ea23d9ae94ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d387c67def72458fa7c4ea23d9ae94ba" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 43517 } } }
I20260809 09:23:04.949651 15793 sys_catalog.cc:458] T 00000000000000000000000000000000 P d387c67def72458fa7c4ea23d9ae94ba [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:04.951889 15790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:04.937926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51408 (local address 127.11.99.254:43517)
0809 09:23:04.938333 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:04.938353 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:04.938392 (+ 39us) server_negotiation.cc:407] Connection header received
0809 09:23:04.939097 (+ 705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:04.939114 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:04.939491 (+ 377us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:04.939824 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:04.940451 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:04.941879 (+ 1428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:04.942770 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:04.943515 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:04.943692 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:04.946271 (+ 2579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:04.946277 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:04.946292 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:04.946322 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:04.948304 (+ 1982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:04.948800 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:04.948805 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:04.948810 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:04.948949 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:04.949382 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:04.949386 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:04.949389 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:04.949960 (+ 571us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:04.950183 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:04.950785 (+ 602us) server_negotiation.cc:299] Negotiation successful
0809 09:23:04.951089 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":115,"threads_started":1}
W20260809 09:23:04.953464 15809 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d387c67def72458fa7c4ea23d9ae94ba: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 09:23:04.953542 15809 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 09:23:04.953603 15799 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:23:04.954421 15799 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:23:04.959731 15799 catalog_manager.cc:1347] Generated new cluster ID: dc86196cdb354a228cd53802cdfdccbd
I20260809 09:23:04.959794 15799 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:23:04.970846 15799 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:23:04.972004 15799 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:23:04.980974 15799 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d387c67def72458fa7c4ea23d9ae94ba: Generated new TSK 0
I20260809 09:23:04.981546 15799 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.99.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
I20260809 09:23:05.015870 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:0
--local_ip_for_outbound_sockets=127.11.99.193
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:43517
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:41677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:05.120183 15815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:05.120409 15815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:05.120471 15815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:05.124223 15815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:05.124272 15815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:05.124370 15815 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:23:05.129355 15815 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:41677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:43517
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15815
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:05.130344 15815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:05.131342 15815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:05.140344 15821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:05.140450 15824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:05.140461 15822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:05.140753 15815 server_base.cc:1034] running on GCE node
I20260809 09:23:05.141125 15815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:05.141758 15815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:05.142908 15815 hybrid_clock.cc:648] HybridClock initialized: now 1786267385142884 us; error 33 us; skew 500 ppm
Aug 09 09:23:05 dist-test-slave-pgkr krb5kdc[15689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267385, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:05.145468 15815 init.cc:377] Logged in from keytab as kudu/127.11.99.193@KRBTEST.COM (short username kudu)
I20260809 09:23:05.146322 15815 webserver.cc:460] Webserver started at http://127.11.99.193:34423/ using document root <none> and password file <none>
I20260809 09:23:05.146898 15815 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:05.146956 15815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:05.147115 15815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:05.149102 15815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-0/data/instance:
uuid: "04a063c6cae74d8787210451b786f5ad"
format_stamp: "Formatted at 2026-08-09 09:23:05 on dist-test-slave-pgkr"
server_key: "2055a2a2faa6e47f46d8fd0c2625cf0a"
server_key_iv: "f9cc7f64adaae6cdac241fa674a58177"
server_key_version: "encryptionkey@0"
I20260809 09:23:05.149686 15815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance:
uuid: "04a063c6cae74d8787210451b786f5ad"
format_stamp: "Formatted at 2026-08-09 09:23:05 on dist-test-slave-pgkr"
server_key: "2055a2a2faa6e47f46d8fd0c2625cf0a"
server_key_iv: "f9cc7f64adaae6cdac241fa674a58177"
server_key_version: "encryptionkey@0"
I20260809 09:23:05.153555 15815 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 09:23:05.155850 15831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:05.156904 15815 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 09:23:05.157039 15815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "04a063c6cae74d8787210451b786f5ad"
format_stamp: "Formatted at 2026-08-09 09:23:05 on dist-test-slave-pgkr"
server_key: "2055a2a2faa6e47f46d8fd0c2625cf0a"
server_key_iv: "f9cc7f64adaae6cdac241fa674a58177"
server_key_version: "encryptionkey@0"
I20260809 09:23:05.157152 15815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:05.172590 15815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:05.175094 15815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:05.175279 15815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:05.175784 15815 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:05.176508 15815 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:05.176571 15815 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:05.176637 15815 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:05.176672 15815 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:05.184715 15815 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:39029
I20260809 09:23:05.184760 15968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:39029 every 8 connection(s)
I20260809 09:23:05.185518 15815 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:23:05.191921 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 15815
I20260809 09:23:05.192039 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance
I20260809 09:23:05.192337 11663 external_mini_cluster.cc:1428] Setting key 0a7f8888d08cce556cf2d7260c0fe520
Aug 09 09:23:05 dist-test-slave-pgkr krb5kdc[15689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267385, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:23:05.198899 15790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:05.187059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:47607 (local address 127.11.99.254:43517)
0809 09:23:05.187180 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:05.187183 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:05.187937 (+ 754us) server_negotiation.cc:407] Connection header received
0809 09:23:05.189077 (+ 1140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:05.189080 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:05.189123 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:05.189192 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:05.190263 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:05.190872 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:05.192157 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:05.192440 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:05.192557 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:05.194998 (+ 2441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:05.195001 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:05.195004 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:05.195035 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:05.196683 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:05.197261 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:05.197267 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:05.197272 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:05.197359 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:05.197682 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:05.197688 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:05.197693 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:05.197949 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:05.198091 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:05.198524 (+ 433us) server_negotiation.cc:299] Negotiation successful
0809 09:23:05.198720 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 09:23:05.199604 15971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:05.187365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:43517 (local address 127.11.99.193:47607)
0809 09:23:05.187789 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:05.187839 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:05.188912 (+ 1073us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:05.189358 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:05.189363 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:05.189704 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:05.190144 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:05.190155 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:05.190981 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:05.190983 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:05.192046 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:05.192055 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:05.192596 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:05.192600 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:05.192791 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:05.193348 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:05.193362 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:05.194835 (+ 1473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:05.196801 (+ 1966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:05.196806 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:05.196819 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:05.197151 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:05.197446 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:05.197448 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:05.197449 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:05.197592 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:05.198082 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:05.198086 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:05.198294 (+ 208us) client_negotiation.cc:769] Sending connection context
0809 09:23:05.198444 (+ 150us) client_negotiation.cc:240] Negotiation successful
0809 09:23:05.198747 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":122,"threads_started":1}
I20260809 09:23:05.200759 15969 heartbeater.cc:347] Connected to a master server at 127.11.99.254:43517
I20260809 09:23:05.200969 15969 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:05.201386 15969 heartbeater.cc:511] Master 127.11.99.254:43517 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.99.194@KRBTEST.COM; defaulting to no policy
I20260809 09:23:05.202955 15742 ts_manager.cc:194] Registered new tserver with Master: 04a063c6cae74d8787210451b786f5ad (127.11.99.193:39029)
I20260809 09:23:05.204034 15742 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.193@KRBTEST.COM'} at 127.11.99.193:47607
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
I20260809 09:23:05.217360 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:0
--local_ip_for_outbound_sockets=127.11.99.194
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:43517
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:41677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:05.327199 15974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:05.327435 15974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:05.327476 15974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:05.331365 15974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:05.331416 15974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:05.331508 15974 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:23:05.336367 15974 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:41677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:43517
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15974
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:05.337306 15974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:05.338222 15974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:05.347146 15979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:05.347246 15974 server_base.cc:1034] running on GCE node
W20260809 09:23:05.347448 15980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:05.347199 15982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:05.348327 15974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:05.349115 15974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:05.350266 15974 hybrid_clock.cc:648] HybridClock initialized: now 1786267385350231 us; error 50 us; skew 500 ppm
Aug 09 09:23:05 dist-test-slave-pgkr krb5kdc[15689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267385, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:05.354245 15974 init.cc:377] Logged in from keytab as kudu/127.11.99.194@KRBTEST.COM (short username kudu)
I20260809 09:23:05.355199 15974 webserver.cc:460] Webserver started at http://127.11.99.194:46099/ using document root <none> and password file <none>
I20260809 09:23:05.355885 15974 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:05.355986 15974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:05.356240 15974 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:05.358244 15974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-1/data/instance:
uuid: "2400e913de5747d794211780787db0f3"
format_stamp: "Formatted at 2026-08-09 09:23:05 on dist-test-slave-pgkr"
server_key: "4a7d3e902a567739e8b497abb5d36226"
server_key_iv: "715b43b89d88f6fbafb8a5f2c0f8a519"
server_key_version: "encryptionkey@0"
I20260809 09:23:05.358837 15974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance:
uuid: "2400e913de5747d794211780787db0f3"
format_stamp: "Formatted at 2026-08-09 09:23:05 on dist-test-slave-pgkr"
server_key: "4a7d3e902a567739e8b497abb5d36226"
server_key_iv: "715b43b89d88f6fbafb8a5f2c0f8a519"
server_key_version: "encryptionkey@0"
I20260809 09:23:05.362522 15974 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 09:23:05.364823 15989 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:05.365983 15974 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:23:05.366096 15974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "2400e913de5747d794211780787db0f3"
format_stamp: "Formatted at 2026-08-09 09:23:05 on dist-test-slave-pgkr"
server_key: "4a7d3e902a567739e8b497abb5d36226"
server_key_iv: "715b43b89d88f6fbafb8a5f2c0f8a519"
server_key_version: "encryptionkey@0"
I20260809 09:23:05.366190 15974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:05.376680 15974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:05.379371 15974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:05.379563 15974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:05.380069 15974 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:05.380812 15974 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:05.380856 15974 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:05.380914 15974 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:05.380946 15974 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:05.388993 15974 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:41531
I20260809 09:23:05.389014 16116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:41531 every 8 connection(s)
I20260809 09:23:05.389773 15974 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:23:05.393187 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 15974
I20260809 09:23:05.393321 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance
I20260809 09:23:05.393584 11663 external_mini_cluster.cc:1428] Setting key 605714ba007c5d13c29ebd819ff9480c
Aug 09 09:23:05 dist-test-slave-pgkr krb5kdc[15689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267385, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:23:05.404033 15790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:05.391390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:55103 (local address 127.11.99.254:43517)
0809 09:23:05.391563 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:05.391568 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:05.392316 (+ 748us) server_negotiation.cc:407] Connection header received
0809 09:23:05.393630 (+ 1314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:05.393635 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:05.393695 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:05.393783 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:05.394894 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:05.395400 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:05.397001 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:05.397387 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:05.397489 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:05.400202 (+ 2713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:05.400205 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:05.400206 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:05.400228 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:05.401863 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:05.402386 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:05.402390 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:05.402392 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:05.402480 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:05.402865 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:05.402869 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:05.402871 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:05.403108 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:05.403214 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:05.403683 (+ 469us) server_negotiation.cc:299] Negotiation successful
0809 09:23:05.403819 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
WARNING: no policy specified for kudu/127.11.99.195@KRBTEST.COM; defaulting to no policy
I20260809 09:23:05.404726 16119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:05.391747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:43517 (local address 127.11.99.194:55103)
0809 09:23:05.392138 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:05.392177 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:05.393404 (+ 1227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:05.393937 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:05.393943 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:05.394265 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:05.394766 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:05.394793 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:05.395526 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:05.395532 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:05.396850 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:05.396865 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:05.397525 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:05.397528 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:05.397652 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:05.398206 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:05.398221 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:05.400053 (+ 1832us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:05.401996 (+ 1943us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:05.402000 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:05.402020 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:05.402289 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:05.402594 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:05.402597 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:05.402602 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:05.402763 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:05.403205 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:05.403209 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:05.403423 (+ 214us) client_negotiation.cc:769] Sending connection context
0809 09:23:05.403579 (+ 156us) client_negotiation.cc:240] Negotiation successful
0809 09:23:05.403828 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":97,"threads_started":1}
I20260809 09:23:05.405800 16117 heartbeater.cc:347] Connected to a master server at 127.11.99.254:43517
I20260809 09:23:05.406025 16117 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:05.406490 16117 heartbeater.cc:511] Master 127.11.99.254:43517 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.195@KRBTEST.COM" created.
I20260809 09:23:05.407541 15742 ts_manager.cc:194] Registered new tserver with Master: 2400e913de5747d794211780787db0f3 (127.11.99.194:41531)
I20260809 09:23:05.408103 15742 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.194@KRBTEST.COM'} at 127.11.99.194:55103
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
I20260809 09:23:05.421370 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:0
--local_ip_for_outbound_sockets=127.11.99.195
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:43517
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:41677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:05.526096 16122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:05.526340 16122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:05.526404 16122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:05.530170 16122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:05.530246 16122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:05.530329 16122 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:23:05.535122 16122 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:41677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:43517
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16122
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:05.536029 16122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:05.536960 16122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:05.545953 16129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:05.545941 16128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:05.545998 16131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:05.546139 16122 server_base.cc:1034] running on GCE node
I20260809 09:23:05.546571 16122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:05.547152 16122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:05.548326 16122 hybrid_clock.cc:648] HybridClock initialized: now 1786267385548293 us; error 47 us; skew 500 ppm
Aug 09 09:23:05 dist-test-slave-pgkr krb5kdc[15689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267385, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:05.551191 16122 init.cc:377] Logged in from keytab as kudu/127.11.99.195@KRBTEST.COM (short username kudu)
I20260809 09:23:05.551993 16122 webserver.cc:460] Webserver started at http://127.11.99.195:45741/ using document root <none> and password file <none>
I20260809 09:23:05.552543 16122 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:05.552627 16122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:05.552841 16122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:05.554816 16122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-2/data/instance:
uuid: "3f9a165a137c4ceaacc88a5da9da20a8"
format_stamp: "Formatted at 2026-08-09 09:23:05 on dist-test-slave-pgkr"
server_key: "63014265ab36f79ee110a9622fb9204d"
server_key_iv: "45ef353ae36892414d2acd43f655f14d"
server_key_version: "encryptionkey@0"
I20260809 09:23:05.555349 16122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance:
uuid: "3f9a165a137c4ceaacc88a5da9da20a8"
format_stamp: "Formatted at 2026-08-09 09:23:05 on dist-test-slave-pgkr"
server_key: "63014265ab36f79ee110a9622fb9204d"
server_key_iv: "45ef353ae36892414d2acd43f655f14d"
server_key_version: "encryptionkey@0"
I20260809 09:23:05.558707 16122 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 09:23:05.560983 16138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:05.562108 16122 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:23:05.562228 16122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "3f9a165a137c4ceaacc88a5da9da20a8"
format_stamp: "Formatted at 2026-08-09 09:23:05 on dist-test-slave-pgkr"
server_key: "63014265ab36f79ee110a9622fb9204d"
server_key_iv: "45ef353ae36892414d2acd43f655f14d"
server_key_version: "encryptionkey@0"
I20260809 09:23:05.562326 16122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:05.579399 16122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:05.581863 16122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:05.582041 16122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:05.582562 16122 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:05.583328 16122 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:05.583393 16122 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:05.583460 16122 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:05.583499 16122 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:05.591922 16122 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:46215
I20260809 09:23:05.591952 16273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:46215 every 8 connection(s)
I20260809 09:23:05.592778 16122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:23:05.597071 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 16122
I20260809 09:23:05.597210 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance
I20260809 09:23:05.597544 11663 external_mini_cluster.cc:1428] Setting key 492b684f811cddb4cb3a834805930a67
Aug 09 09:23:05 dist-test-slave-pgkr krb5kdc[15689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267385, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:23:05.606143 15790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:05.594480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:38679 (local address 127.11.99.254:43517)
0809 09:23:05.594675 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:05.594679 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:05.595415 (+ 736us) server_negotiation.cc:407] Connection header received
0809 09:23:05.596661 (+ 1246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:05.596663 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:05.596705 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:05.596772 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:05.598211 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:05.598878 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:05.600157 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:05.600389 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:05.600515 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:05.602876 (+ 2361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:05.602879 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:05.602881 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:05.602906 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:05.604452 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:05.604900 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:05.604903 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:05.604904 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:05.604979 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:05.605243 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:05.605245 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:05.605246 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:05.605435 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:05.605548 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:05.605932 (+ 384us) server_negotiation.cc:299] Negotiation successful
0809 09:23:05.606028 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 09:23:05.606881 16278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:05.594831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:43517 (local address 127.11.99.195:38679)
0809 09:23:05.595269 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:05.595311 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:05.596488 (+ 1177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:05.597014 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:05.597023 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:05.597501 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:05.598060 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:05.598074 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:05.599025 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:05.599028 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:05.600026 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:05.600037 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:05.600539 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:05.600543 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:05.600719 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:05.601298 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:05.601328 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:05.602735 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:05.604568 (+ 1833us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:05.604572 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:05.604581 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:05.604806 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:05.605058 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:05.605060 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:05.605061 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:05.605170 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:05.605549 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:05.605553 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:05.605746 (+ 193us) client_negotiation.cc:769] Sending connection context
0809 09:23:05.605884 (+ 138us) client_negotiation.cc:240] Negotiation successful
0809 09:23:05.606103 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":96,"threads_started":1}
I20260809 09:23:05.607873 16274 heartbeater.cc:347] Connected to a master server at 127.11.99.254:43517
I20260809 09:23:05.608068 16274 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:05.608449 16274 heartbeater.cc:511] Master 127.11.99.254:43517 requested a full tablet report, sending...
I20260809 09:23:05.609323 15742 ts_manager.cc:194] Registered new tserver with Master: 3f9a165a137c4ceaacc88a5da9da20a8 (127.11.99.195:46215)
I20260809 09:23:05.609943 15742 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.195@KRBTEST.COM'} at 127.11.99.195:38679
I20260809 09:23:05.611224 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 09:23:05 dist-test-slave-pgkr krb5kdc[15689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267385, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 09:23:05 dist-test-slave-pgkr krb5kdc[15689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267385, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.193@KRBTEST.COM
I20260809 09:23:05.637341 16283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:05.628237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47568 (local address 127.11.99.193:39029)
0809 09:23:05.628611 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:05.628621 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:05.628643 (+ 22us) server_negotiation.cc:407] Connection header received
0809 09:23:05.628692 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:05.628696 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:05.628888 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:05.629009 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:05.629651 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:05.630381 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:05.631290 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:05.631641 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:05.631754 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:05.633969 (+ 2215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:05.633976 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:05.633987 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:05.634009 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:05.635482 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:05.635914 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:05.635919 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:05.635920 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:05.636000 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:05.636392 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:05.636394 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:05.636396 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:05.636643 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:05.636848 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:05.637011 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 09:23:05.637161 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":145,"threads_started":1}
Aug 09 09:23:05 dist-test-slave-pgkr krb5kdc[15689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267385, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:23:05.647665 15790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:05.640040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46012 (local address 127.11.99.254:43517)
0809 09:23:05.640167 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:05.640174 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:05.640208 (+ 34us) server_negotiation.cc:407] Connection header received
0809 09:23:05.640357 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:05.640359 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:05.640398 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:05.640473 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:05.641043 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:05.641544 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:05.642284 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:05.642492 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:05.642640 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:05.644787 (+ 2147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:05.644790 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:05.644791 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:05.644813 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:05.646174 (+ 1361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:05.646505 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:05.646508 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:05.646509 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:05.646575 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:05.646840 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:05.646842 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:05.646843 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:05.647068 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:05.647169 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:05.647345 (+ 176us) server_negotiation.cc:299] Negotiation successful
0809 09:23:05.647429 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
W20260809 09:23:05.648121 15742 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46012
I20260809 09:23:05.648722 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 15815
I20260809 09:23:05.656515 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 15974
I20260809 09:23:05.663367 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 16122
I20260809 09:23:05.670876 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 15705
2026-08-09T09:23:05Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2049 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:23:05 dist-test-slave-pgkr krb5kdc[16288](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:23:05 dist-test-slave-pgkr krb5kdc[16288](info): set up 2 sockets
Aug 09 09:23:05 dist-test-slave-pgkr krb5kdc[16288](info): commencing operation
krb5kdc: starting...
W20260809 09:23:06.701139 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.008s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:23:06 dist-test-slave-pgkr krb5kdc[16288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267386, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:23:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:23:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:23:06.813182 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:44913
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:37435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:44913
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:06.919152 16304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:06.919371 16304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:06.919410 16304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:06.923223 16304 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:23:06.923270 16304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:06.923288 16304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:06.923334 16304 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:23:06.923367 16304 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:23:06.928308 16304 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:37435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:44913
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:44913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16304
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:06.929191 16304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:06.930094 16304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:06.937618 16310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:06.937664 16309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:06.937651 16312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:06.937940 16304 server_base.cc:1034] running on GCE node
I20260809 09:23:06.938416 16304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:06.939383 16304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:06.940557 16304 hybrid_clock.cc:648] HybridClock initialized: now 1786267386940547 us; error 25 us; skew 500 ppm
Aug 09 09:23:06 dist-test-slave-pgkr krb5kdc[16288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267386, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:06.943008 16304 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:23:06.943650 16304 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:06.943732 16304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:06.943917 16304 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:06.945688 16304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "91dc435c050649b08dd349d9d008f297"
format_stamp: "Formatted at 2026-08-09 09:23:06 on dist-test-slave-pgkr"
server_key: "724d2ba5b88ecdd2e27f835019ecd068"
server_key_iv: "6ebf3b1f81b4607c580c3d41ed7e873f"
server_key_version: "encryptionkey@0"
I20260809 09:23:06.946218 16304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "91dc435c050649b08dd349d9d008f297"
format_stamp: "Formatted at 2026-08-09 09:23:06 on dist-test-slave-pgkr"
server_key: "724d2ba5b88ecdd2e27f835019ecd068"
server_key_iv: "6ebf3b1f81b4607c580c3d41ed7e873f"
server_key_version: "encryptionkey@0"
I20260809 09:23:06.949437 16304 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:23:06.951558 16319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:06.952646 16304 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 09:23:06.952770 16304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "91dc435c050649b08dd349d9d008f297"
format_stamp: "Formatted at 2026-08-09 09:23:06 on dist-test-slave-pgkr"
server_key: "724d2ba5b88ecdd2e27f835019ecd068"
server_key_iv: "6ebf3b1f81b4607c580c3d41ed7e873f"
server_key_version: "encryptionkey@0"
I20260809 09:23:06.952868 16304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:06.981405 16304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:06.984539 16304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:06.984733 16304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:06.991379 16304 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:44913
I20260809 09:23:06.991726 16376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:44913 every 8 connection(s)
I20260809 09:23:06.992057 16304 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:23:06.994649 16377 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:06.999663 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 16304
I20260809 09:23:06.999789 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:23:06.999845 16377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91dc435c050649b08dd349d9d008f297: Bootstrap starting.
I20260809 09:23:07.000065 11663 external_mini_cluster.cc:1428] Setting key 5867018f92a4e7f8c855a97a33c6fa42
I20260809 09:23:07.002283 16377 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91dc435c050649b08dd349d9d008f297: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:07.003153 16377 log.cc:824] T 00000000000000000000000000000000 P 91dc435c050649b08dd349d9d008f297: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:07.005199 16377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91dc435c050649b08dd349d9d008f297: No bootstrap required, opened a new log
Aug 09 09:23:07 dist-test-slave-pgkr krb5kdc[16288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267386, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:23:07.009698 16377 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91dc435c050649b08dd349d9d008f297 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91dc435c050649b08dd349d9d008f297" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 44913 } }
I20260809 09:23:07.009946 16377 raft_consensus.cc:374] T 00000000000000000000000000000000 P 91dc435c050649b08dd349d9d008f297 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:07.010035 16377 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91dc435c050649b08dd349d9d008f297 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91dc435c050649b08dd349d9d008f297, State: Initialized, Role: FOLLOWER
I20260809 09:23:07.010483 16377 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91dc435c050649b08dd349d9d008f297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91dc435c050649b08dd349d9d008f297" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 44913 } }
I20260809 09:23:07.010655 16377 raft_consensus.cc:388] T 00000000000000000000000000000000 P 91dc435c050649b08dd349d9d008f297 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:23:07.010762 16377 raft_consensus.cc:482] T 00000000000000000000000000000000 P 91dc435c050649b08dd349d9d008f297 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:23:07.010900 16377 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91dc435c050649b08dd349d9d008f297 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:07.012116 16377 raft_consensus.cc:504] T 00000000000000000000000000000000 P 91dc435c050649b08dd349d9d008f297 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91dc435c050649b08dd349d9d008f297" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 44913 } }
I20260809 09:23:07.012458 16377 leader_election.cc:302] T 00000000000000000000000000000000 P 91dc435c050649b08dd349d9d008f297 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91dc435c050649b08dd349d9d008f297; no voters:
I20260809 09:23:07.012809 16377 leader_election.cc:288] T 00000000000000000000000000000000 P 91dc435c050649b08dd349d9d008f297 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:23:07.012895 16382 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 91dc435c050649b08dd349d9d008f297 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:23:07.013096 16382 raft_consensus.cc:686] T 00000000000000000000000000000000 P 91dc435c050649b08dd349d9d008f297 [term 1 LEADER]: Becoming Leader. State: Replica: 91dc435c050649b08dd349d9d008f297, State: Running, Role: LEADER
I20260809 09:23:07.013425 16382 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91dc435c050649b08dd349d9d008f297 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91dc435c050649b08dd349d9d008f297" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 44913 } }
I20260809 09:23:07.014133 16377 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91dc435c050649b08dd349d9d008f297 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:23:07.015112 16385 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91dc435c050649b08dd349d9d008f297 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "91dc435c050649b08dd349d9d008f297" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91dc435c050649b08dd349d9d008f297" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 44913 } } }
I20260809 09:23:07.015224 16385 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91dc435c050649b08dd349d9d008f297 [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:07.015185 16384 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91dc435c050649b08dd349d9d008f297 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91dc435c050649b08dd349d9d008f297. Latest consensus state: current_term: 1 leader_uuid: "91dc435c050649b08dd349d9d008f297" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91dc435c050649b08dd349d9d008f297" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 44913 } } }
I20260809 09:23:07.015303 16384 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91dc435c050649b08dd349d9d008f297 [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:07.015525 16380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:07.001252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47740 (local address 127.11.99.254:44913)
0809 09:23:07.001619 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:07.001633 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:07.001665 (+ 32us) server_negotiation.cc:407] Connection header received
0809 09:23:07.002207 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:07.002220 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:07.002546 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:07.002841 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:07.003890 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.004870 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.005996 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.006404 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.006531 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:07.009590 (+ 3059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:07.009595 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:07.009609 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:07.009635 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:07.011875 (+ 2240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:07.012358 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:07.012364 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:07.012369 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:07.012488 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:07.012779 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:07.012783 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:07.012785 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:07.013327 (+ 542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:07.014074 (+ 747us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:07.014186 (+ 112us) server_negotiation.cc:299] Negotiation successful
0809 09:23:07.014488 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":112,"threads_started":1}
W20260809 09:23:07.019165 16399 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 91dc435c050649b08dd349d9d008f297: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 09:23:07.019258 16399 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 09:23:07.019342 16392 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:23:07.020079 16392 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:23:07.025115 16392 catalog_manager.cc:1347] Generated new cluster ID: aba978dd28a144a8965366281bfd45cd
I20260809 09:23:07.025175 16392 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:23:07.040678 16392 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:23:07.041553 16392 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:23:07.047425 16392 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 91dc435c050649b08dd349d9d008f297: Generated new TSK 0
I20260809 09:23:07.048003 16392 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.99.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
I20260809 09:23:07.083146 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:0
--local_ip_for_outbound_sockets=127.11.99.193
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:44913
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:37435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:07.193526 16405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:07.193747 16405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:07.193836 16405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:07.197561 16405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:07.197615 16405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:07.197721 16405 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:23:07.202498 16405 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:37435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:44913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16405
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:07.203348 16405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:07.204224 16405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:07.212623 16412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:07.212625 16410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:07.212690 16405 server_base.cc:1034] running on GCE node
W20260809 09:23:07.212623 16414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:07.213212 16405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:07.213696 16405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:07.214838 16405 hybrid_clock.cc:648] HybridClock initialized: now 1786267387214828 us; error 21 us; skew 500 ppm
Aug 09 09:23:07 dist-test-slave-pgkr krb5kdc[16288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267387, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:07.217450 16405 init.cc:377] Logged in from keytab as kudu/127.11.99.193@KRBTEST.COM (short username kudu)
I20260809 09:23:07.218040 16405 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:07.218106 16405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:07.218251 16405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:07.220228 16405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-0/data/instance:
uuid: "8f12519eb01e441ab609e736b46f6ae2"
format_stamp: "Formatted at 2026-08-09 09:23:07 on dist-test-slave-pgkr"
server_key: "f74bb0e9be03b0f4ea72beb892c74118"
server_key_iv: "86b1d9417ccd0ce381fe31c356a3474c"
server_key_version: "encryptionkey@0"
I20260809 09:23:07.220707 16405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance:
uuid: "8f12519eb01e441ab609e736b46f6ae2"
format_stamp: "Formatted at 2026-08-09 09:23:07 on dist-test-slave-pgkr"
server_key: "f74bb0e9be03b0f4ea72beb892c74118"
server_key_iv: "86b1d9417ccd0ce381fe31c356a3474c"
server_key_version: "encryptionkey@0"
I20260809 09:23:07.223948 16405 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260809 09:23:07.226169 16420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:07.227314 16405 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 09:23:07.227421 16405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "8f12519eb01e441ab609e736b46f6ae2"
format_stamp: "Formatted at 2026-08-09 09:23:07 on dist-test-slave-pgkr"
server_key: "f74bb0e9be03b0f4ea72beb892c74118"
server_key_iv: "86b1d9417ccd0ce381fe31c356a3474c"
server_key_version: "encryptionkey@0"
I20260809 09:23:07.227517 16405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:07.239046 16405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:07.241496 16405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:07.241683 16405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:07.242158 16405 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:07.242913 16405 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:07.242973 16405 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:07.243032 16405 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:07.243080 16405 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:07.252995 16405 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:33961
I20260809 09:23:07.253608 16405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:23:07.257735 16545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:33961 every 8 connection(s)
I20260809 09:23:07.259495 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 16405
I20260809 09:23:07.259636 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance
I20260809 09:23:07.259895 11663 external_mini_cluster.cc:1428] Setting key dd619ac394299adec0589492b8ed6b32
Aug 09 09:23:07 dist-test-slave-pgkr krb5kdc[16288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267387, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:23:07.268536 16380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:07.257384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:46119 (local address 127.11.99.254:44913)
0809 09:23:07.257522 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:07.257526 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:07.257545 (+ 19us) server_negotiation.cc:407] Connection header received
0809 09:23:07.258418 (+ 873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:07.258422 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:07.258479 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:07.258549 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:07.259894 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.260530 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.261696 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.261931 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.262026 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:07.264602 (+ 2576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:07.264608 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:07.264614 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:07.264646 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:07.266300 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:07.266872 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:07.266878 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:07.266883 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:07.266980 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:07.267388 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:07.267393 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:07.267398 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:07.267661 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:07.267797 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:07.268217 (+ 420us) server_negotiation.cc:299] Negotiation successful
0809 09:23:07.268346 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 09:23:07.269100 16549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:07.256396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:44913 (local address 127.11.99.193:46119)
0809 09:23:07.256947 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:07.257001 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:07.258192 (+ 1191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:07.258737 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:07.258743 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:07.259177 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:07.259745 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:07.259763 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.260638 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.260642 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:07.261568 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:07.261577 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.262069 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.262073 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:07.262232 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:07.262789 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:07.262803 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:07.264445 (+ 1642us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:07.266402 (+ 1957us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:07.266406 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:07.266446 (+ 40us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:07.266772 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:07.267085 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:07.267088 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:07.267090 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:07.267265 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:07.267782 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:07.267787 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:07.267977 (+ 190us) client_negotiation.cc:769] Sending connection context
0809 09:23:07.268112 (+ 135us) client_negotiation.cc:240] Negotiation successful
0809 09:23:07.268319 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":149,"threads_started":1}
I20260809 09:23:07.270231 16546 heartbeater.cc:347] Connected to a master server at 127.11.99.254:44913
WARNING: no policy specified for kudu/127.11.99.194@KRBTEST.COM; defaulting to no policy
I20260809 09:23:07.270469 16546 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:07.270922 16546 heartbeater.cc:511] Master 127.11.99.254:44913 requested a full tablet report, sending...
I20260809 09:23:07.272202 16338 ts_manager.cc:194] Registered new tserver with Master: 8f12519eb01e441ab609e736b46f6ae2 (127.11.99.193:33961)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.194@KRBTEST.COM" created.
I20260809 09:23:07.273511 16338 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.193@KRBTEST.COM'} at 127.11.99.193:46119
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
I20260809 09:23:07.286870 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:0
--local_ip_for_outbound_sockets=127.11.99.194
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:44913
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:37435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:07.395856 16553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:07.396121 16553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:07.396204 16553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:07.400558 16553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:07.400648 16553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:07.400744 16553 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:23:07.406517 16553 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:37435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:44913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16553
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:07.407406 16553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:07.408337 16553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:07.417356 16559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:07.417364 16558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:07.417363 16561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:07.417573 16553 server_base.cc:1034] running on GCE node
I20260809 09:23:07.418051 16553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:07.418674 16553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:07.419845 16553 hybrid_clock.cc:648] HybridClock initialized: now 1786267387419832 us; error 25 us; skew 500 ppm
Aug 09 09:23:07 dist-test-slave-pgkr krb5kdc[16288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267387, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:07.422520 16553 init.cc:377] Logged in from keytab as kudu/127.11.99.194@KRBTEST.COM (short username kudu)
I20260809 09:23:07.423214 16553 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:07.423274 16553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:07.423425 16553 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:07.425292 16553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-1/data/instance:
uuid: "47ebf4e1a69b4b968809a4324f640b11"
format_stamp: "Formatted at 2026-08-09 09:23:07 on dist-test-slave-pgkr"
server_key: "d70ff1a36f082eb008acdf3dba75412d"
server_key_iv: "d05bdf8938b0fd09f1f45047d3b3e1b9"
server_key_version: "encryptionkey@0"
I20260809 09:23:07.425786 16553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance:
uuid: "47ebf4e1a69b4b968809a4324f640b11"
format_stamp: "Formatted at 2026-08-09 09:23:07 on dist-test-slave-pgkr"
server_key: "d70ff1a36f082eb008acdf3dba75412d"
server_key_iv: "d05bdf8938b0fd09f1f45047d3b3e1b9"
server_key_version: "encryptionkey@0"
I20260809 09:23:07.429800 16553 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260809 09:23:07.432258 16567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:07.433432 16553 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 09:23:07.433571 16553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "47ebf4e1a69b4b968809a4324f640b11"
format_stamp: "Formatted at 2026-08-09 09:23:07 on dist-test-slave-pgkr"
server_key: "d70ff1a36f082eb008acdf3dba75412d"
server_key_iv: "d05bdf8938b0fd09f1f45047d3b3e1b9"
server_key_version: "encryptionkey@0"
I20260809 09:23:07.433689 16553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:07.443312 16553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:07.446209 16553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:07.446412 16553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:07.446973 16553 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:07.447795 16553 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:07.447872 16553 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:07.447947 16553 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:07.447999 16553 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:07.458179 16553 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:37111
I20260809 09:23:07.458199 16697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:37111 every 8 connection(s)
I20260809 09:23:07.458808 16553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:23:07.462458 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 16553
I20260809 09:23:07.462637 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance
I20260809 09:23:07.462968 11663 external_mini_cluster.cc:1428] Setting key fd25db894522049a2286f517905f6b07
Aug 09 09:23:07 dist-test-slave-pgkr krb5kdc[16288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267387, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.99.195@KRBTEST.COM; defaulting to no policy
I20260809 09:23:07.474037 16380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:07.460500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:51459 (local address 127.11.99.254:44913)
0809 09:23:07.460650 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:07.460653 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:07.461448 (+ 795us) server_negotiation.cc:407] Connection header received
0809 09:23:07.462902 (+ 1454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:07.462909 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:07.462974 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:07.463102 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:07.464404 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.465057 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.466954 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.467444 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.467586 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:07.470162 (+ 2576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:07.470169 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:07.470173 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:07.470206 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:07.471933 (+ 1727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:07.472454 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:07.472458 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:07.472459 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:07.472562 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:07.472889 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:07.472894 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:07.472899 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:07.473163 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:07.473276 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:07.473710 (+ 434us) server_negotiation.cc:299] Negotiation successful
0809 09:23:07.473838 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 09:23:07.474787 16700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:07.460828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:44913 (local address 127.11.99.194:51459)
0809 09:23:07.461291 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:07.461333 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:07.462537 (+ 1204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:07.463282 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:07.463291 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:07.463729 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:07.464247 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:07.464268 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.465348 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.465354 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:07.466823 (+ 1469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:07.466839 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.467614 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.467617 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:07.467755 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:07.468406 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:07.468421 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:07.469984 (+ 1563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:07.472072 (+ 2088us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:07.472076 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:07.472086 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:07.472346 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:07.472661 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:07.472663 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:07.472664 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:07.472793 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:07.473271 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:07.473276 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:07.473484 (+ 208us) client_negotiation.cc:769] Sending connection context
0809 09:23:07.473633 (+ 149us) client_negotiation.cc:240] Negotiation successful
0809 09:23:07.473903 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":128,"threads_started":1}
I20260809 09:23:07.475941 16698 heartbeater.cc:347] Connected to a master server at 127.11.99.254:44913
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.195@KRBTEST.COM" created.
I20260809 09:23:07.476190 16698 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:07.476610 16698 heartbeater.cc:511] Master 127.11.99.254:44913 requested a full tablet report, sending...
I20260809 09:23:07.477649 16338 ts_manager.cc:194] Registered new tserver with Master: 47ebf4e1a69b4b968809a4324f640b11 (127.11.99.194:37111)
I20260809 09:23:07.478236 16338 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.194@KRBTEST.COM'} at 127.11.99.194:51459
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
I20260809 09:23:07.489609 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:0
--local_ip_for_outbound_sockets=127.11.99.195
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:44913
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:37435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:07.596892 16703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:07.597126 16703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:07.597167 16703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:07.601016 16703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:07.601070 16703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:07.601158 16703 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:23:07.606199 16703 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:37435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:44913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16703
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:07.607190 16703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:07.608184 16703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:07.617489 16711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:07.617489 16708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:07.617516 16709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:07.617854 16703 server_base.cc:1034] running on GCE node
I20260809 09:23:07.618188 16703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:07.618873 16703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:07.620042 16703 hybrid_clock.cc:648] HybridClock initialized: now 1786267387620031 us; error 21 us; skew 500 ppm
Aug 09 09:23:07 dist-test-slave-pgkr krb5kdc[16288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267387, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:07.622582 16703 init.cc:377] Logged in from keytab as kudu/127.11.99.195@KRBTEST.COM (short username kudu)
I20260809 09:23:07.623307 16703 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:07.623402 16703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:07.623629 16703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:07.625564 16703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-2/data/instance:
uuid: "88ebead7b0f34159bdfe0cfc9258c53e"
format_stamp: "Formatted at 2026-08-09 09:23:07 on dist-test-slave-pgkr"
server_key: "e0787df23a3ff8cd2d4e28f4bed7b06b"
server_key_iv: "b49948acac616dcfd362cee952470237"
server_key_version: "encryptionkey@0"
I20260809 09:23:07.626127 16703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance:
uuid: "88ebead7b0f34159bdfe0cfc9258c53e"
format_stamp: "Formatted at 2026-08-09 09:23:07 on dist-test-slave-pgkr"
server_key: "e0787df23a3ff8cd2d4e28f4bed7b06b"
server_key_iv: "b49948acac616dcfd362cee952470237"
server_key_version: "encryptionkey@0"
I20260809 09:23:07.629513 16703 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 09:23:07.631875 16717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:07.633037 16703 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 09:23:07.633203 16703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "88ebead7b0f34159bdfe0cfc9258c53e"
format_stamp: "Formatted at 2026-08-09 09:23:07 on dist-test-slave-pgkr"
server_key: "e0787df23a3ff8cd2d4e28f4bed7b06b"
server_key_iv: "b49948acac616dcfd362cee952470237"
server_key_version: "encryptionkey@0"
I20260809 09:23:07.633313 16703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:07.645848 16703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:07.648527 16703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:07.648708 16703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:07.649225 16703 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:07.649977 16703 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:07.650044 16703 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:07.650105 16703 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:07.650146 16703 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:07.659209 16703 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:43055
I20260809 09:23:07.659252 16842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:43055 every 8 connection(s)
I20260809 09:23:07.659808 16703 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:23:07.665158 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 16703
I20260809 09:23:07.665298 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance
I20260809 09:23:07.665562 11663 external_mini_cluster.cc:1428] Setting key ca5257d81015d2e7076402de94fd9a41
Aug 09 09:23:07 dist-test-slave-pgkr krb5kdc[16288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267387, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:23:07.672493 16380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:07.661393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:50841 (local address 127.11.99.254:44913)
0809 09:23:07.661530 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:07.661535 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:07.662679 (+ 1144us) server_negotiation.cc:407] Connection header received
0809 09:23:07.663706 (+ 1027us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:07.663708 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:07.663761 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:07.663833 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:07.664852 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.665407 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.666736 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.667018 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.667101 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:07.669499 (+ 2398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:07.669503 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:07.669505 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:07.669530 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:07.670857 (+ 1327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:07.671274 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:07.671276 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:07.671277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:07.671348 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:07.671671 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:07.671674 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:07.671675 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:07.671839 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:07.671926 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:07.672302 (+ 376us) server_negotiation.cc:299] Negotiation successful
0809 09:23:07.672390 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 09:23:07.673269 16845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:07.661783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:44913 (local address 127.11.99.195:50841)
0809 09:23:07.662488 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:07.662546 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:07.663530 (+ 984us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:07.663973 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:07.663979 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:07.664308 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:07.664742 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:07.664753 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.665535 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.665538 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:07.666577 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:07.666587 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.667178 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.667182 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:07.667365 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:07.667934 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:07.667948 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:07.669359 (+ 1411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:07.670950 (+ 1591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:07.670954 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:07.670963 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:07.671190 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:07.671421 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:07.671423 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:07.671424 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:07.671574 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:07.671925 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:07.671929 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:07.672119 (+ 190us) client_negotiation.cc:769] Sending connection context
0809 09:23:07.672272 (+ 153us) client_negotiation.cc:240] Negotiation successful
0809 09:23:07.672482 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":106,"threads_started":1}
I20260809 09:23:07.674281 16843 heartbeater.cc:347] Connected to a master server at 127.11.99.254:44913
I20260809 09:23:07.674466 16843 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:07.674889 16843 heartbeater.cc:511] Master 127.11.99.254:44913 requested a full tablet report, sending...
I20260809 09:23:07.675724 16338 ts_manager.cc:194] Registered new tserver with Master: 88ebead7b0f34159bdfe0cfc9258c53e (127.11.99.195:43055)
I20260809 09:23:07.676246 16338 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.195@KRBTEST.COM'} at 127.11.99.195:50841
I20260809 09:23:07.678980 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 09:23:07.686767 16380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:07.680576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47756 (local address 127.11.99.254:44913)
0809 09:23:07.680676 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:07.680679 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:07.680827 (+ 148us) server_negotiation.cc:407] Connection header received
0809 09:23:07.680914 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:07.680916 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:07.680945 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:07.681003 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:07.681592 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.682033 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.682855 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.683047 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.683123 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:07.684324 (+ 1201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:07.684327 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:07.684328 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:07.684343 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:07.685452 (+ 1109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:07.685811 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:07.685813 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:07.685814 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:07.685880 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:07.686112 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:07.686114 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:07.686115 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:07.686283 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:07.686374 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:07.686544 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 09:23:07.686674 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 09:23:07.689065 16338 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47756:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 09:23:07.691947 16338 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:23:07.705626 16858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:07.700078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49720 (local address 127.11.99.194:37111)
0809 09:23:07.701329 (+ 1251us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:07.701339 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:07.701356 (+ 17us) server_negotiation.cc:407] Connection header received
0809 09:23:07.701415 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:07.701419 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:07.701556 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:07.701800 (+ 244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:07.701932 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.702976 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.704398 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.705103 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.705194 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:07.705305 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:07.705400 (+ 95us) server_negotiation.cc:299] Negotiation successful
0809 09:23:07.705484 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1158,"thread_start_us":128,"threads_started":1}
I20260809 09:23:07.705651 16859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:07.700033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:43055 (local address 127.0.0.1:46456)
0809 09:23:07.700975 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:07.700989 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:07.701179 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:07.701636 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:07.701641 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:07.701661 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:07.701962 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:07.701968 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.703192 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.703195 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:07.704121 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:07.704129 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.705094 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.705096 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:07.705196 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:07.705262 (+ 66us) client_negotiation.cc:769] Sending connection context
0809 09:23:07.705362 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 09:23:07.705487 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":879,"mutex_wait_us":29,"thread_start_us":104,"threads_started":1}
I20260809 09:23:07.705650 16855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:07.699958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:37111 (local address 127.0.0.1:49720)
0809 09:23:07.700582 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:07.700628 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:07.700740 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:07.701699 (+ 959us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:07.701702 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:07.701719 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:07.701835 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:07.701845 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.703101 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.703104 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:07.704291 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:07.704296 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.705199 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.705202 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:07.705284 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:07.705298 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 09:23:07.705362 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 09:23:07.705487 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"mutex_wait_us":133,"thread_start_us":76,"threads_started":1}
I20260809 09:23:07.706033 16860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:07.700654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46456 (local address 127.11.99.195:43055)
0809 09:23:07.701057 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:07.701071 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:07.701235 (+ 164us) server_negotiation.cc:407] Connection header received
0809 09:23:07.701306 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:07.701311 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:07.701485 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:07.701637 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:07.702068 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.703068 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.704247 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.704973 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.705082 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:07.705221 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:07.705803 (+ 582us) server_negotiation.cc:299] Negotiation successful
0809 09:23:07.705882 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":140,"threads_started":1}
I20260809 09:23:07.706919 16857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:07.700310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:33961 (local address 127.0.0.1:40304)
0809 09:23:07.701290 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:07.701299 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:07.701391 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:07.701955 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:07.701958 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:07.701974 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:07.702059 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:07.702065 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.702972 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.702975 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:07.704283 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:07.704293 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.706461 (+ 2168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.706464 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:07.706550 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:07.706571 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 09:23:07.706698 (+ 127us) client_negotiation.cc:240] Negotiation successful
0809 09:23:07.706783 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":926,"mutex_wait_us":98,"thread_start_us":83,"threads_started":1}
I20260809 09:23:07.707408 16861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:07.700660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40304 (local address 127.11.99.193:33961)
0809 09:23:07.701117 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:07.701150 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:07.701386 (+ 236us) server_negotiation.cc:407] Connection header received
0809 09:23:07.701493 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:07.701497 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:07.701671 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:07.701804 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:07.702173 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.702854 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.705379 (+ 2525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.706150 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.706259 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:07.706396 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:07.707194 (+ 798us) server_negotiation.cc:299] Negotiation successful
0809 09:23:07.707287 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":134,"threads_started":1}
I20260809 09:23:07.708858 16768 tablet_service.cc:1467] Processing CreateTablet for tablet 9047b99a1e93402f8e795ae20e5b4b26 (DEFAULT_TABLE table=test-table [id=12b8b017416f4a4490ad62a075ddac90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:07.708858 16621 tablet_service.cc:1467] Processing CreateTablet for tablet 9047b99a1e93402f8e795ae20e5b4b26 (DEFAULT_TABLE table=test-table [id=12b8b017416f4a4490ad62a075ddac90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:07.709474 16474 tablet_service.cc:1467] Processing CreateTablet for tablet 9047b99a1e93402f8e795ae20e5b4b26 (DEFAULT_TABLE table=test-table [id=12b8b017416f4a4490ad62a075ddac90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:07.709933 16621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9047b99a1e93402f8e795ae20e5b4b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:07.709936 16768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9047b99a1e93402f8e795ae20e5b4b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:07.710320 16474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9047b99a1e93402f8e795ae20e5b4b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:07.717226 16864 tablet_bootstrap.cc:492] T 9047b99a1e93402f8e795ae20e5b4b26 P 8f12519eb01e441ab609e736b46f6ae2: Bootstrap starting.
I20260809 09:23:07.718241 16862 tablet_bootstrap.cc:492] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e: Bootstrap starting.
I20260809 09:23:07.718900 16863 tablet_bootstrap.cc:492] T 9047b99a1e93402f8e795ae20e5b4b26 P 47ebf4e1a69b4b968809a4324f640b11: Bootstrap starting.
I20260809 09:23:07.719534 16864 tablet_bootstrap.cc:654] T 9047b99a1e93402f8e795ae20e5b4b26 P 8f12519eb01e441ab609e736b46f6ae2: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:07.720266 16862 tablet_bootstrap.cc:654] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:07.720487 16863 tablet_bootstrap.cc:654] T 9047b99a1e93402f8e795ae20e5b4b26 P 47ebf4e1a69b4b968809a4324f640b11: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:07.720870 16864 log.cc:824] T 9047b99a1e93402f8e795ae20e5b4b26 P 8f12519eb01e441ab609e736b46f6ae2: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:07.721369 16862 log.cc:824] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:07.721550 16863 log.cc:824] T 9047b99a1e93402f8e795ae20e5b4b26 P 47ebf4e1a69b4b968809a4324f640b11: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:07.723285 16862 tablet_bootstrap.cc:492] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e: No bootstrap required, opened a new log
I20260809 09:23:07.723275 16864 tablet_bootstrap.cc:492] T 9047b99a1e93402f8e795ae20e5b4b26 P 8f12519eb01e441ab609e736b46f6ae2: No bootstrap required, opened a new log
I20260809 09:23:07.723464 16862 ts_tablet_manager.cc:1397] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.001s
I20260809 09:23:07.723464 16864 ts_tablet_manager.cc:1397] T 9047b99a1e93402f8e795ae20e5b4b26 P 8f12519eb01e441ab609e736b46f6ae2: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 09:23:07.723472 16863 tablet_bootstrap.cc:492] T 9047b99a1e93402f8e795ae20e5b4b26 P 47ebf4e1a69b4b968809a4324f640b11: No bootstrap required, opened a new log
I20260809 09:23:07.723655 16863 ts_tablet_manager.cc:1397] T 9047b99a1e93402f8e795ae20e5b4b26 P 47ebf4e1a69b4b968809a4324f640b11: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 09:23:07.726300 16863 raft_consensus.cc:348] T 9047b99a1e93402f8e795ae20e5b4b26 P 47ebf4e1a69b4b968809a4324f640b11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47ebf4e1a69b4b968809a4324f640b11" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37111 } } peers { permanent_uuid: "88ebead7b0f34159bdfe0cfc9258c53e" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 43055 } } peers { permanent_uuid: "8f12519eb01e441ab609e736b46f6ae2" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 33961 } }
I20260809 09:23:07.726518 16863 raft_consensus.cc:374] T 9047b99a1e93402f8e795ae20e5b4b26 P 47ebf4e1a69b4b968809a4324f640b11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:07.726588 16863 raft_consensus.cc:729] T 9047b99a1e93402f8e795ae20e5b4b26 P 47ebf4e1a69b4b968809a4324f640b11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ebf4e1a69b4b968809a4324f640b11, State: Initialized, Role: FOLLOWER
I20260809 09:23:07.727016 16863 consensus_queue.cc:260] T 9047b99a1e93402f8e795ae20e5b4b26 P 47ebf4e1a69b4b968809a4324f640b11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47ebf4e1a69b4b968809a4324f640b11" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37111 } } peers { permanent_uuid: "88ebead7b0f34159bdfe0cfc9258c53e" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 43055 } } peers { permanent_uuid: "8f12519eb01e441ab609e736b46f6ae2" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 33961 } }
I20260809 09:23:07.727126 16864 raft_consensus.cc:348] T 9047b99a1e93402f8e795ae20e5b4b26 P 8f12519eb01e441ab609e736b46f6ae2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47ebf4e1a69b4b968809a4324f640b11" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37111 } } peers { permanent_uuid: "88ebead7b0f34159bdfe0cfc9258c53e" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 43055 } } peers { permanent_uuid: "8f12519eb01e441ab609e736b46f6ae2" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 33961 } }
I20260809 09:23:07.727126 16862 raft_consensus.cc:348] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47ebf4e1a69b4b968809a4324f640b11" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37111 } } peers { permanent_uuid: "88ebead7b0f34159bdfe0cfc9258c53e" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 43055 } } peers { permanent_uuid: "8f12519eb01e441ab609e736b46f6ae2" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 33961 } }
I20260809 09:23:07.727450 16862 raft_consensus.cc:374] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:07.727543 16862 raft_consensus.cc:729] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ebead7b0f34159bdfe0cfc9258c53e, State: Initialized, Role: FOLLOWER
I20260809 09:23:07.727506 16864 raft_consensus.cc:374] T 9047b99a1e93402f8e795ae20e5b4b26 P 8f12519eb01e441ab609e736b46f6ae2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:07.727603 16698 heartbeater.cc:503] Master 127.11.99.254:44913 was elected leader, sending a full tablet report...
I20260809 09:23:07.727600 16864 raft_consensus.cc:729] T 9047b99a1e93402f8e795ae20e5b4b26 P 8f12519eb01e441ab609e736b46f6ae2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f12519eb01e441ab609e736b46f6ae2, State: Initialized, Role: FOLLOWER
I20260809 09:23:07.727922 16863 ts_tablet_manager.cc:1428] T 9047b99a1e93402f8e795ae20e5b4b26 P 47ebf4e1a69b4b968809a4324f640b11: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260809 09:23:07.728009 16862 consensus_queue.cc:260] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47ebf4e1a69b4b968809a4324f640b11" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37111 } } peers { permanent_uuid: "88ebead7b0f34159bdfe0cfc9258c53e" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 43055 } } peers { permanent_uuid: "8f12519eb01e441ab609e736b46f6ae2" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 33961 } }
I20260809 09:23:07.728009 16864 consensus_queue.cc:260] T 9047b99a1e93402f8e795ae20e5b4b26 P 8f12519eb01e441ab609e736b46f6ae2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47ebf4e1a69b4b968809a4324f640b11" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37111 } } peers { permanent_uuid: "88ebead7b0f34159bdfe0cfc9258c53e" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 43055 } } peers { permanent_uuid: "8f12519eb01e441ab609e736b46f6ae2" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 33961 } }
I20260809 09:23:07.728828 16864 ts_tablet_manager.cc:1428] T 9047b99a1e93402f8e795ae20e5b4b26 P 8f12519eb01e441ab609e736b46f6ae2: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 09:23:07.729125 16546 heartbeater.cc:503] Master 127.11.99.254:44913 was elected leader, sending a full tablet report...
I20260809 09:23:07.730386 16862 ts_tablet_manager.cc:1428] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20260809 09:23:07.731027 16843 heartbeater.cc:503] Master 127.11.99.254:44913 was elected leader, sending a full tablet report...
W20260809 09:23:07.754871 16548 tablet.cc:2369] T 9047b99a1e93402f8e795ae20e5b4b26 P 8f12519eb01e441ab609e736b46f6ae2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:23:07.813711 16871 raft_consensus.cc:482] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:23:07.813943 16871 raft_consensus.cc:504] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47ebf4e1a69b4b968809a4324f640b11" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37111 } } peers { permanent_uuid: "88ebead7b0f34159bdfe0cfc9258c53e" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 43055 } } peers { permanent_uuid: "8f12519eb01e441ab609e736b46f6ae2" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 33961 } }
I20260809 09:23:07.815271 16871 leader_election.cc:288] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47ebf4e1a69b4b968809a4324f640b11 (127.11.99.194:37111), 8f12519eb01e441ab609e736b46f6ae2 (127.11.99.193:33961)
I20260809 09:23:07.818966 16845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:07.815509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:33961 (local address 127.11.99.195:43339)
0809 09:23:07.815626 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:07.815643 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:07.815731 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:07.816001 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:07.816004 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:07.816024 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:07.816146 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:07.816152 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.816904 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.816908 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:07.817835 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:07.817848 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.818527 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.818530 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:07.818657 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:07.818675 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 09:23:07.818770 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 09:23:07.818840 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260809 09:23:07.818966 16861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:07.815582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:43339 (local address 127.11.99.193:33961)
0809 09:23:07.815708 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:07.815712 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:07.815741 (+ 29us) server_negotiation.cc:407] Connection header received
0809 09:23:07.815823 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:07.815825 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:07.815897 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:07.815986 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:07.816270 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.816781 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.817980 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.818405 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.818535 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:07.818589 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:07.818784 (+ 195us) server_negotiation.cc:299] Negotiation successful
0809 09:23:07.818849 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 09:23:07.819507 16873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:07.815509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:37111 (local address 127.11.99.195:51627)
0809 09:23:07.816165 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:07.816176 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:07.816288 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:07.816559 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:07.816562 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:07.816577 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:07.816695 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:07.816700 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.817422 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.817425 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:07.818372 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:07.818381 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.819088 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.819091 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:07.819187 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:07.819208 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 09:23:07.819314 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 09:23:07.819379 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"mutex_wait_us":292,"thread_start_us":140,"threads_started":1}
I20260809 09:23:07.819514 16858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:07.815620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:51627 (local address 127.11.99.194:37111)
0809 09:23:07.815742 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:07.815746 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:07.816255 (+ 509us) server_negotiation.cc:407] Connection header received
0809 09:23:07.816405 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:07.816408 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:07.816451 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:07.816548 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:07.816797 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.817307 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.818489 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.818952 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.819081 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:07.819125 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:07.819344 (+ 219us) server_negotiation.cc:299] Negotiation successful
0809 09:23:07.819430 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 09:23:07.819665 16494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9047b99a1e93402f8e795ae20e5b4b26" candidate_uuid: "88ebead7b0f34159bdfe0cfc9258c53e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f12519eb01e441ab609e736b46f6ae2" is_pre_election: true
I20260809 09:23:07.819945 16494 raft_consensus.cc:2454] T 9047b99a1e93402f8e795ae20e5b4b26 P 8f12519eb01e441ab609e736b46f6ae2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ebead7b0f34159bdfe0cfc9258c53e in term 0.
I20260809 09:23:07.820444 16719 leader_election.cc:302] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88ebead7b0f34159bdfe0cfc9258c53e, 8f12519eb01e441ab609e736b46f6ae2; no voters:
I20260809 09:23:07.820757 16871 raft_consensus.cc:2781] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:23:07.820735 16644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9047b99a1e93402f8e795ae20e5b4b26" candidate_uuid: "88ebead7b0f34159bdfe0cfc9258c53e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ebf4e1a69b4b968809a4324f640b11" is_pre_election: true
I20260809 09:23:07.820854 16871 raft_consensus.cc:482] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:23:07.820919 16871 raft_consensus.cc:3037] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:07.821012 16644 raft_consensus.cc:2454] T 9047b99a1e93402f8e795ae20e5b4b26 P 47ebf4e1a69b4b968809a4324f640b11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ebead7b0f34159bdfe0cfc9258c53e in term 0.
I20260809 09:23:07.822126 16871 raft_consensus.cc:504] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47ebf4e1a69b4b968809a4324f640b11" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37111 } } peers { permanent_uuid: "88ebead7b0f34159bdfe0cfc9258c53e" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 43055 } } peers { permanent_uuid: "8f12519eb01e441ab609e736b46f6ae2" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 33961 } }
I20260809 09:23:07.822453 16871 leader_election.cc:288] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e [CANDIDATE]: Term 1 election: Requested vote from peers 47ebf4e1a69b4b968809a4324f640b11 (127.11.99.194:37111), 8f12519eb01e441ab609e736b46f6ae2 (127.11.99.193:33961)
I20260809 09:23:07.822809 16494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9047b99a1e93402f8e795ae20e5b4b26" candidate_uuid: "88ebead7b0f34159bdfe0cfc9258c53e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f12519eb01e441ab609e736b46f6ae2"
I20260809 09:23:07.822945 16494 raft_consensus.cc:3037] T 9047b99a1e93402f8e795ae20e5b4b26 P 8f12519eb01e441ab609e736b46f6ae2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:07.822966 16644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9047b99a1e93402f8e795ae20e5b4b26" candidate_uuid: "88ebead7b0f34159bdfe0cfc9258c53e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ebf4e1a69b4b968809a4324f640b11"
I20260809 09:23:07.823096 16644 raft_consensus.cc:3037] T 9047b99a1e93402f8e795ae20e5b4b26 P 47ebf4e1a69b4b968809a4324f640b11 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:07.824043 16494 raft_consensus.cc:2454] T 9047b99a1e93402f8e795ae20e5b4b26 P 8f12519eb01e441ab609e736b46f6ae2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ebead7b0f34159bdfe0cfc9258c53e in term 1.
I20260809 09:23:07.824160 16644 raft_consensus.cc:2454] T 9047b99a1e93402f8e795ae20e5b4b26 P 47ebf4e1a69b4b968809a4324f640b11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ebead7b0f34159bdfe0cfc9258c53e in term 1.
I20260809 09:23:07.824397 16719 leader_election.cc:302] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88ebead7b0f34159bdfe0cfc9258c53e, 8f12519eb01e441ab609e736b46f6ae2; no voters:
I20260809 09:23:07.824551 16871 raft_consensus.cc:2781] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:23:07.824770 16871 raft_consensus.cc:686] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e [term 1 LEADER]: Becoming Leader. State: Replica: 88ebead7b0f34159bdfe0cfc9258c53e, State: Running, Role: LEADER
I20260809 09:23:07.825079 16871 consensus_queue.cc:237] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47ebf4e1a69b4b968809a4324f640b11" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37111 } } peers { permanent_uuid: "88ebead7b0f34159bdfe0cfc9258c53e" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 43055 } } peers { permanent_uuid: "8f12519eb01e441ab609e736b46f6ae2" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 33961 } }
I20260809 09:23:07.828030 16338 catalog_manager.cc:5495] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ebead7b0f34159bdfe0cfc9258c53e (127.11.99.195). New cstate: current_term: 1 leader_uuid: "88ebead7b0f34159bdfe0cfc9258c53e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47ebf4e1a69b4b968809a4324f640b11" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88ebead7b0f34159bdfe0cfc9258c53e" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 43055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f12519eb01e441ab609e736b46f6ae2" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 33961 } health_report { overall_health: UNKNOWN } } }
I20260809 09:23:07.855063 16860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:07.851450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46470 (local address 127.11.99.195:43055)
0809 09:23:07.851592 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:07.851596 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:07.851609 (+ 13us) server_negotiation.cc:407] Connection header received
0809 09:23:07.851777 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:07.851779 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:07.851830 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:07.851938 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:23:07.852196 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.852719 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.853621 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:07.853837 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:07.853942 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:07.854243 (+ 301us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:23:07.854670 (+ 427us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:23:07.854821 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:07.854874 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 09:23:07.854925 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 09:23:07.860594 16644 raft_consensus.cc:1261] T 9047b99a1e93402f8e795ae20e5b4b26 P 47ebf4e1a69b4b968809a4324f640b11 [term 1 FOLLOWER]: Refusing update from remote peer 88ebead7b0f34159bdfe0cfc9258c53e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:23:07.860606 16494 raft_consensus.cc:1261] T 9047b99a1e93402f8e795ae20e5b4b26 P 8f12519eb01e441ab609e736b46f6ae2 [term 1 FOLLOWER]: Refusing update from remote peer 88ebead7b0f34159bdfe0cfc9258c53e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:23:07.861227 16874 consensus_queue.cc:1035] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ebf4e1a69b4b968809a4324f640b11" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:23:07.861436 16871 consensus_queue.cc:1035] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f12519eb01e441ab609e736b46f6ae2" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 33961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:23:07.869570 16878 mvcc.cc:205] Tried to move back new op lower bound from 7316551220670562304 to 7316551220534079488. Current Snapshot: MvccSnapshot[applied={T|T < 7316551220670562304}]
I20260809 09:23:07.875212 16337 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47756:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:23:07.875360 16337 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47756:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:23:07.877547 16337 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 91dc435c050649b08dd349d9d008f297: Sending DeleteTablet for 3 replicas of tablet 9047b99a1e93402f8e795ae20e5b4b26
I20260809 09:23:07.878244 16768 tablet_service.cc:1514] Processing DeleteTablet for tablet 9047b99a1e93402f8e795ae20e5b4b26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:07 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:46456
I20260809 09:23:07.878458 16474 tablet_service.cc:1514] Processing DeleteTablet for tablet 9047b99a1e93402f8e795ae20e5b4b26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:07 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:40304
I20260809 09:23:07.878463 16621 tablet_service.cc:1514] Processing DeleteTablet for tablet 9047b99a1e93402f8e795ae20e5b4b26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:07 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:49720
I20260809 09:23:07.878908 16892 tablet_replica.cc:330] T 9047b99a1e93402f8e795ae20e5b4b26 P 8f12519eb01e441ab609e736b46f6ae2: stopping tablet replica
I20260809 09:23:07.878931 16889 tablet_replica.cc:330] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e: stopping tablet replica
I20260809 09:23:07.879179 16892 raft_consensus.cc:2229] T 9047b99a1e93402f8e795ae20e5b4b26 P 8f12519eb01e441ab609e736b46f6ae2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:23:07.879179 16889 raft_consensus.cc:2229] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e [term 1 LEADER]: Raft consensus shutting down.
I20260809 09:23:07.879334 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 16405
I20260809 09:23:07.881482 16889 raft_consensus.cc:2258] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:23:07.883570 16889 ts_tablet_manager.cc:1905] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:23:07.884949 16890 tablet_replica.cc:330] T 9047b99a1e93402f8e795ae20e5b4b26 P 47ebf4e1a69b4b968809a4324f640b11: stopping tablet replica
I20260809 09:23:07.885249 16890 raft_consensus.cc:2229] T 9047b99a1e93402f8e795ae20e5b4b26 P 47ebf4e1a69b4b968809a4324f640b11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:23:07.885556 16890 raft_consensus.cc:2258] T 9047b99a1e93402f8e795ae20e5b4b26 P 47ebf4e1a69b4b968809a4324f640b11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:23:07.886219 16889 ts_tablet_manager.cc:1918] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:23:07.886353 16889 log.cc:1196] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/9047b99a1e93402f8e795ae20e5b4b26
I20260809 09:23:07.886725 16889 ts_tablet_manager.cc:1939] T 9047b99a1e93402f8e795ae20e5b4b26 P 88ebead7b0f34159bdfe0cfc9258c53e: Deleting consensus metadata
I20260809 09:23:07.886952 16890 ts_tablet_manager.cc:1905] T 9047b99a1e93402f8e795ae20e5b4b26 P 47ebf4e1a69b4b968809a4324f640b11: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:23:07.887764 16320 catalog_manager.cc:4841] TS 88ebead7b0f34159bdfe0cfc9258c53e (127.11.99.195:43055): tablet 9047b99a1e93402f8e795ae20e5b4b26 (table test-table [id=12b8b017416f4a4490ad62a075ddac90]) successfully deleted
I20260809 09:23:07.889552 16890 ts_tablet_manager.cc:1918] T 9047b99a1e93402f8e795ae20e5b4b26 P 47ebf4e1a69b4b968809a4324f640b11: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:23:07.889669 16890 log.cc:1196] T 9047b99a1e93402f8e795ae20e5b4b26 P 47ebf4e1a69b4b968809a4324f640b11: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/9047b99a1e93402f8e795ae20e5b4b26
I20260809 09:23:07.890038 16890 ts_tablet_manager.cc:1939] T 9047b99a1e93402f8e795ae20e5b4b26 P 47ebf4e1a69b4b968809a4324f640b11: Deleting consensus metadata
W20260809 09:23:07.890441 16323 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.99.193:33961 (error 108)
I20260809 09:23:07.891110 16324 catalog_manager.cc:4841] TS 47ebf4e1a69b4b968809a4324f640b11 (127.11.99.194:37111): tablet 9047b99a1e93402f8e795ae20e5b4b26 (table test-table [id=12b8b017416f4a4490ad62a075ddac90]) successfully deleted
W20260809 09:23:07.891499 16857 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:07.891168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:33961 (local address 127.0.0.1:40306)
0809 09:23:07.891331 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:07.891402 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.193:33961: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":72}
W20260809 09:23:07.891626 16323 catalog_manager.cc:4584] TS 8f12519eb01e441ab609e736b46f6ae2 (127.11.99.193:33961): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9047b99a1e93402f8e795ae20e5b4b26: Network error: Client connection negotiation failed: client connection to 127.11.99.193:33961: connect: Connection reset by peer (error 104)
I20260809 09:23:07.891666 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 16553
I20260809 09:23:07.900870 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 16703
I20260809 09:23:07.906462 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 16304
2026-08-09T09:23:07Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2235 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-09T09:23:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:23:07Z Disabled control of system clock
I20260809 09:23:07.936594 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:35389
--webserver_interface=127.11.99.254
--webserver_port=0
--builtin_ntp_servers=127.11.99.212:40263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:35389
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 09:23:08.041954 16900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:08.042196 16900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:08.042227 16900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:08.045949 16900 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:23:08.046020 16900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:08.046034 16900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:08.046049 16900 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:23:08.046063 16900 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:23:08.050393 16900 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:40263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:35389
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:35389
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16900
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:08.051417 16900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:08.052644 16900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:08.060860 16905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:08.060920 16907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:08.060873 16909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:08.061040 16900 server_base.cc:1034] running on GCE node
I20260809 09:23:08.061651 16900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:08.062752 16900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:08.063906 16900 hybrid_clock.cc:648] HybridClock initialized: now 1786267388063878 us; error 39 us; skew 500 ppm
I20260809 09:23:08.069433 16900 webserver.cc:460] Webserver started at http://127.11.99.254:39779/ using document root <none> and password file <none>
I20260809 09:23:08.070010 16900 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:08.070072 16900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:08.070297 16900 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:08.072434 16900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "f68316ab5401413ab80d3ef9a80bafc1"
format_stamp: "Formatted at 2026-08-09 09:23:08 on dist-test-slave-pgkr"
server_key: "8c49dc9b651b4ead38e84220f156b198"
server_key_iv: "d07352130adf45858a7947080bbd974c"
server_key_version: "encryptionkey@0"
I20260809 09:23:08.073016 16900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "f68316ab5401413ab80d3ef9a80bafc1"
format_stamp: "Formatted at 2026-08-09 09:23:08 on dist-test-slave-pgkr"
server_key: "8c49dc9b651b4ead38e84220f156b198"
server_key_iv: "d07352130adf45858a7947080bbd974c"
server_key_version: "encryptionkey@0"
I20260809 09:23:08.076432 16900 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:23:08.078773 16916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:08.079879 16900 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:23:08.080010 16900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "f68316ab5401413ab80d3ef9a80bafc1"
format_stamp: "Formatted at 2026-08-09 09:23:08 on dist-test-slave-pgkr"
server_key: "8c49dc9b651b4ead38e84220f156b198"
server_key_iv: "d07352130adf45858a7947080bbd974c"
server_key_version: "encryptionkey@0"
I20260809 09:23:08.080112 16900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:08.084273 16900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:08.084815 16900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:08.084982 16900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:08.091439 16900 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:35389
I20260809 09:23:08.091462 16971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:35389 every 8 connection(s)
I20260809 09:23:08.092263 16900 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:23:08.095458 16972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:08.100556 16972 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f68316ab5401413ab80d3ef9a80bafc1: Bootstrap starting.
I20260809 09:23:08.101626 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 16900
I20260809 09:23:08.101756 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:23:08.102002 11663 external_mini_cluster.cc:1428] Setting key a663f6b14f31648712c2680adb7c9bb2
I20260809 09:23:08.103026 16972 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f68316ab5401413ab80d3ef9a80bafc1: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:08.103830 16972 log.cc:824] T 00000000000000000000000000000000 P f68316ab5401413ab80d3ef9a80bafc1: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:08.106033 16972 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f68316ab5401413ab80d3ef9a80bafc1: No bootstrap required, opened a new log
I20260809 09:23:08.107244 16975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:08.103137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56542 (local address 127.11.99.254:35389)
0809 09:23:08.103735 (+ 598us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:08.103750 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:08.103783 (+ 33us) server_negotiation.cc:407] Connection header received
0809 09:23:08.104546 (+ 763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:08.104571 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:08.104871 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:08.105126 (+ 255us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:08.106020 (+ 894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:08.106025 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:08.106035 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:23:08.106044 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:08.106094 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:23:08.106108 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:08.106235 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:08.106363 (+ 128us) server_negotiation.cc:299] Negotiation successful
0809 09:23:08.106585 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":130,"threads_started":1}
I20260809 09:23:08.109979 16972 raft_consensus.cc:348] T 00000000000000000000000000000000 P f68316ab5401413ab80d3ef9a80bafc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f68316ab5401413ab80d3ef9a80bafc1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35389 } }
I20260809 09:23:08.110239 16972 raft_consensus.cc:374] T 00000000000000000000000000000000 P f68316ab5401413ab80d3ef9a80bafc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:08.110330 16972 raft_consensus.cc:729] T 00000000000000000000000000000000 P f68316ab5401413ab80d3ef9a80bafc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f68316ab5401413ab80d3ef9a80bafc1, State: Initialized, Role: FOLLOWER
I20260809 09:23:08.110814 16972 consensus_queue.cc:260] T 00000000000000000000000000000000 P f68316ab5401413ab80d3ef9a80bafc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f68316ab5401413ab80d3ef9a80bafc1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35389 } }
I20260809 09:23:08.110961 16972 raft_consensus.cc:388] T 00000000000000000000000000000000 P f68316ab5401413ab80d3ef9a80bafc1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:23:08.111047 16972 raft_consensus.cc:482] T 00000000000000000000000000000000 P f68316ab5401413ab80d3ef9a80bafc1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:23:08.111186 16972 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f68316ab5401413ab80d3ef9a80bafc1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:08.112100 16972 raft_consensus.cc:504] T 00000000000000000000000000000000 P f68316ab5401413ab80d3ef9a80bafc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f68316ab5401413ab80d3ef9a80bafc1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35389 } }
I20260809 09:23:08.112457 16972 leader_election.cc:302] T 00000000000000000000000000000000 P f68316ab5401413ab80d3ef9a80bafc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f68316ab5401413ab80d3ef9a80bafc1; no voters:
I20260809 09:23:08.112758 16972 leader_election.cc:288] T 00000000000000000000000000000000 P f68316ab5401413ab80d3ef9a80bafc1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:23:08.112888 16979 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f68316ab5401413ab80d3ef9a80bafc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:23:08.113078 16979 raft_consensus.cc:686] T 00000000000000000000000000000000 P f68316ab5401413ab80d3ef9a80bafc1 [term 1 LEADER]: Becoming Leader. State: Replica: f68316ab5401413ab80d3ef9a80bafc1, State: Running, Role: LEADER
I20260809 09:23:08.113375 16979 consensus_queue.cc:237] T 00000000000000000000000000000000 P f68316ab5401413ab80d3ef9a80bafc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f68316ab5401413ab80d3ef9a80bafc1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35389 } }
I20260809 09:23:08.113976 16972 sys_catalog.cc:564] T 00000000000000000000000000000000 P f68316ab5401413ab80d3ef9a80bafc1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:23:08.114961 16981 sys_catalog.cc:455] T 00000000000000000000000000000000 P f68316ab5401413ab80d3ef9a80bafc1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f68316ab5401413ab80d3ef9a80bafc1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f68316ab5401413ab80d3ef9a80bafc1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35389 } } }
I20260809 09:23:08.115073 16980 sys_catalog.cc:455] T 00000000000000000000000000000000 P f68316ab5401413ab80d3ef9a80bafc1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f68316ab5401413ab80d3ef9a80bafc1. Latest consensus state: current_term: 1 leader_uuid: "f68316ab5401413ab80d3ef9a80bafc1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f68316ab5401413ab80d3ef9a80bafc1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35389 } } }
I20260809 09:23:08.115134 16981 sys_catalog.cc:458] T 00000000000000000000000000000000 P f68316ab5401413ab80d3ef9a80bafc1 [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:08.115149 16980 sys_catalog.cc:458] T 00000000000000000000000000000000 P f68316ab5401413ab80d3ef9a80bafc1 [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:08.115649 16988 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:23:08.118404 16988 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:23:08.123625 16988 catalog_manager.cc:1347] Generated new cluster ID: 5e370e9be9f240e29f9d45010cedbedc
I20260809 09:23:08.123692 16988 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:23:08.132869 16988 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:23:08.133163 16988 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:23:08.141327 16988 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f68316ab5401413ab80d3ef9a80bafc1: Generated new TSK 0
I20260809 09:23:08.141894 16988 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:23:08.144599 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:0
--local_ip_for_outbound_sockets=127.11.99.193
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:35389
--builtin_ntp_servers=127.11.99.212:40263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 09:23:08.248751 17002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:08.248968 17002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:08.249002 17002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:08.252950 17002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:08.253001 17002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:08.253054 17002 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:23:08.257519 17002 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:40263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:35389
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17002
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:08.258553 17002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:08.259884 17002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:08.268867 17008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:08.268965 17002 server_base.cc:1034] running on GCE node
W20260809 09:23:08.268872 17007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:08.268863 17010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:08.269658 17002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:08.270268 17002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:08.271467 17002 hybrid_clock.cc:648] HybridClock initialized: now 1786267388271447 us; error 30 us; skew 500 ppm
I20260809 09:23:08.273228 17002 webserver.cc:460] Webserver started at http://127.11.99.193:44823/ using document root <none> and password file <none>
I20260809 09:23:08.273792 17002 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:08.273883 17002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:08.274112 17002 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:08.276088 17002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-0/data/instance:
uuid: "07b1f12e0dea4081904ce2a563f04574"
format_stamp: "Formatted at 2026-08-09 09:23:08 on dist-test-slave-pgkr"
server_key: "04fe8e71c05395587dd13e0d637fae24"
server_key_iv: "37583a3341ad3d7687ab725fc97a6b9c"
server_key_version: "encryptionkey@0"
I20260809 09:23:08.276676 17002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance:
uuid: "07b1f12e0dea4081904ce2a563f04574"
format_stamp: "Formatted at 2026-08-09 09:23:08 on dist-test-slave-pgkr"
server_key: "04fe8e71c05395587dd13e0d637fae24"
server_key_iv: "37583a3341ad3d7687ab725fc97a6b9c"
server_key_version: "encryptionkey@0"
I20260809 09:23:08.280514 17002 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260809 09:23:08.282912 17016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:08.284144 17002 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 09:23:08.284271 17002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "07b1f12e0dea4081904ce2a563f04574"
format_stamp: "Formatted at 2026-08-09 09:23:08 on dist-test-slave-pgkr"
server_key: "04fe8e71c05395587dd13e0d637fae24"
server_key_iv: "37583a3341ad3d7687ab725fc97a6b9c"
server_key_version: "encryptionkey@0"
I20260809 09:23:08.284384 17002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:08.288710 17002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:08.289251 17002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:08.289413 17002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:08.289919 17002 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:08.290881 17002 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:08.290949 17002 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:08.291010 17002 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:08.291060 17002 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:08.299081 17002 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:42633
I20260809 09:23:08.299146 17145 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:42633 every 8 connection(s)
I20260809 09:23:08.299976 17002 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:23:08.301051 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 17002
I20260809 09:23:08.301173 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance
I20260809 09:23:08.301460 11663 external_mini_cluster.cc:1428] Setting key 2ed4a45bea79bf7257fb14274955840e
I20260809 09:23:08.305366 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:0
--local_ip_for_outbound_sockets=127.11.99.194
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:35389
--builtin_ntp_servers=127.11.99.212:40263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 09:23:08.307116 16975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:08.302378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:55953 (local address 127.11.99.254:35389)
0809 09:23:08.302553 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:08.302557 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:08.303668 (+ 1111us) server_negotiation.cc:407] Connection header received
0809 09:23:08.305302 (+ 1634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:08.305305 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:08.305338 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:08.305404 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:08.306680 (+ 1276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:08.306683 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:08.306685 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:23:08.306697 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:08.306718 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:23:08.306733 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:08.306809 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:08.306977 (+ 168us) server_negotiation.cc:299] Negotiation successful
0809 09:23:08.307014 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 09:23:08.307978 17148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:08.302498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:35389 (local address 127.11.99.193:55953)
0809 09:23:08.303480 (+ 982us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:08.303563 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:08.305083 (+ 1520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:08.305590 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:08.305600 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:08.305703 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:08.306330 (+ 627us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 09:23:08.306334 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:08.306389 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 09:23:08.306475 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:08.306823 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:08.306834 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:08.306843 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 09:23:08.307021 (+ 178us) client_negotiation.cc:240] Negotiation successful
0809 09:23:08.307259 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":170,"threads_started":1}
I20260809 09:23:08.309144 17146 heartbeater.cc:347] Connected to a master server at 127.11.99.254:35389
I20260809 09:23:08.309363 17146 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:08.309755 17146 heartbeater.cc:511] Master 127.11.99.254:35389 requested a full tablet report, sending...
I20260809 09:23:08.311272 16933 ts_manager.cc:194] Registered new tserver with Master: 07b1f12e0dea4081904ce2a563f04574 (127.11.99.193:42633)
W20260809 09:23:08.410844 17149 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:08.411085 17149 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:08.411145 17149 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:08.415143 17149 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:08.415215 17149 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:08.415309 17149 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:23:08.419803 17149 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:40263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:35389
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17149
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:08.420742 17149 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:08.421933 17149 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:08.430905 17157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:08.430882 17154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:08.430867 17155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:08.431222 17149 server_base.cc:1034] running on GCE node
I20260809 09:23:08.431639 17149 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:08.432219 17149 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:08.433418 17149 hybrid_clock.cc:648] HybridClock initialized: now 1786267388433405 us; error 28 us; skew 500 ppm
I20260809 09:23:08.435305 17149 webserver.cc:460] Webserver started at http://127.11.99.194:33981/ using document root <none> and password file <none>
I20260809 09:23:08.435855 17149 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:08.435956 17149 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:08.436167 17149 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:08.438148 17149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-1/data/instance:
uuid: "242e5291bfef4da5a0f06509e5fbd4b1"
format_stamp: "Formatted at 2026-08-09 09:23:08 on dist-test-slave-pgkr"
server_key: "b13e356eae0b95c8e90f39cc6797fcec"
server_key_iv: "7724df0a824a87c1446424dcee2edf5a"
server_key_version: "encryptionkey@0"
I20260809 09:23:08.438798 17149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance:
uuid: "242e5291bfef4da5a0f06509e5fbd4b1"
format_stamp: "Formatted at 2026-08-09 09:23:08 on dist-test-slave-pgkr"
server_key: "b13e356eae0b95c8e90f39cc6797fcec"
server_key_iv: "7724df0a824a87c1446424dcee2edf5a"
server_key_version: "encryptionkey@0"
I20260809 09:23:08.442250 17149 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 09:23:08.444634 17165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:08.445689 17149 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:23:08.445829 17149 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "242e5291bfef4da5a0f06509e5fbd4b1"
format_stamp: "Formatted at 2026-08-09 09:23:08 on dist-test-slave-pgkr"
server_key: "b13e356eae0b95c8e90f39cc6797fcec"
server_key_iv: "7724df0a824a87c1446424dcee2edf5a"
server_key_version: "encryptionkey@0"
I20260809 09:23:08.445936 17149 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:08.450106 17149 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:08.450690 17149 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:08.450876 17149 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:08.451363 17149 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:08.452188 17149 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:08.452272 17149 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:08.452366 17149 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:08.452414 17149 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:08.460633 17149 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:39051
I20260809 09:23:08.460654 17289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:39051 every 8 connection(s)
I20260809 09:23:08.461440 17149 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:23:08.463115 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 17149
I20260809 09:23:08.463240 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance
I20260809 09:23:08.463534 11663 external_mini_cluster.cc:1428] Setting key 9b141f448421bfe2c32513e64dbdd6c6
I20260809 09:23:08.465768 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:0
--local_ip_for_outbound_sockets=127.11.99.195
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:35389
--builtin_ntp_servers=127.11.99.212:40263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 09:23:08.467751 16975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:08.463242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:38763 (local address 127.11.99.254:35389)
0809 09:23:08.463405 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:08.463408 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:08.464594 (+ 1186us) server_negotiation.cc:407] Connection header received
0809 09:23:08.466040 (+ 1446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:08.466043 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:08.466086 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:08.466172 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:08.467322 (+ 1150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:08.467325 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:08.467328 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:23:08.467340 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:08.467360 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:23:08.467375 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:08.467468 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:08.467616 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 09:23:08.467655 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 09:23:08.468914 17292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:08.463698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:35389 (local address 127.11.99.194:38763)
0809 09:23:08.464440 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:08.464491 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:08.465783 (+ 1292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:08.466340 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:08.466346 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:08.466426 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:08.467068 (+ 642us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 09:23:08.467069 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:08.467106 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 09:23:08.467170 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:08.467455 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:08.467463 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:08.467468 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 09:23:08.467647 (+ 179us) client_negotiation.cc:240] Negotiation successful
0809 09:23:08.467905 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":124,"threads_started":1}
I20260809 09:23:08.470027 17290 heartbeater.cc:347] Connected to a master server at 127.11.99.254:35389
I20260809 09:23:08.470258 17290 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:08.470705 17290 heartbeater.cc:511] Master 127.11.99.254:35389 requested a full tablet report, sending...
I20260809 09:23:08.471756 16933 ts_manager.cc:194] Registered new tserver with Master: 242e5291bfef4da5a0f06509e5fbd4b1 (127.11.99.194:39051)
W20260809 09:23:08.573817 17293 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:08.574049 17293 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:08.574087 17293 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:08.577673 17293 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:08.577725 17293 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:08.577776 17293 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:23:08.582267 17293 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:40263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:35389
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17293
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:08.583384 17293 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:08.584661 17293 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:08.594029 17300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:08.594065 17302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:08.594138 17293 server_base.cc:1034] running on GCE node
W20260809 09:23:08.594056 17299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:08.594594 17293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:08.595202 17293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:08.596349 17293 hybrid_clock.cc:648] HybridClock initialized: now 1786267388596338 us; error 23 us; skew 500 ppm
I20260809 09:23:08.598012 17293 webserver.cc:460] Webserver started at http://127.11.99.195:42693/ using document root <none> and password file <none>
I20260809 09:23:08.598549 17293 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:08.598644 17293 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:08.598860 17293 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:08.600776 17293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-2/data/instance:
uuid: "a1bfc73d0179427a951c54f570e3642f"
format_stamp: "Formatted at 2026-08-09 09:23:08 on dist-test-slave-pgkr"
server_key: "046f72f3f312de5c146832635ba91375"
server_key_iv: "76b6d1611f08a2862c479338cfc4dd74"
server_key_version: "encryptionkey@0"
I20260809 09:23:08.601373 17293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance:
uuid: "a1bfc73d0179427a951c54f570e3642f"
format_stamp: "Formatted at 2026-08-09 09:23:08 on dist-test-slave-pgkr"
server_key: "046f72f3f312de5c146832635ba91375"
server_key_iv: "76b6d1611f08a2862c479338cfc4dd74"
server_key_version: "encryptionkey@0"
I20260809 09:23:08.604799 17293 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:23:08.607194 17309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:08.608284 17293 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:23:08.608394 17293 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "a1bfc73d0179427a951c54f570e3642f"
format_stamp: "Formatted at 2026-08-09 09:23:08 on dist-test-slave-pgkr"
server_key: "046f72f3f312de5c146832635ba91375"
server_key_iv: "76b6d1611f08a2862c479338cfc4dd74"
server_key_version: "encryptionkey@0"
I20260809 09:23:08.608494 17293 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:08.612635 17293 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:08.613166 17293 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:08.613327 17293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:08.613797 17293 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:08.614718 17293 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:08.614784 17293 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:08.614856 17293 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:08.614898 17293 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:08.622973 17293 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:45081
I20260809 09:23:08.623006 17433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:45081 every 8 connection(s)
I20260809 09:23:08.623760 17293 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:23:08.629380 16975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:08.625354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:42167 (local address 127.11.99.254:35389)
0809 09:23:08.625480 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:08.625484 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:08.626451 (+ 967us) server_negotiation.cc:407] Connection header received
0809 09:23:08.627751 (+ 1300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:08.627754 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:08.627800 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:08.627914 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:08.628888 (+ 974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:08.628891 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:08.628893 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:23:08.628905 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:08.628943 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:23:08.628951 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:08.629064 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:08.629207 (+ 143us) server_negotiation.cc:299] Negotiation successful
0809 09:23:08.629253 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 09:23:08.630096 17438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:08.625714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:35389 (local address 127.11.99.195:42167)
0809 09:23:08.626290 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:08.626325 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:08.627558 (+ 1233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:08.628055 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:08.628060 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:08.628133 (+ 73us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:08.628641 (+ 508us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 09:23:08.628643 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:08.628676 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 09:23:08.628751 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:08.629058 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:08.629066 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:08.629072 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 09:23:08.629233 (+ 161us) client_negotiation.cc:240] Negotiation successful
0809 09:23:08.629438 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":101,"threads_started":1}
I20260809 09:23:08.631088 17434 heartbeater.cc:347] Connected to a master server at 127.11.99.254:35389
I20260809 09:23:08.631287 17434 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:08.631649 17434 heartbeater.cc:511] Master 127.11.99.254:35389 requested a full tablet report, sending...
I20260809 09:23:08.632587 16933 ts_manager.cc:194] Registered new tserver with Master: a1bfc73d0179427a951c54f570e3642f (127.11.99.195:45081)
I20260809 09:23:08.633253 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 17293
I20260809 09:23:08.633378 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance
I20260809 09:23:08.633677 11663 external_mini_cluster.cc:1428] Setting key 2e4558d9d938f4763e4218497183395f
I20260809 09:23:08.635640 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 09:23:08.638810 16975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:08.637489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56544 (local address 127.11.99.254:35389)
0809 09:23:08.637772 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:08.637799 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:08.637814 (+ 15us) server_negotiation.cc:407] Connection header received
0809 09:23:08.637852 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:08.637854 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:08.637889 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:08.637947 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:08.638477 (+ 530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:08.638480 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:08.638482 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:23:08.638491 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:08.638506 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:23:08.638514 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:08.638580 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:08.638662 (+ 82us) server_negotiation.cc:299] Negotiation successful
0809 09:23:08.638701 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202}
I20260809 09:23:08.641495 16933 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56544:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 09:23:08.644508 16933 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:23:08.655537 17447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:08.652489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:45081 (local address 127.0.0.1:43290)
0809 09:23:08.652843 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:08.652893 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:08.653016 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:08.654078 (+ 1062us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:08.654084 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:08.654153 (+ 69us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:08.654717 (+ 564us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 09:23:08.654719 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:08.654738 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 09:23:08.654801 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:08.655198 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:08.655207 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:08.655211 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 09:23:08.655313 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 09:23:08.655390 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":108,"threads_started":1}
I20260809 09:23:08.655624 17448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:08.652666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43290 (local address 127.11.99.195:45081)
0809 09:23:08.653628 (+ 962us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:08.653640 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:08.653663 (+ 23us) server_negotiation.cc:407] Connection header received
0809 09:23:08.653716 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:08.653724 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:08.653915 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:08.654059 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:08.654964 (+ 905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:08.654973 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:08.655000 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:23:08.655015 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:08.655062 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:23:08.655097 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:08.655216 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:08.655340 (+ 124us) server_negotiation.cc:299] Negotiation successful
0809 09:23:08.655439 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":853,"thread_start_us":91,"threads_started":1}
I20260809 09:23:08.655727 17450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:08.653057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:42633 (local address 127.0.0.1:46924)
0809 09:23:08.653357 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:08.653370 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:08.653445 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:08.654405 (+ 960us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:08.654408 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:08.654423 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:08.654851 (+ 428us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 09:23:08.654855 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:08.654868 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 09:23:08.654900 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:08.655473 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:08.655477 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:08.655481 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 09:23:08.655555 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 09:23:08.655589 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":108,"threads_started":1}
I20260809 09:23:08.656687 17452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:08.653349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46924 (local address 127.11.99.193:42633)
0809 09:23:08.653955 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:08.653965 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:08.653988 (+ 23us) server_negotiation.cc:407] Connection header received
0809 09:23:08.654064 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:08.654069 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:08.654229 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:08.654673 (+ 444us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:08.655256 (+ 583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:08.655260 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:08.655269 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:23:08.655280 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:08.655317 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:23:08.655340 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:08.656403 (+ 1063us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:08.656453 (+ 50us) server_negotiation.cc:299] Negotiation successful
0809 09:23:08.656530 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":159,"threads_started":1}
I20260809 09:23:08.658162 17451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:08.653186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:39051 (local address 127.0.0.1:55920)
0809 09:23:08.654202 (+ 1016us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:08.654215 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:08.654352 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:08.656575 (+ 2223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:08.656579 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:08.656593 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:08.657559 (+ 966us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 09:23:08.657561 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:08.657570 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 09:23:08.657595 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:08.657930 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:08.657933 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:08.657936 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 09:23:08.658011 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 09:23:08.658041 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":958,"thread_start_us":77,"threads_started":1}
I20260809 09:23:08.658254 17454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:08.653639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55920 (local address 127.11.99.194:39051)
0809 09:23:08.654047 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:08.654058 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:08.654289 (+ 231us) server_negotiation.cc:407] Connection header received
0809 09:23:08.654952 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:08.654958 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:08.655105 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:08.655215 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:08.657721 (+ 2506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:08.657727 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:08.657737 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:23:08.657750 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:08.657793 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:23:08.657821 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:08.657943 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:08.658025 (+ 82us) server_negotiation.cc:299] Negotiation successful
0809 09:23:08.658087 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":112,"threads_started":1}
I20260809 09:23:08.658558 17361 tablet_service.cc:1467] Processing CreateTablet for tablet aa136a6a20474aeca4ba798d81333bc5 (DEFAULT_TABLE table=test-table [id=6b90f940dd5e444b9763bb951e0d447f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:08.659790 17361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa136a6a20474aeca4ba798d81333bc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:08.659427 17069 tablet_service.cc:1467] Processing CreateTablet for tablet aa136a6a20474aeca4ba798d81333bc5 (DEFAULT_TABLE table=test-table [id=6b90f940dd5e444b9763bb951e0d447f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:08.660405 17069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa136a6a20474aeca4ba798d81333bc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:08.660758 17218 tablet_service.cc:1467] Processing CreateTablet for tablet aa136a6a20474aeca4ba798d81333bc5 (DEFAULT_TABLE table=test-table [id=6b90f940dd5e444b9763bb951e0d447f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:08.661649 17218 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa136a6a20474aeca4ba798d81333bc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:08.665573 17455 tablet_bootstrap.cc:492] T aa136a6a20474aeca4ba798d81333bc5 P a1bfc73d0179427a951c54f570e3642f: Bootstrap starting.
I20260809 09:23:08.667348 17456 tablet_bootstrap.cc:492] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574: Bootstrap starting.
I20260809 09:23:08.668262 17457 tablet_bootstrap.cc:492] T aa136a6a20474aeca4ba798d81333bc5 P 242e5291bfef4da5a0f06509e5fbd4b1: Bootstrap starting.
I20260809 09:23:08.668880 17455 tablet_bootstrap.cc:654] T aa136a6a20474aeca4ba798d81333bc5 P a1bfc73d0179427a951c54f570e3642f: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:08.669399 17456 tablet_bootstrap.cc:654] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:08.669739 17455 log.cc:824] T aa136a6a20474aeca4ba798d81333bc5 P a1bfc73d0179427a951c54f570e3642f: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:08.670022 17457 tablet_bootstrap.cc:654] T aa136a6a20474aeca4ba798d81333bc5 P 242e5291bfef4da5a0f06509e5fbd4b1: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:08.670157 17456 log.cc:824] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:08.670883 17457 log.cc:824] T aa136a6a20474aeca4ba798d81333bc5 P 242e5291bfef4da5a0f06509e5fbd4b1: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:08.671839 17455 tablet_bootstrap.cc:492] T aa136a6a20474aeca4ba798d81333bc5 P a1bfc73d0179427a951c54f570e3642f: No bootstrap required, opened a new log
I20260809 09:23:08.672020 17456 tablet_bootstrap.cc:492] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574: No bootstrap required, opened a new log
I20260809 09:23:08.672037 17455 ts_tablet_manager.cc:1397] T aa136a6a20474aeca4ba798d81333bc5 P a1bfc73d0179427a951c54f570e3642f: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260809 09:23:08.672207 17456 ts_tablet_manager.cc:1397] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 09:23:08.672713 17457 tablet_bootstrap.cc:492] T aa136a6a20474aeca4ba798d81333bc5 P 242e5291bfef4da5a0f06509e5fbd4b1: No bootstrap required, opened a new log
I20260809 09:23:08.672891 17457 ts_tablet_manager.cc:1397] T aa136a6a20474aeca4ba798d81333bc5 P 242e5291bfef4da5a0f06509e5fbd4b1: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 09:23:08.675606 17455 raft_consensus.cc:348] T aa136a6a20474aeca4ba798d81333bc5 P a1bfc73d0179427a951c54f570e3642f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bfc73d0179427a951c54f570e3642f" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 45081 } } peers { permanent_uuid: "242e5291bfef4da5a0f06509e5fbd4b1" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 39051 } } peers { permanent_uuid: "07b1f12e0dea4081904ce2a563f04574" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 42633 } }
I20260809 09:23:08.675817 17455 raft_consensus.cc:374] T aa136a6a20474aeca4ba798d81333bc5 P a1bfc73d0179427a951c54f570e3642f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:08.675866 17455 raft_consensus.cc:729] T aa136a6a20474aeca4ba798d81333bc5 P a1bfc73d0179427a951c54f570e3642f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1bfc73d0179427a951c54f570e3642f, State: Initialized, Role: FOLLOWER
I20260809 09:23:08.676254 17455 consensus_queue.cc:260] T aa136a6a20474aeca4ba798d81333bc5 P a1bfc73d0179427a951c54f570e3642f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bfc73d0179427a951c54f570e3642f" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 45081 } } peers { permanent_uuid: "242e5291bfef4da5a0f06509e5fbd4b1" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 39051 } } peers { permanent_uuid: "07b1f12e0dea4081904ce2a563f04574" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 42633 } }
I20260809 09:23:08.676551 17456 raft_consensus.cc:348] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bfc73d0179427a951c54f570e3642f" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 45081 } } peers { permanent_uuid: "242e5291bfef4da5a0f06509e5fbd4b1" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 39051 } } peers { permanent_uuid: "07b1f12e0dea4081904ce2a563f04574" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 42633 } }
I20260809 09:23:08.676791 17456 raft_consensus.cc:374] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:08.676815 17434 heartbeater.cc:503] Master 127.11.99.254:35389 was elected leader, sending a full tablet report...
I20260809 09:23:08.676843 17456 raft_consensus.cc:729] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07b1f12e0dea4081904ce2a563f04574, State: Initialized, Role: FOLLOWER
I20260809 09:23:08.677157 17455 ts_tablet_manager.cc:1428] T aa136a6a20474aeca4ba798d81333bc5 P a1bfc73d0179427a951c54f570e3642f: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 09:23:08.677251 17456 consensus_queue.cc:260] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bfc73d0179427a951c54f570e3642f" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 45081 } } peers { permanent_uuid: "242e5291bfef4da5a0f06509e5fbd4b1" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 39051 } } peers { permanent_uuid: "07b1f12e0dea4081904ce2a563f04574" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 42633 } }
I20260809 09:23:08.677187 17457 raft_consensus.cc:348] T aa136a6a20474aeca4ba798d81333bc5 P 242e5291bfef4da5a0f06509e5fbd4b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bfc73d0179427a951c54f570e3642f" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 45081 } } peers { permanent_uuid: "242e5291bfef4da5a0f06509e5fbd4b1" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 39051 } } peers { permanent_uuid: "07b1f12e0dea4081904ce2a563f04574" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 42633 } }
I20260809 09:23:08.677402 17457 raft_consensus.cc:374] T aa136a6a20474aeca4ba798d81333bc5 P 242e5291bfef4da5a0f06509e5fbd4b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:08.677452 17457 raft_consensus.cc:729] T aa136a6a20474aeca4ba798d81333bc5 P 242e5291bfef4da5a0f06509e5fbd4b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 242e5291bfef4da5a0f06509e5fbd4b1, State: Initialized, Role: FOLLOWER
I20260809 09:23:08.677908 17146 heartbeater.cc:503] Master 127.11.99.254:35389 was elected leader, sending a full tablet report...
I20260809 09:23:08.677857 17457 consensus_queue.cc:260] T aa136a6a20474aeca4ba798d81333bc5 P 242e5291bfef4da5a0f06509e5fbd4b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bfc73d0179427a951c54f570e3642f" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 45081 } } peers { permanent_uuid: "242e5291bfef4da5a0f06509e5fbd4b1" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 39051 } } peers { permanent_uuid: "07b1f12e0dea4081904ce2a563f04574" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 42633 } }
I20260809 09:23:08.678156 17456 ts_tablet_manager.cc:1428] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260809 09:23:08.678718 17457 ts_tablet_manager.cc:1428] T aa136a6a20474aeca4ba798d81333bc5 P 242e5291bfef4da5a0f06509e5fbd4b1: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260809 09:23:08.679036 17290 heartbeater.cc:503] Master 127.11.99.254:35389 was elected leader, sending a full tablet report...
W20260809 09:23:08.712423 17291 tablet.cc:2369] T aa136a6a20474aeca4ba798d81333bc5 P 242e5291bfef4da5a0f06509e5fbd4b1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:23:08.779958 17463 raft_consensus.cc:482] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:23:08.780246 17463 raft_consensus.cc:504] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bfc73d0179427a951c54f570e3642f" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 45081 } } peers { permanent_uuid: "242e5291bfef4da5a0f06509e5fbd4b1" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 39051 } } peers { permanent_uuid: "07b1f12e0dea4081904ce2a563f04574" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 42633 } }
I20260809 09:23:08.781378 17463 leader_election.cc:288] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1bfc73d0179427a951c54f570e3642f (127.11.99.195:45081), 242e5291bfef4da5a0f06509e5fbd4b1 (127.11.99.194:39051)
I20260809 09:23:08.783463 17148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:08.781668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:45081 (local address 127.11.99.193:45127)
0809 09:23:08.781800 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:08.781815 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:08.781893 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:08.782284 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:08.782286 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:08.782299 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:08.782848 (+ 549us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 09:23:08.782852 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:08.782866 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 09:23:08.782915 (+ 49us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:08.783203 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:08.783207 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:08.783211 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 09:23:08.783297 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 09:23:08.783335 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 09:23:08.783497 17448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:08.781783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:45127 (local address 127.11.99.195:45081)
0809 09:23:08.781915 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:08.781921 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:08.781939 (+ 18us) server_negotiation.cc:407] Connection header received
0809 09:23:08.781987 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:08.781990 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:08.782029 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:08.782126 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:08.783037 (+ 911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:08.783041 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:08.783045 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:23:08.783062 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:08.783090 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:23:08.783106 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:08.783207 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:08.783303 (+ 96us) server_negotiation.cc:299] Negotiation successful
0809 09:23:08.783362 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 09:23:08.783876 17454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:08.782058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:42229 (local address 127.11.99.194:39051)
0809 09:23:08.782209 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:08.782213 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:08.782430 (+ 217us) server_negotiation.cc:407] Connection header received
0809 09:23:08.782561 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:08.782566 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:08.782629 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:08.782721 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:08.783406 (+ 685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:08.783409 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:08.783412 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:23:08.783423 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:08.783443 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:23:08.783452 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:08.783545 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:08.783721 (+ 176us) server_negotiation.cc:299] Negotiation successful
0809 09:23:08.783765 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 09:23:08.784091 17381 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa136a6a20474aeca4ba798d81333bc5" candidate_uuid: "07b1f12e0dea4081904ce2a563f04574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bfc73d0179427a951c54f570e3642f" is_pre_election: true
I20260809 09:23:08.784269 17465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:08.781946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:39051 (local address 127.11.99.193:42229)
0809 09:23:08.782322 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:08.782334 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:08.782457 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:08.782740 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:08.782743 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:08.782757 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:08.783246 (+ 489us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 09:23:08.783250 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:08.783262 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 09:23:08.783289 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:08.783586 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:08.783592 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:08.783597 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 09:23:08.784068 (+ 471us) client_negotiation.cc:240] Negotiation successful
0809 09:23:08.784110 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":164,"threads_started":1}
I20260809 09:23:08.784430 17381 raft_consensus.cc:2454] T aa136a6a20474aeca4ba798d81333bc5 P a1bfc73d0179427a951c54f570e3642f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07b1f12e0dea4081904ce2a563f04574 in term 0.
I20260809 09:23:08.784920 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa136a6a20474aeca4ba798d81333bc5" candidate_uuid: "07b1f12e0dea4081904ce2a563f04574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "242e5291bfef4da5a0f06509e5fbd4b1" is_pre_election: true
I20260809 09:23:08.784948 17018 leader_election.cc:302] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07b1f12e0dea4081904ce2a563f04574, a1bfc73d0179427a951c54f570e3642f; no voters:
I20260809 09:23:08.785207 17240 raft_consensus.cc:2454] T aa136a6a20474aeca4ba798d81333bc5 P 242e5291bfef4da5a0f06509e5fbd4b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07b1f12e0dea4081904ce2a563f04574 in term 0.
I20260809 09:23:08.785228 17463 raft_consensus.cc:2781] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:23:08.785306 17463 raft_consensus.cc:482] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:23:08.785348 17463 raft_consensus.cc:3037] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:08.786429 17463 raft_consensus.cc:504] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bfc73d0179427a951c54f570e3642f" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 45081 } } peers { permanent_uuid: "242e5291bfef4da5a0f06509e5fbd4b1" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 39051 } } peers { permanent_uuid: "07b1f12e0dea4081904ce2a563f04574" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 42633 } }
I20260809 09:23:08.786780 17463 leader_election.cc:288] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574 [CANDIDATE]: Term 1 election: Requested vote from peers a1bfc73d0179427a951c54f570e3642f (127.11.99.195:45081), 242e5291bfef4da5a0f06509e5fbd4b1 (127.11.99.194:39051)
I20260809 09:23:08.787149 17381 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa136a6a20474aeca4ba798d81333bc5" candidate_uuid: "07b1f12e0dea4081904ce2a563f04574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1bfc73d0179427a951c54f570e3642f"
I20260809 09:23:08.787256 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa136a6a20474aeca4ba798d81333bc5" candidate_uuid: "07b1f12e0dea4081904ce2a563f04574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "242e5291bfef4da5a0f06509e5fbd4b1"
I20260809 09:23:08.787267 17381 raft_consensus.cc:3037] T aa136a6a20474aeca4ba798d81333bc5 P a1bfc73d0179427a951c54f570e3642f [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:08.787396 17240 raft_consensus.cc:3037] T aa136a6a20474aeca4ba798d81333bc5 P 242e5291bfef4da5a0f06509e5fbd4b1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:08.788383 17381 raft_consensus.cc:2454] T aa136a6a20474aeca4ba798d81333bc5 P a1bfc73d0179427a951c54f570e3642f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07b1f12e0dea4081904ce2a563f04574 in term 1.
I20260809 09:23:08.788528 17240 raft_consensus.cc:2454] T aa136a6a20474aeca4ba798d81333bc5 P 242e5291bfef4da5a0f06509e5fbd4b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07b1f12e0dea4081904ce2a563f04574 in term 1.
I20260809 09:23:08.788648 17018 leader_election.cc:302] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07b1f12e0dea4081904ce2a563f04574, a1bfc73d0179427a951c54f570e3642f; no voters:
I20260809 09:23:08.788820 17463 raft_consensus.cc:2781] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:23:08.789047 17463 raft_consensus.cc:686] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574 [term 1 LEADER]: Becoming Leader. State: Replica: 07b1f12e0dea4081904ce2a563f04574, State: Running, Role: LEADER
I20260809 09:23:08.789353 17463 consensus_queue.cc:237] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bfc73d0179427a951c54f570e3642f" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 45081 } } peers { permanent_uuid: "242e5291bfef4da5a0f06509e5fbd4b1" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 39051 } } peers { permanent_uuid: "07b1f12e0dea4081904ce2a563f04574" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 42633 } }
I20260809 09:23:08.792507 16931 catalog_manager.cc:5495] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07b1f12e0dea4081904ce2a563f04574 (127.11.99.193). New cstate: current_term: 1 leader_uuid: "07b1f12e0dea4081904ce2a563f04574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1bfc73d0179427a951c54f570e3642f" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 45081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "242e5291bfef4da5a0f06509e5fbd4b1" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 39051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07b1f12e0dea4081904ce2a563f04574" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 42633 } health_report { overall_health: HEALTHY } } }
W20260809 09:23:08.800966 17147 tablet.cc:2369] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:23:08.806844 17452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:08.805396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46930 (local address 127.11.99.193:42633)
0809 09:23:08.805526 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:08.805531 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:08.805582 (+ 51us) server_negotiation.cc:407] Connection header received
0809 09:23:08.805737 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:08.805740 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:08.805800 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:08.805886 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:08.806452 (+ 566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:08.806454 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:08.806457 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:23:08.806467 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:08.806484 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:23:08.806492 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:08.806584 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:08.806704 (+ 120us) server_negotiation.cc:299] Negotiation successful
0809 09:23:08.806738 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 09:23:08.812037 17381 raft_consensus.cc:1261] T aa136a6a20474aeca4ba798d81333bc5 P a1bfc73d0179427a951c54f570e3642f [term 1 FOLLOWER]: Refusing update from remote peer 07b1f12e0dea4081904ce2a563f04574: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:23:08.812037 17240 raft_consensus.cc:1261] T aa136a6a20474aeca4ba798d81333bc5 P 242e5291bfef4da5a0f06509e5fbd4b1 [term 1 FOLLOWER]: Refusing update from remote peer 07b1f12e0dea4081904ce2a563f04574: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:23:08.812772 17463 consensus_queue.cc:1035] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1bfc73d0179427a951c54f570e3642f" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 45081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:23:08.813009 17466 consensus_queue.cc:1035] T aa136a6a20474aeca4ba798d81333bc5 P 07b1f12e0dea4081904ce2a563f04574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "242e5291bfef4da5a0f06509e5fbd4b1" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 39051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:23:08.823736 17470 mvcc.cc:205] Tried to move back new op lower bound from 7316551224566919168 to 7316551224483717120. Current Snapshot: MvccSnapshot[applied={T|T < 7316551224566919168 or (T in {7316551224566919168})}]
I20260809 09:23:08.828118 16931 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56544:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:23:08.828277 16931 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56544:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:23:08.830528 16931 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f68316ab5401413ab80d3ef9a80bafc1: Sending DeleteTablet for 3 replicas of tablet aa136a6a20474aeca4ba798d81333bc5
I20260809 09:23:08.831341 17069 tablet_service.cc:1514] Processing DeleteTablet for tablet aa136a6a20474aeca4ba798d81333bc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:08 UTC) from {username='slave'} at 127.0.0.1:46924
I20260809 09:23:08.831452 17218 tablet_service.cc:1514] Processing DeleteTablet for tablet aa136a6a20474aeca4ba798d81333bc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:08 UTC) from {username='slave'} at 127.0.0.1:55920
I20260809 09:23:08.831887 17480 tablet_replica.cc:330] T aa136a6a20474aeca4ba798d81333bc5 P 242e5291bfef4da5a0f06509e5fbd4b1: stopping tablet replica
I20260809 09:23:08.831940 17361 tablet_service.cc:1514] Processing DeleteTablet for tablet aa136a6a20474aeca4ba798d81333bc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:08 UTC) from {username='slave'} at 127.0.0.1:43290
I20260809 09:23:08.832183 17480 raft_consensus.cc:2229] T aa136a6a20474aeca4ba798d81333bc5 P 242e5291bfef4da5a0f06509e5fbd4b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:23:08.832341 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 17002
I20260809 09:23:08.834743 17480 raft_consensus.cc:2258] T aa136a6a20474aeca4ba798d81333bc5 P 242e5291bfef4da5a0f06509e5fbd4b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:23:08.836637 17480 ts_tablet_manager.cc:1905] T aa136a6a20474aeca4ba798d81333bc5 P 242e5291bfef4da5a0f06509e5fbd4b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:23:08.838809 17481 tablet_replica.cc:330] T aa136a6a20474aeca4ba798d81333bc5 P a1bfc73d0179427a951c54f570e3642f: stopping tablet replica
I20260809 09:23:08.839083 17481 raft_consensus.cc:2229] T aa136a6a20474aeca4ba798d81333bc5 P a1bfc73d0179427a951c54f570e3642f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:23:08.839385 17481 raft_consensus.cc:2258] T aa136a6a20474aeca4ba798d81333bc5 P a1bfc73d0179427a951c54f570e3642f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:23:08.840041 17480 ts_tablet_manager.cc:1918] T aa136a6a20474aeca4ba798d81333bc5 P 242e5291bfef4da5a0f06509e5fbd4b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:23:08.840143 17480 log.cc:1196] T aa136a6a20474aeca4ba798d81333bc5 P 242e5291bfef4da5a0f06509e5fbd4b1: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/aa136a6a20474aeca4ba798d81333bc5
I20260809 09:23:08.840463 17480 ts_tablet_manager.cc:1939] T aa136a6a20474aeca4ba798d81333bc5 P 242e5291bfef4da5a0f06509e5fbd4b1: Deleting consensus metadata
I20260809 09:23:08.840754 17481 ts_tablet_manager.cc:1905] T aa136a6a20474aeca4ba798d81333bc5 P a1bfc73d0179427a951c54f570e3642f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:23:08.841729 16918 catalog_manager.cc:4841] TS 242e5291bfef4da5a0f06509e5fbd4b1 (127.11.99.194:39051): tablet aa136a6a20474aeca4ba798d81333bc5 (table test-table [id=6b90f940dd5e444b9763bb951e0d447f]) successfully deleted
W20260809 09:23:08.842195 16919 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.99.193:42633 (error 108)
I20260809 09:23:08.842415 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 17149
I20260809 09:23:08.843456 17481 ts_tablet_manager.cc:1918] T aa136a6a20474aeca4ba798d81333bc5 P a1bfc73d0179427a951c54f570e3642f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:23:08.843540 17481 log.cc:1196] T aa136a6a20474aeca4ba798d81333bc5 P a1bfc73d0179427a951c54f570e3642f: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/aa136a6a20474aeca4ba798d81333bc5
I20260809 09:23:08.843741 17451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:08.843397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:42633 (local address 127.0.0.1:46938)
0809 09:23:08.843573 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:08.843645 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.193:42633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260809 09:23:08.843839 17481 ts_tablet_manager.cc:1939] T aa136a6a20474aeca4ba798d81333bc5 P a1bfc73d0179427a951c54f570e3642f: Deleting consensus metadata
W20260809 09:23:08.843851 16919 catalog_manager.cc:4584] TS 07b1f12e0dea4081904ce2a563f04574 (127.11.99.193:42633): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet aa136a6a20474aeca4ba798d81333bc5: Network error: Client connection negotiation failed: client connection to 127.11.99.193:42633: connect: Connection refused (error 111)
I20260809 09:23:08.845001 16918 catalog_manager.cc:4841] TS a1bfc73d0179427a951c54f570e3642f (127.11.99.195:45081): tablet aa136a6a20474aeca4ba798d81333bc5 (table test-table [id=6b90f940dd5e444b9763bb951e0d447f]) successfully deleted
I20260809 09:23:08.850090 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 17293
I20260809 09:23:08.857780 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 16900
2026-08-09T09:23:08Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (951 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260809 09:23:08.880648 11663 mini_oidc.cc:152] Starting JWKS server
I20260809 09:23:08.882378 11663 webserver.cc:460] Webserver started at https://127.0.0.1:32997/ using document root <none> and password file <none>
I20260809 09:23:08.882570 11663 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 09:23:08.882898 11663 webserver.cc:460] Webserver started at http://127.0.0.1:44189/ using document root <none> and password file <none>
2026-08-09T09:23:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:23:08Z Disabled control of system clock
I20260809 09:23:08.892483 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:32861
--webserver_interface=127.11.99.254
--webserver_port=0
--builtin_ntp_servers=127.11.99.212:45857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:32861
--enable_jwt_token_auth=true
--jwks_url=https://localhost:32997/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786267363058776-11663-0/testchainca.cert with env {}
W20260809 09:23:08.994581 17488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:08.994827 17488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:08.994889 17488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:08.998442 17488 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:23:08.998489 17488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:08.998503 17488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:08.998519 17488 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:23:08.998533 17488 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 09:23:08.998584 17488 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 09:23:08.998622 17488 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:32997/jwks.json
I20260809 09:23:09.003532 17488 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:45857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:32861
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:32861
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:32997/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786267363058776-11663-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17488
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:09.004456 17488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:09.005399 17488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:09.013521 17496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:09.013520 17494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:09.013525 17493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:09.013999 17488 server_base.cc:1034] running on GCE node
I20260809 09:23:09.014590 17488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:09.015653 17488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:09.016849 17488 hybrid_clock.cc:648] HybridClock initialized: now 1786267389016832 us; error 29 us; skew 500 ppm
I20260809 09:23:09.018712 17488 webserver.cc:460] Webserver started at http://127.11.99.254:41401/ using document root <none> and password file <none>
I20260809 09:23:09.019279 17488 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:09.019371 17488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:09.019572 17488 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:09.021556 17488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "4d6ef022b045419386e703dcf9ddb29a"
format_stamp: "Formatted at 2026-08-09 09:23:09 on dist-test-slave-pgkr"
server_key: "e36efb480cbfbfaccb623edd901d966e"
server_key_iv: "1f3d54b33637db47a03dfae57c8327e3"
server_key_version: "encryptionkey@0"
I20260809 09:23:09.022146 17488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "4d6ef022b045419386e703dcf9ddb29a"
format_stamp: "Formatted at 2026-08-09 09:23:09 on dist-test-slave-pgkr"
server_key: "e36efb480cbfbfaccb623edd901d966e"
server_key_iv: "1f3d54b33637db47a03dfae57c8327e3"
server_key_version: "encryptionkey@0"
I20260809 09:23:09.025681 17488 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 09:23:09.028028 17503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:09.029260 17488 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 09:23:09.029400 17488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "4d6ef022b045419386e703dcf9ddb29a"
format_stamp: "Formatted at 2026-08-09 09:23:09 on dist-test-slave-pgkr"
server_key: "e36efb480cbfbfaccb623edd901d966e"
server_key_iv: "1f3d54b33637db47a03dfae57c8327e3"
server_key_version: "encryptionkey@0"
I20260809 09:23:09.029510 17488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:09.041864 17488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:09.042462 17488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:09.042711 17488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:09.049342 17488 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:32861
I20260809 09:23:09.049360 17561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:32861 every 8 connection(s)
I20260809 09:23:09.050195 17488 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:23:09.053153 17562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:09.057597 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 17488
I20260809 09:23:09.057739 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:23:09.058007 11663 external_mini_cluster.cc:1428] Setting key c944d16226959586e14814f7ba37bc44
I20260809 09:23:09.058596 17562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d6ef022b045419386e703dcf9ddb29a: Bootstrap starting.
I20260809 09:23:09.060948 17562 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d6ef022b045419386e703dcf9ddb29a: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:09.061677 17562 log.cc:824] T 00000000000000000000000000000000 P 4d6ef022b045419386e703dcf9ddb29a: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:09.063547 17562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d6ef022b045419386e703dcf9ddb29a: No bootstrap required, opened a new log
I20260809 09:23:09.066952 17565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:09.059311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60678 (local address 127.11.99.254:32861)
0809 09:23:09.059908 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:09.059921 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:09.059955 (+ 34us) server_negotiation.cc:407] Connection header received
0809 09:23:09.060564 (+ 609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:09.060579 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:09.060918 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:09.061268 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:09.061688 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:09.062869 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:09.063742 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:09.064197 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:09.064368 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:09.065215 (+ 847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:09.065220 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:09.065231 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:23:09.065608 (+ 377us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:09.065657 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:23:09.065675 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:09.065792 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:09.065939 (+ 147us) server_negotiation.cc:299] Negotiation successful
0809 09:23:09.066168 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":141,"threads_started":1}
I20260809 09:23:09.067445 17562 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d6ef022b045419386e703dcf9ddb29a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d6ef022b045419386e703dcf9ddb29a" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 32861 } }
I20260809 09:23:09.067718 17562 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4d6ef022b045419386e703dcf9ddb29a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:09.067771 17562 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d6ef022b045419386e703dcf9ddb29a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d6ef022b045419386e703dcf9ddb29a, State: Initialized, Role: FOLLOWER
I20260809 09:23:09.068181 17562 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d6ef022b045419386e703dcf9ddb29a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d6ef022b045419386e703dcf9ddb29a" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 32861 } }
I20260809 09:23:09.068300 17562 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4d6ef022b045419386e703dcf9ddb29a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:23:09.068384 17562 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d6ef022b045419386e703dcf9ddb29a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:23:09.068516 17562 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d6ef022b045419386e703dcf9ddb29a [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:09.069495 17562 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d6ef022b045419386e703dcf9ddb29a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d6ef022b045419386e703dcf9ddb29a" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 32861 } }
I20260809 09:23:09.069686 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 09:23:09.069870 17562 leader_election.cc:302] T 00000000000000000000000000000000 P 4d6ef022b045419386e703dcf9ddb29a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4d6ef022b045419386e703dcf9ddb29a; no voters:
I20260809 09:23:09.070181 17562 leader_election.cc:288] T 00000000000000000000000000000000 P 4d6ef022b045419386e703dcf9ddb29a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:23:09.070291 17567 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d6ef022b045419386e703dcf9ddb29a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:23:09.070498 17567 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4d6ef022b045419386e703dcf9ddb29a [term 1 LEADER]: Becoming Leader. State: Replica: 4d6ef022b045419386e703dcf9ddb29a, State: Running, Role: LEADER
I20260809 09:23:09.070815 17567 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d6ef022b045419386e703dcf9ddb29a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d6ef022b045419386e703dcf9ddb29a" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 32861 } }
I20260809 09:23:09.071379 17562 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d6ef022b045419386e703dcf9ddb29a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:23:09.072592 17570 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d6ef022b045419386e703dcf9ddb29a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d6ef022b045419386e703dcf9ddb29a. Latest consensus state: current_term: 1 leader_uuid: "4d6ef022b045419386e703dcf9ddb29a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d6ef022b045419386e703dcf9ddb29a" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 32861 } } }
I20260809 09:23:09.072593 17569 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d6ef022b045419386e703dcf9ddb29a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4d6ef022b045419386e703dcf9ddb29a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d6ef022b045419386e703dcf9ddb29a" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 32861 } } }
I20260809 09:23:09.072734 17570 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d6ef022b045419386e703dcf9ddb29a [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:09.072790 17569 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d6ef022b045419386e703dcf9ddb29a [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:09.073149 17577 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:23:09.076314 17577 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:23:09.082423 17577 catalog_manager.cc:1347] Generated new cluster ID: 6d54f210142745b39999aa8a5b0d4c80
I20260809 09:23:09.082490 17577 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:23:09.099793 17577 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:23:09.100615 17577 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:23:09.106871 17577 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4d6ef022b045419386e703dcf9ddb29a: Generated new TSK 0
I20260809 09:23:09.107578 17577 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 09:23:09.140373 17594 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260809 09:23:09.140477 17594 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 09:23:09.141028 17565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:09.124352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60690 (local address 127.11.99.254:32861)
0809 09:23:09.124491 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:09.124497 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:09.124668 (+ 171us) server_negotiation.cc:407] Connection header received
0809 09:23:09.124857 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:09.124860 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:09.124920 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:09.125047 (+ 127us) server_negotiation.cc:226] Negotiated authn=JWT
0809 09:23:09.125268 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:09.126106 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:09.126994 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:09.127333 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:09.127437 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:09.127735 (+ 298us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 09:23:09.140660 (+ 12925us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32997/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 09:23:09.140887 (+ 227us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60690: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32997/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":55}
W20260809 09:23:09.141106 17565 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60690: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32997/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260809 09:23:09.142138 17593 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:09.124183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:32861 (local address 127.0.0.1:60690)
0809 09:23:09.124585 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:09.124597 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:09.124701 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:09.125053 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:09.125056 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:09.125062 (+ 6us) client_negotiation.cc:189] Negotiated authn=JWT
0809 09:23:09.125165 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:09.125170 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:09.126213 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:09.126215 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:09.126878 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:09.126887 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:09.127454 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:09.127457 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:09.127522 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:09.127573 (+ 51us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 09:23:09.140828 (+ 13255us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32997/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 09:23:09.140985 (+ 157us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.99.254:32861: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32997/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":110,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.11.99.254:32861: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32997/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260809 09:23:09.142889 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 17488
2026-08-09T09:23:09Z chronyd exiting
I20260809 09:23:09.182788 11663 test_util.cc:175] -----------------------------------------------
I20260809 09:23:09.182868 11663 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786267363058776-11663-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (304 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260809 09:23:09.183961 11663 mini_oidc.cc:152] Starting JWKS server
I20260809 09:23:09.184779 11663 webserver.cc:460] Webserver started at https://127.0.0.1:32791/ using document root <none> and password file <none>
I20260809 09:23:09.184883 11663 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 09:23:09.185180 11663 webserver.cc:460] Webserver started at http://127.0.0.1:41341/ using document root <none> and password file <none>
2026-08-09T09:23:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:23:09Z Disabled control of system clock
I20260809 09:23:09.194312 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:36713
--webserver_interface=127.11.99.254
--webserver_port=0
--builtin_ntp_servers=127.11.99.212:33049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:36713
--enable_jwt_token_auth=true
--jwks_url=https://localhost:32791/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786267363058776-11663-0/testchainca.cert with env {}
W20260809 09:23:09.302163 17601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:09.302394 17601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:09.302429 17601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:09.307381 17601 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:23:09.307438 17601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:09.307454 17601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:09.307471 17601 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:23:09.307487 17601 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 09:23:09.307507 17601 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 09:23:09.307554 17601 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:32791/jwks.json
I20260809 09:23:09.312789 17601 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:33049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:36713
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:36713
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:32791/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786267363058776-11663-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17601
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:09.313740 17601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:09.314740 17601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:09.322783 17606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:09.322834 17601 server_base.cc:1034] running on GCE node
W20260809 09:23:09.322852 17608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:09.322794 17610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:09.323478 17601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:09.324465 17601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:09.325656 17601 hybrid_clock.cc:648] HybridClock initialized: now 1786267389325639 us; error 28 us; skew 500 ppm
I20260809 09:23:09.327351 17601 webserver.cc:460] Webserver started at http://127.11.99.254:43331/ using document root <none> and password file <none>
I20260809 09:23:09.327875 17601 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:09.327963 17601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:09.328181 17601 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:09.330231 17601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "dba76061806e4a029c37c90aca278a6a"
format_stamp: "Formatted at 2026-08-09 09:23:09 on dist-test-slave-pgkr"
server_key: "cb3d7cd44dc80215218c6594b7cd6410"
server_key_iv: "5f7f9fe3e8a1ef6af5ed55d232c8c459"
server_key_version: "encryptionkey@0"
I20260809 09:23:09.330868 17601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "dba76061806e4a029c37c90aca278a6a"
format_stamp: "Formatted at 2026-08-09 09:23:09 on dist-test-slave-pgkr"
server_key: "cb3d7cd44dc80215218c6594b7cd6410"
server_key_iv: "5f7f9fe3e8a1ef6af5ed55d232c8c459"
server_key_version: "encryptionkey@0"
I20260809 09:23:09.334406 17601 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260809 09:23:09.336649 17616 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:09.337747 17601 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:23:09.337888 17601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "dba76061806e4a029c37c90aca278a6a"
format_stamp: "Formatted at 2026-08-09 09:23:09 on dist-test-slave-pgkr"
server_key: "cb3d7cd44dc80215218c6594b7cd6410"
server_key_iv: "5f7f9fe3e8a1ef6af5ed55d232c8c459"
server_key_version: "encryptionkey@0"
I20260809 09:23:09.337989 17601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:09.354101 17601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:09.354753 17601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:09.354957 17601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:09.361219 17601 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:36713
I20260809 09:23:09.361235 17673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:36713 every 8 connection(s)
I20260809 09:23:09.362043 17601 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:23:09.365106 17674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:09.370003 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 17601
I20260809 09:23:09.370071 17674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dba76061806e4a029c37c90aca278a6a: Bootstrap starting.
I20260809 09:23:09.370168 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:23:09.370424 11663 external_mini_cluster.cc:1428] Setting key e11756fe67e2283f0ba64fbe9de74e3a
I20260809 09:23:09.372432 17674 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dba76061806e4a029c37c90aca278a6a: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:09.373126 17674 log.cc:824] T 00000000000000000000000000000000 P dba76061806e4a029c37c90aca278a6a: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:09.374922 17674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dba76061806e4a029c37c90aca278a6a: No bootstrap required, opened a new log
I20260809 09:23:09.378333 17674 raft_consensus.cc:348] T 00000000000000000000000000000000 P dba76061806e4a029c37c90aca278a6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dba76061806e4a029c37c90aca278a6a" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 36713 } }
I20260809 09:23:09.378558 17674 raft_consensus.cc:374] T 00000000000000000000000000000000 P dba76061806e4a029c37c90aca278a6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:09.378641 17674 raft_consensus.cc:729] T 00000000000000000000000000000000 P dba76061806e4a029c37c90aca278a6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba76061806e4a029c37c90aca278a6a, State: Initialized, Role: FOLLOWER
I20260809 09:23:09.378911 17677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:09.371670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38556 (local address 127.11.99.254:36713)
0809 09:23:09.372209 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:09.372222 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:09.372263 (+ 41us) server_negotiation.cc:407] Connection header received
0809 09:23:09.372886 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:09.372902 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:09.373266 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:09.373596 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:09.373987 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:09.374939 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:09.375804 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:09.376240 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:09.376425 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:09.377240 (+ 815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:09.377245 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:09.377255 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:23:09.377583 (+ 328us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:09.377642 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:23:09.377660 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:09.377763 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:09.377905 (+ 142us) server_negotiation.cc:299] Negotiation successful
0809 09:23:09.378127 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":106,"threads_started":1}
I20260809 09:23:09.379097 17674 consensus_queue.cc:260] T 00000000000000000000000000000000 P dba76061806e4a029c37c90aca278a6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dba76061806e4a029c37c90aca278a6a" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 36713 } }
I20260809 09:23:09.379256 17674 raft_consensus.cc:388] T 00000000000000000000000000000000 P dba76061806e4a029c37c90aca278a6a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:23:09.379320 17674 raft_consensus.cc:482] T 00000000000000000000000000000000 P dba76061806e4a029c37c90aca278a6a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:23:09.379405 17674 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dba76061806e4a029c37c90aca278a6a [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:09.380271 17674 raft_consensus.cc:504] T 00000000000000000000000000000000 P dba76061806e4a029c37c90aca278a6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dba76061806e4a029c37c90aca278a6a" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 36713 } }
I20260809 09:23:09.380661 17674 leader_election.cc:302] T 00000000000000000000000000000000 P dba76061806e4a029c37c90aca278a6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dba76061806e4a029c37c90aca278a6a; no voters:
I20260809 09:23:09.380992 17674 leader_election.cc:288] T 00000000000000000000000000000000 P dba76061806e4a029c37c90aca278a6a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:23:09.381067 17679 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dba76061806e4a029c37c90aca278a6a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:23:09.381263 17679 raft_consensus.cc:686] T 00000000000000000000000000000000 P dba76061806e4a029c37c90aca278a6a [term 1 LEADER]: Becoming Leader. State: Replica: dba76061806e4a029c37c90aca278a6a, State: Running, Role: LEADER
I20260809 09:23:09.381551 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 09:23:09.381549 17679 consensus_queue.cc:237] T 00000000000000000000000000000000 P dba76061806e4a029c37c90aca278a6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dba76061806e4a029c37c90aca278a6a" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 36713 } }
I20260809 09:23:09.382153 17674 sys_catalog.cc:564] T 00000000000000000000000000000000 P dba76061806e4a029c37c90aca278a6a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:23:09.382462 17679 sys_catalog.cc:455] T 00000000000000000000000000000000 P dba76061806e4a029c37c90aca278a6a [sys.catalog]: SysCatalogTable state changed. Reason: New leader dba76061806e4a029c37c90aca278a6a. Latest consensus state: current_term: 1 leader_uuid: "dba76061806e4a029c37c90aca278a6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dba76061806e4a029c37c90aca278a6a" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 36713 } } }
I20260809 09:23:09.382586 17679 sys_catalog.cc:458] T 00000000000000000000000000000000 P dba76061806e4a029c37c90aca278a6a [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:09.383046 17680 sys_catalog.cc:455] T 00000000000000000000000000000000 P dba76061806e4a029c37c90aca278a6a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dba76061806e4a029c37c90aca278a6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dba76061806e4a029c37c90aca278a6a" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 36713 } } }
I20260809 09:23:09.383173 17683 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:23:09.383213 17680 sys_catalog.cc:458] T 00000000000000000000000000000000 P dba76061806e4a029c37c90aca278a6a [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:09.385859 17683 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:23:09.390298 17683 catalog_manager.cc:1347] Generated new cluster ID: 548fcd2e4d134336b6b231aa8ea64cb5
I20260809 09:23:09.390357 17683 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:23:09.397899 17683 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:23:09.398949 17683 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:23:09.403211 17683 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dba76061806e4a029c37c90aca278a6a: Generated new TSK 0
I20260809 09:23:09.403862 17683 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 09:23:09.427632 17707 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260809 09:23:09.427706 17707 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 09:23:09.428328 17677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:09.411456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38570 (local address 127.11.99.254:36713)
0809 09:23:09.411578 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:09.411584 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:09.411804 (+ 220us) server_negotiation.cc:407] Connection header received
0809 09:23:09.411977 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:09.411979 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:09.412020 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:09.412121 (+ 101us) server_negotiation.cc:226] Negotiated authn=JWT
0809 09:23:09.412370 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:09.412856 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:09.413744 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:09.413954 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:09.414056 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:09.414341 (+ 285us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 09:23:09.427952 (+ 13611us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32791/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 09:23:09.428181 (+ 229us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38570: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32791/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":49}
W20260809 09:23:09.428390 17677 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38570: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32791/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260809 09:23:09.428416 17706 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:09.411377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:36713 (local address 127.0.0.1:38570)
0809 09:23:09.411711 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:09.411722 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:09.411848 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:09.412129 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:09.412132 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:09.412140 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0809 09:23:09.412266 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:09.412271 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:09.412976 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:09.412980 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:09.413611 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:09.413618 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:09.414064 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:09.414067 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:09.414160 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:09.414186 (+ 26us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 09:23:09.428100 (+ 13914us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32791/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 09:23:09.428257 (+ 157us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.99.254:36713: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32791/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":96,"threads_started":1}
I20260809 09:23:09.429024 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 17601
2026-08-09T09:23:09Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (285 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260809 09:23:09.469972 11663 mini_oidc.cc:152] Starting JWKS server
I20260809 09:23:09.470886 11663 webserver.cc:460] Webserver started at https://127.0.0.1:36217/ using document root <none> and password file <none>
I20260809 09:23:09.471010 11663 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 09:23:09.471277 11663 webserver.cc:460] Webserver started at http://127.0.0.1:45845/ using document root <none> and password file <none>
2026-08-09T09:23:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:23:09Z Disabled control of system clock
I20260809 09:23:09.480705 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:39785
--webserver_interface=127.11.99.254
--webserver_port=0
--builtin_ntp_servers=127.11.99.212:34915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:39785
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36217/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 09:23:09.586434 17713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:09.586709 17713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:09.586748 17713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:09.590632 17713 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:23:09.590698 17713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:09.590718 17713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:09.590737 17713 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:23:09.590756 17713 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 09:23:09.590782 17713 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 09:23:09.590801 17713 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36217/jwks.json
I20260809 09:23:09.595772 17713 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:34915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:39785
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:39785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36217/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17713
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:09.596717 17713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:09.598023 17713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:09.605950 17721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:09.605926 17718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:09.605926 17719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:09.606109 17713 server_base.cc:1034] running on GCE node
I20260809 09:23:09.606884 17713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:09.607944 17713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:09.609112 17713 hybrid_clock.cc:648] HybridClock initialized: now 1786267389609088 us; error 35 us; skew 500 ppm
I20260809 09:23:09.610962 17713 webserver.cc:460] Webserver started at http://127.11.99.254:41727/ using document root <none> and password file <none>
I20260809 09:23:09.611474 17713 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:09.611565 17713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:09.611786 17713 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:09.613888 17713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "05ee22d9eedc4720bf7076b000f2dc0e"
format_stamp: "Formatted at 2026-08-09 09:23:09 on dist-test-slave-pgkr"
server_key: "7290a1c3a8157e2c64c2ddf18fba760e"
server_key_iv: "a3d06116e1b11a6eea8b6b5b4e1c3200"
server_key_version: "encryptionkey@0"
I20260809 09:23:09.614498 17713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "05ee22d9eedc4720bf7076b000f2dc0e"
format_stamp: "Formatted at 2026-08-09 09:23:09 on dist-test-slave-pgkr"
server_key: "7290a1c3a8157e2c64c2ddf18fba760e"
server_key_iv: "a3d06116e1b11a6eea8b6b5b4e1c3200"
server_key_version: "encryptionkey@0"
I20260809 09:23:09.618098 17713 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 09:23:09.620354 17728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:09.621556 17713 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:23:09.621714 17713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "05ee22d9eedc4720bf7076b000f2dc0e"
format_stamp: "Formatted at 2026-08-09 09:23:09 on dist-test-slave-pgkr"
server_key: "7290a1c3a8157e2c64c2ddf18fba760e"
server_key_iv: "a3d06116e1b11a6eea8b6b5b4e1c3200"
server_key_version: "encryptionkey@0"
I20260809 09:23:09.621834 17713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:09.638101 17713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:09.638736 17713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:09.638919 17713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:09.645900 17713 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:39785
I20260809 09:23:09.645926 17786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:39785 every 8 connection(s)
I20260809 09:23:09.646848 17713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:23:09.649327 17788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:09.654238 17788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05ee22d9eedc4720bf7076b000f2dc0e: Bootstrap starting.
I20260809 09:23:09.656095 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 17713
I20260809 09:23:09.656236 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:23:09.656504 11663 external_mini_cluster.cc:1428] Setting key 58ba8be9823f54064ee8f7dba5905c24
I20260809 09:23:09.656538 17788 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05ee22d9eedc4720bf7076b000f2dc0e: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:09.657377 17788 log.cc:824] T 00000000000000000000000000000000 P 05ee22d9eedc4720bf7076b000f2dc0e: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:09.659538 17788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05ee22d9eedc4720bf7076b000f2dc0e: No bootstrap required, opened a new log
I20260809 09:23:09.662950 17788 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05ee22d9eedc4720bf7076b000f2dc0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05ee22d9eedc4720bf7076b000f2dc0e" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39785 } }
I20260809 09:23:09.663182 17788 raft_consensus.cc:374] T 00000000000000000000000000000000 P 05ee22d9eedc4720bf7076b000f2dc0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:09.663252 17788 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05ee22d9eedc4720bf7076b000f2dc0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05ee22d9eedc4720bf7076b000f2dc0e, State: Initialized, Role: FOLLOWER
I20260809 09:23:09.663695 17788 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05ee22d9eedc4720bf7076b000f2dc0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05ee22d9eedc4720bf7076b000f2dc0e" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39785 } }
I20260809 09:23:09.663851 17788 raft_consensus.cc:388] T 00000000000000000000000000000000 P 05ee22d9eedc4720bf7076b000f2dc0e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:23:09.663942 17788 raft_consensus.cc:482] T 00000000000000000000000000000000 P 05ee22d9eedc4720bf7076b000f2dc0e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:23:09.664062 17788 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05ee22d9eedc4720bf7076b000f2dc0e [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:09.664986 17793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:09.657559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52904 (local address 127.11.99.254:39785)
0809 09:23:09.658281 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:09.658302 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:09.658342 (+ 40us) server_negotiation.cc:407] Connection header received
0809 09:23:09.659028 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:09.659045 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:09.659341 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:09.659650 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:09.660055 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:09.660999 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:09.661872 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:09.662289 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:09.662443 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:09.663308 (+ 865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:09.663316 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:09.663333 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:23:09.663779 (+ 446us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:09.663829 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:23:09.663869 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:09.663962 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:09.664082 (+ 120us) server_negotiation.cc:299] Negotiation successful
0809 09:23:09.664335 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":165,"threads_started":1}
I20260809 09:23:09.664973 17788 raft_consensus.cc:504] T 00000000000000000000000000000000 P 05ee22d9eedc4720bf7076b000f2dc0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05ee22d9eedc4720bf7076b000f2dc0e" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39785 } }
I20260809 09:23:09.665375 17788 leader_election.cc:302] T 00000000000000000000000000000000 P 05ee22d9eedc4720bf7076b000f2dc0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05ee22d9eedc4720bf7076b000f2dc0e; no voters:
I20260809 09:23:09.665723 17788 leader_election.cc:288] T 00000000000000000000000000000000 P 05ee22d9eedc4720bf7076b000f2dc0e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:23:09.665793 17794 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 05ee22d9eedc4720bf7076b000f2dc0e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:23:09.666764 17794 raft_consensus.cc:686] T 00000000000000000000000000000000 P 05ee22d9eedc4720bf7076b000f2dc0e [term 1 LEADER]: Becoming Leader. State: Replica: 05ee22d9eedc4720bf7076b000f2dc0e, State: Running, Role: LEADER
I20260809 09:23:09.666857 17788 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05ee22d9eedc4720bf7076b000f2dc0e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:23:09.667034 17794 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05ee22d9eedc4720bf7076b000f2dc0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05ee22d9eedc4720bf7076b000f2dc0e" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39785 } }
I20260809 09:23:09.667913 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 09:23:09.669399 17795 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05ee22d9eedc4720bf7076b000f2dc0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05ee22d9eedc4720bf7076b000f2dc0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05ee22d9eedc4720bf7076b000f2dc0e" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39785 } } }
I20260809 09:23:09.669525 17795 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05ee22d9eedc4720bf7076b000f2dc0e [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:09.669840 17796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05ee22d9eedc4720bf7076b000f2dc0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05ee22d9eedc4720bf7076b000f2dc0e. Latest consensus state: current_term: 1 leader_uuid: "05ee22d9eedc4720bf7076b000f2dc0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05ee22d9eedc4720bf7076b000f2dc0e" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39785 } } }
I20260809 09:23:09.669952 17796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05ee22d9eedc4720bf7076b000f2dc0e [sys.catalog]: This master's current role is: LEADER
W20260809 09:23:09.672048 17808 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 05ee22d9eedc4720bf7076b000f2dc0e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 09:23:09.672137 17808 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 09:23:09.672205 17810 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:23:09.672904 17810 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:23:09.677979 17810 catalog_manager.cc:1347] Generated new cluster ID: 8bb4ee9258fc4ca998940b0ea9d0c6e1
I20260809 09:23:09.678043 17810 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:23:09.693248 17810 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:23:09.694386 17810 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:23:09.706314 17810 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 05ee22d9eedc4720bf7076b000f2dc0e: Generated new TSK 0
I20260809 09:23:09.706959 17810 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:23:09.719452 17793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:09.714641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52920 (local address 127.11.99.254:39785)
0809 09:23:09.714760 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:09.714765 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:09.714957 (+ 192us) server_negotiation.cc:407] Connection header received
0809 09:23:09.715115 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:09.715117 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:09.715163 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:09.715251 (+ 88us) server_negotiation.cc:226] Negotiated authn=JWT
0809 09:23:09.715480 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:09.715971 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:09.717148 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:09.717344 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:09.717421 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:09.717857 (+ 436us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 09:23:09.719114 (+ 1257us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36217/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 09:23:09.719354 (+ 240us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52920: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36217/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":35}
W20260809 09:23:09.719527 17793 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52920: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36217/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260809 09:23:09.722362 17822 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:09.714533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:39785 (local address 127.0.0.1:52920)
0809 09:23:09.714866 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:09.714880 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:09.714993 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:09.715271 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:09.715274 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:09.715281 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0809 09:23:09.715386 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:09.715391 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:09.716089 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:09.716092 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:09.717041 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:09.717051 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:09.717477 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:09.717480 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:09.717575 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:09.717601 (+ 26us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 09:23:09.719275 (+ 1674us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36217/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 09:23:09.722215 (+ 2940us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.99.254:39785: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36217/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":250,"mutex_wait_us":2768,"thread_start_us":141,"threads_started":1}
I20260809 09:23:09.722972 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 17713
E20260809 09:23:09.732100 17823 webserver.cc:533] Webserver: sslize failed:
E20260809 09:23:09.732152 17823 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-09T09:23:09Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (294 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-09T09:23:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:23:09Z Disabled control of system clock
I20260809 09:23:09.772873 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:34209
--webserver_interface=127.11.99.254
--webserver_port=0
--builtin_ntp_servers=127.11.99.212:38105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:34209
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786267363058776-11663-0/testchainca.cert with env {}
W20260809 09:23:09.876974 17829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:09.877269 17829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:09.877323 17829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:09.881222 17829 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:23:09.881280 17829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:09.881295 17829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:09.881311 17829 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:23:09.881325 17829 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 09:23:09.881340 17829 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 09:23:09.881353 17829 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260809 09:23:09.886147 17829 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:38105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:34209
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:34209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786267363058776-11663-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17829
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:09.887194 17829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:09.888183 17829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:09.896222 17837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:09.896248 17835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:09.896353 17829 server_base.cc:1034] running on GCE node
W20260809 09:23:09.896222 17834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:09.896936 17829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:09.897884 17829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:09.899039 17829 hybrid_clock.cc:648] HybridClock initialized: now 1786267389899014 us; error 37 us; skew 500 ppm
I20260809 09:23:09.900694 17829 webserver.cc:460] Webserver started at http://127.11.99.254:37909/ using document root <none> and password file <none>
I20260809 09:23:09.901245 17829 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:09.901304 17829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:09.901561 17829 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:09.903412 17829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "9213cc6ab4ce43eda07d6a77a5b63490"
format_stamp: "Formatted at 2026-08-09 09:23:09 on dist-test-slave-pgkr"
server_key: "3c9a8fee208acb62b6d3f32c2edceb65"
server_key_iv: "eaf7b64e31ee050db6cd3d712d240706"
server_key_version: "encryptionkey@0"
I20260809 09:23:09.903978 17829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "9213cc6ab4ce43eda07d6a77a5b63490"
format_stamp: "Formatted at 2026-08-09 09:23:09 on dist-test-slave-pgkr"
server_key: "3c9a8fee208acb62b6d3f32c2edceb65"
server_key_iv: "eaf7b64e31ee050db6cd3d712d240706"
server_key_version: "encryptionkey@0"
I20260809 09:23:09.907586 17829 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260809 09:23:09.909788 17844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:09.911023 17829 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 09:23:09.911140 17829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "9213cc6ab4ce43eda07d6a77a5b63490"
format_stamp: "Formatted at 2026-08-09 09:23:09 on dist-test-slave-pgkr"
server_key: "3c9a8fee208acb62b6d3f32c2edceb65"
server_key_iv: "eaf7b64e31ee050db6cd3d712d240706"
server_key_version: "encryptionkey@0"
I20260809 09:23:09.911238 17829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:09.930444 17829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:09.931068 17829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:09.931233 17829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:09.937631 17829 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:34209
I20260809 09:23:09.937638 17900 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:34209 every 8 connection(s)
I20260809 09:23:09.938534 17829 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:23:09.941195 17901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:09.946156 17901 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9213cc6ab4ce43eda07d6a77a5b63490: Bootstrap starting.
I20260809 09:23:09.948477 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 17829
I20260809 09:23:09.948516 17901 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9213cc6ab4ce43eda07d6a77a5b63490: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:09.948629 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:23:09.948933 11663 external_mini_cluster.cc:1428] Setting key 16b0a5c40aa0e1489cf9d90604f6c14f
I20260809 09:23:09.949335 17901 log.cc:824] T 00000000000000000000000000000000 P 9213cc6ab4ce43eda07d6a77a5b63490: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:09.951283 17901 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9213cc6ab4ce43eda07d6a77a5b63490: No bootstrap required, opened a new log
I20260809 09:23:09.955191 17901 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9213cc6ab4ce43eda07d6a77a5b63490 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9213cc6ab4ce43eda07d6a77a5b63490" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34209 } }
I20260809 09:23:09.955451 17901 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9213cc6ab4ce43eda07d6a77a5b63490 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:09.955531 17901 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9213cc6ab4ce43eda07d6a77a5b63490 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9213cc6ab4ce43eda07d6a77a5b63490, State: Initialized, Role: FOLLOWER
I20260809 09:23:09.955955 17901 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9213cc6ab4ce43eda07d6a77a5b63490 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9213cc6ab4ce43eda07d6a77a5b63490" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34209 } }
I20260809 09:23:09.956106 17901 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9213cc6ab4ce43eda07d6a77a5b63490 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:23:09.956188 17901 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9213cc6ab4ce43eda07d6a77a5b63490 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:23:09.956302 17901 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9213cc6ab4ce43eda07d6a77a5b63490 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:09.957242 17901 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9213cc6ab4ce43eda07d6a77a5b63490 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9213cc6ab4ce43eda07d6a77a5b63490" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34209 } }
I20260809 09:23:09.957561 17901 leader_election.cc:302] T 00000000000000000000000000000000 P 9213cc6ab4ce43eda07d6a77a5b63490 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9213cc6ab4ce43eda07d6a77a5b63490; no voters:
I20260809 09:23:09.957623 17905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:09.949998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34548 (local address 127.11.99.254:34209)
0809 09:23:09.950599 (+ 601us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:09.950667 (+ 68us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:09.950702 (+ 35us) server_negotiation.cc:407] Connection header received
0809 09:23:09.951275 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:09.951290 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:09.951627 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:09.951882 (+ 255us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:09.952211 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:09.953150 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:09.954423 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:09.954903 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:09.955019 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:09.955884 (+ 865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:09.955889 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:09.955899 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:23:09.956314 (+ 415us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:09.956371 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:23:09.956413 (+ 42us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:09.956495 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:09.956662 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 09:23:09.956917 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":149,"threads_started":1}
I20260809 09:23:09.957888 17901 leader_election.cc:288] T 00000000000000000000000000000000 P 9213cc6ab4ce43eda07d6a77a5b63490 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:23:09.957980 17906 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9213cc6ab4ce43eda07d6a77a5b63490 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:23:09.958199 17906 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9213cc6ab4ce43eda07d6a77a5b63490 [term 1 LEADER]: Becoming Leader. State: Replica: 9213cc6ab4ce43eda07d6a77a5b63490, State: Running, Role: LEADER
I20260809 09:23:09.958485 17906 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9213cc6ab4ce43eda07d6a77a5b63490 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9213cc6ab4ce43eda07d6a77a5b63490" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34209 } }
I20260809 09:23:09.958973 17901 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9213cc6ab4ce43eda07d6a77a5b63490 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:23:09.960191 17908 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9213cc6ab4ce43eda07d6a77a5b63490 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9213cc6ab4ce43eda07d6a77a5b63490. Latest consensus state: current_term: 1 leader_uuid: "9213cc6ab4ce43eda07d6a77a5b63490" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9213cc6ab4ce43eda07d6a77a5b63490" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34209 } } }
I20260809 09:23:09.960142 17907 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9213cc6ab4ce43eda07d6a77a5b63490 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9213cc6ab4ce43eda07d6a77a5b63490" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9213cc6ab4ce43eda07d6a77a5b63490" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34209 } } }
I20260809 09:23:09.960286 17907 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9213cc6ab4ce43eda07d6a77a5b63490 [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:09.960286 17908 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9213cc6ab4ce43eda07d6a77a5b63490 [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:09.960677 17916 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:23:09.960708 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 09:23:09.963507 17916 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:23:09.968137 17916 catalog_manager.cc:1347] Generated new cluster ID: a2ee91cef95d43c29062dd34d09b412f
I20260809 09:23:09.968194 17916 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:23:09.992183 17916 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:23:09.993116 17916 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:23:10.000689 17916 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9213cc6ab4ce43eda07d6a77a5b63490: Generated new TSK 0
I20260809 09:23:10.001304 17916 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:23:10.073367 17905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:10.009499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34550 (local address 127.11.99.254:34209)
0809 09:23:10.009627 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:10.009631 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:10.009769 (+ 138us) server_negotiation.cc:407] Connection header received
0809 09:23:10.009902 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:10.009905 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:10.009959 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:10.010067 (+ 108us) server_negotiation.cc:226] Negotiated authn=JWT
0809 09:23:10.010268 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:10.011104 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:10.011907 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:10.012256 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:10.012384 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:10.012641 (+ 257us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 09:23:10.072887 (+ 60246us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 09:23:10.073218 (+ 331us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34550: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":53}
W20260809 09:23:10.073479 17905 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34550: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260809 09:23:10.073535 17932 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:10.009367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34209 (local address 127.0.0.1:34550)
0809 09:23:10.009684 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:10.009696 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:10.009785 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:10.010071 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:10.010073 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:10.010078 (+ 5us) client_negotiation.cc:189] Negotiated authn=JWT
0809 09:23:10.010164 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:10.010168 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:10.011209 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:10.011212 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:10.011800 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:10.011807 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:10.012400 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:10.012403 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:10.012465 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:10.012485 (+ 20us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 09:23:10.073156 (+ 60671us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 09:23:10.073332 (+ 176us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.99.254:34209: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":121,"threads_started":1}
I20260809 09:23:10.074219 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 17829
2026-08-09T09:23:10Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (331 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (119 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (118 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:23:10 dist-test-slave-pgkr krb5kdc[17945](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:23:10 dist-test-slave-pgkr krb5kdc[17945](info): set up 2 sockets
Aug 09 09:23:10 dist-test-slave-pgkr krb5kdc[17945](info): commencing operation
krb5kdc: starting...
W20260809 09:23:11.361440 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.028s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:23:11 dist-test-slave-pgkr krb5kdc[17945](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267391, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:23:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:23:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:23:11.475705 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:33429
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:35151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:33429
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:11.595338 17959 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:11.595602 17959 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:11.595677 17959 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:11.599428 17959 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:23:11.599481 17959 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:11.599507 17959 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:11.599525 17959 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:23:11.599542 17959 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:23:11.604473 17959 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:35151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:33429
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:33429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17959
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:11.605409 17959 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:11.606338 17959 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:11.614517 17965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:11.614526 17969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:11.614526 17966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:11.614696 17959 server_base.cc:1034] running on GCE node
I20260809 09:23:11.615342 17959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:11.616341 17959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:11.617487 17959 hybrid_clock.cc:648] HybridClock initialized: now 1786267391617474 us; error 45 us; skew 500 ppm
Aug 09 09:23:11 dist-test-slave-pgkr krb5kdc[17945](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267391, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:11.620179 17959 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:23:11.621009 17959 webserver.cc:460] Webserver started at http://127.11.99.254:34759/ using document root <none> and password file <none>
I20260809 09:23:11.621541 17959 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:11.621596 17959 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:11.621749 17959 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:11.623703 17959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "47b684bcc95942cf835604103ee9bd67"
format_stamp: "Formatted at 2026-08-09 09:23:11 on dist-test-slave-pgkr"
server_key: "77b4bf643e905e9ae9c6c00652d9ae6e"
server_key_iv: "40c7ef94c6c8d12b9761a4aefb64e63f"
server_key_version: "encryptionkey@0"
I20260809 09:23:11.624190 17959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "47b684bcc95942cf835604103ee9bd67"
format_stamp: "Formatted at 2026-08-09 09:23:11 on dist-test-slave-pgkr"
server_key: "77b4bf643e905e9ae9c6c00652d9ae6e"
server_key_iv: "40c7ef94c6c8d12b9761a4aefb64e63f"
server_key_version: "encryptionkey@0"
I20260809 09:23:11.627703 17959 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260809 09:23:11.629808 17977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:11.631063 17959 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 09:23:11.631206 17959 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "47b684bcc95942cf835604103ee9bd67"
format_stamp: "Formatted at 2026-08-09 09:23:11 on dist-test-slave-pgkr"
server_key: "77b4bf643e905e9ae9c6c00652d9ae6e"
server_key_iv: "40c7ef94c6c8d12b9761a4aefb64e63f"
server_key_version: "encryptionkey@0"
I20260809 09:23:11.631317 17959 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:11.642354 17959 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:11.645664 17959 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:11.645885 17959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:11.652639 17959 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:33429
I20260809 09:23:11.652670 18034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:33429 every 8 connection(s)
I20260809 09:23:11.653540 17959 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:23:11.656044 18035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:11.661036 18035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47b684bcc95942cf835604103ee9bd67: Bootstrap starting.
I20260809 09:23:11.661109 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 17959
I20260809 09:23:11.661255 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:23:11.661505 11663 external_mini_cluster.cc:1428] Setting key 5d9e954e14ba74b0c3ecea2c78f38444
I20260809 09:23:11.663698 18035 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47b684bcc95942cf835604103ee9bd67: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:11.664605 18035 log.cc:824] T 00000000000000000000000000000000 P 47b684bcc95942cf835604103ee9bd67: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:11.666673 18035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47b684bcc95942cf835604103ee9bd67: No bootstrap required, opened a new log
Aug 09 09:23:11 dist-test-slave-pgkr krb5kdc[17945](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267391, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:23:11.670562 18035 raft_consensus.cc:348] T 00000000000000000000000000000000 P 47b684bcc95942cf835604103ee9bd67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b684bcc95942cf835604103ee9bd67" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 33429 } }
I20260809 09:23:11.670827 18035 raft_consensus.cc:374] T 00000000000000000000000000000000 P 47b684bcc95942cf835604103ee9bd67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:11.670893 18035 raft_consensus.cc:729] T 00000000000000000000000000000000 P 47b684bcc95942cf835604103ee9bd67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b684bcc95942cf835604103ee9bd67, State: Initialized, Role: FOLLOWER
I20260809 09:23:11.671361 18035 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47b684bcc95942cf835604103ee9bd67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b684bcc95942cf835604103ee9bd67" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 33429 } }
I20260809 09:23:11.671586 18035 raft_consensus.cc:388] T 00000000000000000000000000000000 P 47b684bcc95942cf835604103ee9bd67 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:23:11.671663 18035 raft_consensus.cc:482] T 00000000000000000000000000000000 P 47b684bcc95942cf835604103ee9bd67 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:23:11.671761 18035 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 47b684bcc95942cf835604103ee9bd67 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:11.672886 18035 raft_consensus.cc:504] T 00000000000000000000000000000000 P 47b684bcc95942cf835604103ee9bd67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b684bcc95942cf835604103ee9bd67" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 33429 } }
I20260809 09:23:11.673199 18035 leader_election.cc:302] T 00000000000000000000000000000000 P 47b684bcc95942cf835604103ee9bd67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47b684bcc95942cf835604103ee9bd67; no voters:
I20260809 09:23:11.673532 18035 leader_election.cc:288] T 00000000000000000000000000000000 P 47b684bcc95942cf835604103ee9bd67 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:23:11.673591 18040 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 47b684bcc95942cf835604103ee9bd67 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:23:11.673756 18040 raft_consensus.cc:686] T 00000000000000000000000000000000 P 47b684bcc95942cf835604103ee9bd67 [term 1 LEADER]: Becoming Leader. State: Replica: 47b684bcc95942cf835604103ee9bd67, State: Running, Role: LEADER
I20260809 09:23:11.674039 18040 consensus_queue.cc:237] T 00000000000000000000000000000000 P 47b684bcc95942cf835604103ee9bd67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b684bcc95942cf835604103ee9bd67" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 33429 } }
I20260809 09:23:11.674752 18035 sys_catalog.cc:564] T 00000000000000000000000000000000 P 47b684bcc95942cf835604103ee9bd67 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:23:11.675964 18043 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47b684bcc95942cf835604103ee9bd67 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "47b684bcc95942cf835604103ee9bd67" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b684bcc95942cf835604103ee9bd67" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 33429 } } }
I20260809 09:23:11.676112 18043 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47b684bcc95942cf835604103ee9bd67 [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:11.676443 18042 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47b684bcc95942cf835604103ee9bd67 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47b684bcc95942cf835604103ee9bd67. Latest consensus state: current_term: 1 leader_uuid: "47b684bcc95942cf835604103ee9bd67" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b684bcc95942cf835604103ee9bd67" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 33429 } } }
I20260809 09:23:11.676553 18042 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47b684bcc95942cf835604103ee9bd67 [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:11.676527 18050 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:23:11.676853 18038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:11.662787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37164 (local address 127.11.99.254:33429)
0809 09:23:11.663242 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:11.663260 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:11.663299 (+ 39us) server_negotiation.cc:407] Connection header received
0809 09:23:11.664218 (+ 919us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:11.664240 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:11.664634 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:11.664992 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:11.665802 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:11.667134 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:11.667911 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:11.668579 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:11.668733 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:11.671359 (+ 2626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:11.671363 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:11.671374 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:11.671399 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:11.673529 (+ 2130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:11.674003 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:11.674014 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:11.674036 (+ 22us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:11.674261 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:11.674563 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:11.674567 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:11.674569 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:11.675055 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:11.675277 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:11.675569 (+ 292us) server_negotiation.cc:299] Negotiation successful
0809 09:23:11.675883 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":113,"threads_started":1}
I20260809 09:23:11.680785 18050 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:23:11.686210 18050 catalog_manager.cc:1347] Generated new cluster ID: 9691c895fe934c21860df3f6801ea20e
I20260809 09:23:11.686280 18050 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:23:11.699136 18050 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:23:11.699962 18050 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:23:11.704749 18050 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 47b684bcc95942cf835604103ee9bd67: Generated new TSK 0
I20260809 09:23:11.705444 18050 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.99.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
I20260809 09:23:11.742129 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:0
--local_ip_for_outbound_sockets=127.11.99.193
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:33429
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:35151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:11.849177 18063 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:11.849419 18063 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:11.849470 18063 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:11.853116 18063 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:11.853160 18063 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:11.853257 18063 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:23:11.857906 18063 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:35151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:33429
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18063
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:11.858855 18063 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:11.859759 18063 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:11.868430 18070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:11.868475 18073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:11.868703 18063 server_base.cc:1034] running on GCE node
W20260809 09:23:11.868428 18068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:11.869206 18063 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:11.869750 18063 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:11.870939 18063 hybrid_clock.cc:648] HybridClock initialized: now 1786267391870906 us; error 42 us; skew 500 ppm
Aug 09 09:23:11 dist-test-slave-pgkr krb5kdc[17945](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267391, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:11.873610 18063 init.cc:377] Logged in from keytab as kudu/127.11.99.193@KRBTEST.COM (short username kudu)
I20260809 09:23:11.874377 18063 webserver.cc:460] Webserver started at http://127.11.99.193:41985/ using document root <none> and password file <none>
I20260809 09:23:11.874953 18063 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:11.875016 18063 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:11.875165 18063 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:11.877169 18063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-0/data/instance:
uuid: "9fef8d1af8b843e3813eb4bf45ee9ce0"
format_stamp: "Formatted at 2026-08-09 09:23:11 on dist-test-slave-pgkr"
server_key: "f05581ebdf0d1dd429591ff275587d72"
server_key_iv: "0092c5d91d2758f8d59036abff2890d8"
server_key_version: "encryptionkey@0"
I20260809 09:23:11.877698 18063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance:
uuid: "9fef8d1af8b843e3813eb4bf45ee9ce0"
format_stamp: "Formatted at 2026-08-09 09:23:11 on dist-test-slave-pgkr"
server_key: "f05581ebdf0d1dd429591ff275587d72"
server_key_iv: "0092c5d91d2758f8d59036abff2890d8"
server_key_version: "encryptionkey@0"
I20260809 09:23:11.881219 18063 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 09:23:11.883497 18081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:11.884824 18063 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:23:11.884954 18063 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "9fef8d1af8b843e3813eb4bf45ee9ce0"
format_stamp: "Formatted at 2026-08-09 09:23:11 on dist-test-slave-pgkr"
server_key: "f05581ebdf0d1dd429591ff275587d72"
server_key_iv: "0092c5d91d2758f8d59036abff2890d8"
server_key_version: "encryptionkey@0"
I20260809 09:23:11.885097 18063 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:11.896906 18063 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:11.899711 18063 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:11.899904 18063 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:11.900437 18063 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:11.901221 18063 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:11.901290 18063 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:11.901360 18063 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:11.901413 18063 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:11.909477 18063 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:46697
I20260809 09:23:11.909536 18210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:46697 every 8 connection(s)
I20260809 09:23:11.910307 18063 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:23:11.918116 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 18063
I20260809 09:23:11.918247 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance
I20260809 09:23:11.918546 11663 external_mini_cluster.cc:1428] Setting key da7fabc1f52737fe037335d85f725758
Aug 09 09:23:11 dist-test-slave-pgkr krb5kdc[17945](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267391, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:23:11.923321 18038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:11.912106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:52595 (local address 127.11.99.254:33429)
0809 09:23:11.912262 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:11.912267 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:11.913058 (+ 791us) server_negotiation.cc:407] Connection header received
0809 09:23:11.914257 (+ 1199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:11.914260 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:11.914324 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:11.914409 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:11.915478 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:11.915957 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:11.917034 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:11.917255 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:11.917340 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:11.919775 (+ 2435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:11.919782 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:11.919786 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:11.919814 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:11.921203 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:11.921790 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:11.921797 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:11.921801 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:11.921901 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:11.922205 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:11.922210 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:11.922213 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:11.922429 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:11.922523 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:11.922984 (+ 461us) server_negotiation.cc:299] Negotiation successful
0809 09:23:11.923112 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 09:23:11.923851 18213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:11.912482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:33429 (local address 127.11.99.193:52595)
0809 09:23:11.912923 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:11.912961 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:11.914089 (+ 1128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:11.914545 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:11.914550 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:11.914908 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:11.915357 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:11.915369 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:11.916058 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:11.916060 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:11.916896 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:11.916905 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:11.917391 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:11.917394 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:11.917517 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:11.917981 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:11.918002 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:11.919607 (+ 1605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:11.921323 (+ 1716us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:11.921331 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:11.921345 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:11.921679 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:11.921991 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:11.921993 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:11.921994 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:11.922122 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:11.922520 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:11.922525 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:11.922758 (+ 233us) client_negotiation.cc:769] Sending connection context
0809 09:23:11.922907 (+ 149us) client_negotiation.cc:240] Negotiation successful
0809 09:23:11.923123 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":109,"threads_started":1}
I20260809 09:23:11.924964 18211 heartbeater.cc:347] Connected to a master server at 127.11.99.254:33429
I20260809 09:23:11.925200 18211 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:11.925791 18211 heartbeater.cc:511] Master 127.11.99.254:33429 requested a full tablet report, sending...
I20260809 09:23:11.927301 17997 ts_manager.cc:194] Registered new tserver with Master: 9fef8d1af8b843e3813eb4bf45ee9ce0 (127.11.99.193:46697)
I20260809 09:23:11.928320 17997 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.193@KRBTEST.COM'} at 127.11.99.193:52595
WARNING: no policy specified for kudu/127.11.99.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
I20260809 09:23:11.945053 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:0
--local_ip_for_outbound_sockets=127.11.99.194
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:33429
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:35151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:12.051265 18217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:12.051472 18217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:12.051508 18217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:12.055303 18217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:12.055352 18217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:12.055433 18217 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:23:12.060328 18217 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:35151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:33429
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18217
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:12.061254 18217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:12.062150 18217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:12.071478 18222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:12.071506 18225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:12.071697 18217 server_base.cc:1034] running on GCE node
W20260809 09:23:12.071533 18223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:12.072160 18217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:12.072679 18217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:12.073839 18217 hybrid_clock.cc:648] HybridClock initialized: now 1786267392073828 us; error 23 us; skew 500 ppm
Aug 09 09:23:12 dist-test-slave-pgkr krb5kdc[17945](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267392, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:12.076620 18217 init.cc:377] Logged in from keytab as kudu/127.11.99.194@KRBTEST.COM (short username kudu)
I20260809 09:23:12.077462 18217 webserver.cc:460] Webserver started at http://127.11.99.194:37893/ using document root <none> and password file <none>
I20260809 09:23:12.078008 18217 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:12.078121 18217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:12.078346 18217 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:12.080446 18217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-1/data/instance:
uuid: "3e091b1ded234182b3728ee58183ed49"
format_stamp: "Formatted at 2026-08-09 09:23:12 on dist-test-slave-pgkr"
server_key: "28cb8b69e267f0e5c577e64ef1fccb93"
server_key_iv: "2f5010025a02ec630702ec027f951629"
server_key_version: "encryptionkey@0"
I20260809 09:23:12.081028 18217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance:
uuid: "3e091b1ded234182b3728ee58183ed49"
format_stamp: "Formatted at 2026-08-09 09:23:12 on dist-test-slave-pgkr"
server_key: "28cb8b69e267f0e5c577e64ef1fccb93"
server_key_iv: "2f5010025a02ec630702ec027f951629"
server_key_version: "encryptionkey@0"
I20260809 09:23:12.084745 18217 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:23:12.087006 18233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:12.088064 18217 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:23:12.088217 18217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "3e091b1ded234182b3728ee58183ed49"
format_stamp: "Formatted at 2026-08-09 09:23:12 on dist-test-slave-pgkr"
server_key: "28cb8b69e267f0e5c577e64ef1fccb93"
server_key_iv: "2f5010025a02ec630702ec027f951629"
server_key_version: "encryptionkey@0"
I20260809 09:23:12.088325 18217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:12.118081 18217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:12.121070 18217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:12.121272 18217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:12.121860 18217 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:12.122685 18217 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:12.122792 18217 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:12.122866 18217 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:12.122908 18217 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:12.131644 18217 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:39923
I20260809 09:23:12.131672 18355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:39923 every 8 connection(s)
I20260809 09:23:12.132520 18217 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:23:12.141022 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 18217
I20260809 09:23:12.141156 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance
I20260809 09:23:12.141477 11663 external_mini_cluster.cc:1428] Setting key 02e1a143c84ddacfef5dcc64dbd6e1b9
Aug 09 09:23:12 dist-test-slave-pgkr krb5kdc[17945](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267392, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:23:12.146319 18038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:12.134221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:55163 (local address 127.11.99.254:33429)
0809 09:23:12.134359 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:12.134362 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:12.135225 (+ 863us) server_negotiation.cc:407] Connection header received
0809 09:23:12.136581 (+ 1356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:12.136584 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:12.136629 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:12.136706 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:12.137764 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:12.138268 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:12.139335 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:12.139543 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:12.139615 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:12.142225 (+ 2610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:12.142228 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:12.142236 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:12.142261 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:12.143803 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:12.144429 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:12.144432 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:12.144433 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:12.144613 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:12.145097 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:12.145104 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:12.145107 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:12.145395 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:12.145546 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:12.145950 (+ 404us) server_negotiation.cc:299] Negotiation successful
0809 09:23:12.146098 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 09:23:12.147099 18359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:12.134596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:33429 (local address 127.11.99.194:55163)
0809 09:23:12.135074 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:12.135122 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:12.136398 (+ 1276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:12.136851 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:12.136856 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:12.137183 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:12.137639 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:12.137651 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:12.138368 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:12.138370 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:12.139219 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:12.139236 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:12.139677 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:12.139679 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:12.139827 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:12.140329 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:12.140343 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:12.142057 (+ 1714us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:12.143917 (+ 1860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:12.143926 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:12.143940 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:12.144303 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:12.144753 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:12.144758 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:12.144763 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:12.144970 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:12.145507 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:12.145513 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:12.145720 (+ 207us) client_negotiation.cc:769] Sending connection context
0809 09:23:12.145862 (+ 142us) client_negotiation.cc:240] Negotiation successful
0809 09:23:12.146098 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":121,"threads_started":1}
I20260809 09:23:12.148627 18356 heartbeater.cc:347] Connected to a master server at 127.11.99.254:33429
I20260809 09:23:12.148866 18356 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:12.149326 18356 heartbeater.cc:511] Master 127.11.99.254:33429 requested a full tablet report, sending...
I20260809 09:23:12.150424 17997 ts_manager.cc:194] Registered new tserver with Master: 3e091b1ded234182b3728ee58183ed49 (127.11.99.194:39923)
I20260809 09:23:12.151242 17997 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.194@KRBTEST.COM'} at 127.11.99.194:55163
WARNING: no policy specified for kudu/127.11.99.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
I20260809 09:23:12.168946 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:0
--local_ip_for_outbound_sockets=127.11.99.195
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:33429
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:35151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:12.271992 18363 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:12.272212 18363 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:12.272265 18363 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:12.276434 18363 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:12.276484 18363 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:12.276593 18363 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:23:12.281652 18363 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:35151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:33429
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18363
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:12.282564 18363 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:12.283502 18363 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:12.292198 18370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:12.292205 18373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:12.292372 18363 server_base.cc:1034] running on GCE node
W20260809 09:23:12.292230 18371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:12.292968 18363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:12.293606 18363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:12.294780 18363 hybrid_clock.cc:648] HybridClock initialized: now 1786267392294744 us; error 45 us; skew 500 ppm
Aug 09 09:23:12 dist-test-slave-pgkr krb5kdc[17945](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267392, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:12.297475 18363 init.cc:377] Logged in from keytab as kudu/127.11.99.195@KRBTEST.COM (short username kudu)
I20260809 09:23:12.298264 18363 webserver.cc:460] Webserver started at http://127.11.99.195:34487/ using document root <none> and password file <none>
I20260809 09:23:12.298835 18363 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:12.298930 18363 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:12.299139 18363 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:12.300995 18363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-2/data/instance:
uuid: "b625d1656ea54148984a93b9f14219c6"
format_stamp: "Formatted at 2026-08-09 09:23:12 on dist-test-slave-pgkr"
server_key: "c17cb521c8c547f2c8fc8d05b8e2e5e3"
server_key_iv: "b91605361378bb6fc186cafd2f10f037"
server_key_version: "encryptionkey@0"
I20260809 09:23:12.301520 18363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance:
uuid: "b625d1656ea54148984a93b9f14219c6"
format_stamp: "Formatted at 2026-08-09 09:23:12 on dist-test-slave-pgkr"
server_key: "c17cb521c8c547f2c8fc8d05b8e2e5e3"
server_key_iv: "b91605361378bb6fc186cafd2f10f037"
server_key_version: "encryptionkey@0"
I20260809 09:23:12.304770 18363 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:23:12.306953 18381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:12.308010 18363 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 09:23:12.308145 18363 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "b625d1656ea54148984a93b9f14219c6"
format_stamp: "Formatted at 2026-08-09 09:23:12 on dist-test-slave-pgkr"
server_key: "c17cb521c8c547f2c8fc8d05b8e2e5e3"
server_key_iv: "b91605361378bb6fc186cafd2f10f037"
server_key_version: "encryptionkey@0"
I20260809 09:23:12.308254 18363 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:12.321640 18363 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:12.324491 18363 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:12.324671 18363 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:12.325212 18363 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:12.325928 18363 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:12.325995 18363 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:12.326085 18363 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:12.326139 18363 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:12.336032 18363 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:43035
I20260809 09:23:12.336051 18504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:43035 every 8 connection(s)
I20260809 09:23:12.336778 18363 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:23:12.344224 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 18363
I20260809 09:23:12.344331 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance
I20260809 09:23:12.344621 11663 external_mini_cluster.cc:1428] Setting key eb569f0be2ef6dd8e2d6a72f92c8cfc9
Aug 09 09:23:12 dist-test-slave-pgkr krb5kdc[17945](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267392, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:23:12.349682 18038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:12.338485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:34461 (local address 127.11.99.254:33429)
0809 09:23:12.338671 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:12.338676 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:12.339457 (+ 781us) server_negotiation.cc:407] Connection header received
0809 09:23:12.340776 (+ 1319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:12.340779 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:12.340836 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:12.340948 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:12.341997 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:12.342513 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:12.343609 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:12.343846 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:12.343950 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:12.346654 (+ 2704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:12.346658 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:12.346660 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:12.346686 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:12.348131 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:12.348545 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:12.348547 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:12.348548 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:12.348614 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:12.348873 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:12.348875 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:12.348876 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:12.349023 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:12.349091 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:12.349476 (+ 385us) server_negotiation.cc:299] Negotiation successful
0809 09:23:12.349578 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 09:23:12.350438 18507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:12.338865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:33429 (local address 127.11.99.195:34461)
0809 09:23:12.339304 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:12.339342 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:12.340556 (+ 1214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:12.341109 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:12.341115 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:12.341422 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:12.341851 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:12.341862 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:12.342671 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:12.342674 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:12.343484 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:12.343493 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:12.343984 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:12.343988 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:12.344149 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:12.344747 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:12.344762 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:12.346415 (+ 1653us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:12.348223 (+ 1808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:12.348227 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:12.348236 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:12.348452 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:12.348687 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:12.348689 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:12.348690 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:12.348802 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:12.349101 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:12.349104 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:12.349291 (+ 187us) client_negotiation.cc:769] Sending connection context
0809 09:23:12.349423 (+ 132us) client_negotiation.cc:240] Negotiation successful
0809 09:23:12.349644 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":115,"threads_started":1}
I20260809 09:23:12.351440 18505 heartbeater.cc:347] Connected to a master server at 127.11.99.254:33429
I20260809 09:23:12.351614 18505 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:12.351975 18505 heartbeater.cc:511] Master 127.11.99.254:33429 requested a full tablet report, sending...
I20260809 09:23:12.352815 17997 ts_manager.cc:194] Registered new tserver with Master: b625d1656ea54148984a93b9f14219c6 (127.11.99.195:43035)
I20260809 09:23:12.353310 17997 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.195@KRBTEST.COM'} at 127.11.99.195:34461
I20260809 09:23:12.358201 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/test-admin.keytab.
Aug 09 09:23:12 dist-test-slave-pgkr krb5kdc[17945](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:12.374663 11663 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260809 09:23:12.377729 18512 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:12.376177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36022 (local address 127.11.99.193:46697)
0809 09:23:12.376572 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:12.376581 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:12.376601 (+ 20us) server_negotiation.cc:407] Connection header received
0809 09:23:12.376646 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:12.376650 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:12.376875 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:12.377023 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:12.377522 (+ 499us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36022: BlockingRecv error: recv got EOF from 127.0.0.1:36022 (error 108)
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":177,"threads_started":1}
W20260809 09:23:12.377990 11663 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/krb5cc)
Aug 09 09:23:12 dist-test-slave-pgkr krb5kdc[17945](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:12.379088 11663 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 09:23:12 dist-test-slave-pgkr krb5kdc[17945](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:12.380002 11663 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 09:23:12 dist-test-slave-pgkr krb5kdc[17945](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.193@KRBTEST.COM
I20260809 09:23:12.388942 18512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:12.380871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36034 (local address 127.11.99.193:46697)
0809 09:23:12.381009 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:12.381013 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:12.381027 (+ 14us) server_negotiation.cc:407] Connection header received
0809 09:23:12.381125 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:12.381127 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:12.381163 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:12.381240 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:12.381682 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:12.382357 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:12.383238 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:12.383595 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:12.383677 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:12.385848 (+ 2171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:12.385856 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:12.385867 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:12.385887 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:12.387387 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:12.387768 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:12.387772 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:12.387773 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:12.387839 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:12.388092 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:12.388094 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:12.388095 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:12.388292 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:12.388439 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:12.388639 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 09:23:12.388810 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20260809 09:23:12.392485 18512 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:12.391485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36040 (local address 127.11.99.193:46697)
0809 09:23:12.391600 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:12.391603 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:12.391722 (+ 119us) server_negotiation.cc:407] Connection header received
0809 09:23:12.391875 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:12.391878 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:12.391919 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:12.391991 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:12.392378 (+ 387us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36040: BlockingRecv error: recv got EOF from 127.0.0.1:36040 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260809 09:23:12.392637 11663 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/krb5cc' of type FILE
Aug 09 09:23:12 dist-test-slave-pgkr krb5kdc[17945](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:12.393518 11663 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 09:23:12 dist-test-slave-pgkr krb5kdc[17945](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:12.394287 11663 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 09:23:12 dist-test-slave-pgkr krb5kdc[17945](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.193@KRBTEST.COM
I20260809 09:23:12.401717 18512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:12.395024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36046 (local address 127.11.99.193:46697)
0809 09:23:12.395134 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:12.395138 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:12.395233 (+ 95us) server_negotiation.cc:407] Connection header received
0809 09:23:12.395364 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:12.395366 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:12.395402 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:12.395472 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:12.395890 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:12.396318 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:12.396978 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:12.397177 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:12.397270 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:12.399179 (+ 1909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:12.399182 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:12.399184 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:12.399205 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:12.400261 (+ 1056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:12.400652 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:12.400655 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:12.400657 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:12.400733 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:12.400982 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:12.400986 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:12.400988 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:12.401139 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:12.401267 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:12.401467 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 09:23:12.401594 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
W20260809 09:23:12.404068 18512 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:12.403170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36058 (local address 127.11.99.193:46697)
0809 09:23:12.403272 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:12.403276 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:12.403367 (+ 91us) server_negotiation.cc:407] Connection header received
0809 09:23:12.403474 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:12.403476 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:12.403507 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:12.403624 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:12.403965 (+ 341us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36058: BlockingRecv error: recv got EOF from 127.0.0.1:36058 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260809 09:23:12.404256 11663 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786267363058776-11663-0/krb5kdc/krb5cc' of type FILE
Aug 09 09:23:12 dist-test-slave-pgkr krb5kdc[17945](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:12.405146 11663 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 09:23:12 dist-test-slave-pgkr krb5kdc[17945](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:12.405964 11663 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 09:23:12 dist-test-slave-pgkr krb5kdc[17945](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.193@KRBTEST.COM
I20260809 09:23:12.413895 18512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:12.406634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36060 (local address 127.11.99.193:46697)
0809 09:23:12.406739 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:12.406745 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:12.406793 (+ 48us) server_negotiation.cc:407] Connection header received
0809 09:23:12.406920 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:12.406922 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:12.406958 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:12.407049 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:12.407560 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:12.407986 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:12.408769 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:12.408975 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:12.409097 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:12.411068 (+ 1971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:12.411071 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:12.411074 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:12.411102 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:12.412390 (+ 1288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:12.412807 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:12.412811 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:12.412813 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:12.412892 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:12.413155 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:12.413158 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:12.413160 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:12.413313 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:12.413432 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:12.413665 (+ 233us) server_negotiation.cc:299] Negotiation successful
0809 09:23:12.413768 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 09:23:12.414776 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 18063
I20260809 09:23:12.422679 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 18217
I20260809 09:23:12.428874 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 18363
I20260809 09:23:12.435132 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 17959
2026-08-09T09:23:12Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2123 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:23:12 dist-test-slave-pgkr krb5kdc[18525](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:23:12 dist-test-slave-pgkr krb5kdc[18525](info): set up 2 sockets
Aug 09 09:23:12 dist-test-slave-pgkr krb5kdc[18525](info): commencing operation
krb5kdc: starting...
W20260809 09:23:13.461701 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.004s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:23:13 dist-test-slave-pgkr krb5kdc[18525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:23:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:23:13Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.254.keytab.
Entry for principal oryx/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.254.keytab.
I20260809 09:23:13.575352 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:34359
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.254.keytab
--principal=oryx/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:34325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:34359
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:13.678661 18540 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:13.678920 18540 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:13.678998 18540 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:13.682731 18540 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:23:13.682806 18540 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:13.682843 18540 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:13.682898 18540 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:23:13.682936 18540 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:23:13.687577 18540 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:34325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:34359
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.254.keytab
--principal=oryx/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:34359
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18540
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:13.688509 18540 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:13.689437 18540 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:13.697324 18546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:13.697397 18548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:13.697324 18545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:13.697508 18540 server_base.cc:1034] running on GCE node
I20260809 09:23:13.698316 18540 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:13.699415 18540 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:13.700600 18540 hybrid_clock.cc:648] HybridClock initialized: now 1786267393700583 us; error 30 us; skew 500 ppm
Aug 09 09:23:13 dist-test-slave-pgkr krb5kdc[18525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267393, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:13.707152 18540 init.cc:377] Logged in from keytab as oryx/127.11.99.254@KRBTEST.COM (short username oryx)
I20260809 09:23:13.707909 18540 webserver.cc:460] Webserver started at http://127.11.99.254:38557/ using document root <none> and password file <none>
I20260809 09:23:13.708381 18540 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:13.708434 18540 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:13.708599 18540 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:13.710475 18540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "4d21e91659d045cf9c12e64eb8c6e8e1"
format_stamp: "Formatted at 2026-08-09 09:23:13 on dist-test-slave-pgkr"
server_key: "bd3d5cbcfd18496f55fb34482bd5723c"
server_key_iv: "48258e7bfe058295ec5d0b505da8260c"
server_key_version: "encryptionkey@0"
I20260809 09:23:13.711032 18540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "4d21e91659d045cf9c12e64eb8c6e8e1"
format_stamp: "Formatted at 2026-08-09 09:23:13 on dist-test-slave-pgkr"
server_key: "bd3d5cbcfd18496f55fb34482bd5723c"
server_key_iv: "48258e7bfe058295ec5d0b505da8260c"
server_key_version: "encryptionkey@0"
I20260809 09:23:13.714448 18540 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 09:23:13.716662 18555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:13.717754 18540 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:23:13.717868 18540 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "4d21e91659d045cf9c12e64eb8c6e8e1"
format_stamp: "Formatted at 2026-08-09 09:23:13 on dist-test-slave-pgkr"
server_key: "bd3d5cbcfd18496f55fb34482bd5723c"
server_key_iv: "48258e7bfe058295ec5d0b505da8260c"
server_key_version: "encryptionkey@0"
I20260809 09:23:13.717962 18540 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:13.729151 18540 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:13.732177 18540 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:13.732394 18540 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:13.738718 18540 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:34359
I20260809 09:23:13.738971 18611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:34359 every 8 connection(s)
I20260809 09:23:13.739647 18540 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:23:13.740324 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 18540
I20260809 09:23:13.740468 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:23:13.740777 11663 external_mini_cluster.cc:1428] Setting key 97177696d73263457fd11e6201ff5816
I20260809 09:23:13.742810 18612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:13.748903 18612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1: Bootstrap starting.
Aug 09 09:23:13 dist-test-slave-pgkr krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM
I20260809 09:23:13.751348 18612 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:13.752255 18612 log.cc:824] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:13.753983 18612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1: No bootstrap required, opened a new log
I20260809 09:23:13.754948 18615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:13.742106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56902 (local address 127.11.99.254:34359)
0809 09:23:13.742491 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:13.742511 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:13.742551 (+ 40us) server_negotiation.cc:407] Connection header received
0809 09:23:13.743322 (+ 771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:13.743341 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:13.743721 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:13.744035 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:13.744638 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:13.746077 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:13.746908 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:13.747562 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:13.747710 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:13.750220 (+ 2510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:13.750226 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:13.750240 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:13.750269 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:13.752276 (+ 2007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:13.752760 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:13.752773 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:13.752777 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:13.752888 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:13.753167 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:13.753171 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:13.753173 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:13.753548 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:13.753734 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:13.754016 (+ 282us) server_negotiation.cc:299] Negotiation successful
0809 09:23:13.754267 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":111,"threads_started":1}
I20260809 09:23:13.756870 18612 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } }
I20260809 09:23:13.757088 18612 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:13.757153 18612 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d21e91659d045cf9c12e64eb8c6e8e1, State: Initialized, Role: FOLLOWER
I20260809 09:23:13.757570 18612 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } }
I20260809 09:23:13.757682 18612 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:23:13.757755 18612 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:23:13.757854 18612 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:13.758599 18612 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } }
I20260809 09:23:13.758944 18612 leader_election.cc:302] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4d21e91659d045cf9c12e64eb8c6e8e1; no voters:
I20260809 09:23:13.759207 18612 leader_election.cc:288] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:23:13.759325 18617 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:23:13.759572 18617 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [term 1 LEADER]: Becoming Leader. State: Replica: 4d21e91659d045cf9c12e64eb8c6e8e1, State: Running, Role: LEADER
I20260809 09:23:13.759837 18617 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } }
I20260809 09:23:13.760298 18612 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:23:13.761564 18620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d21e91659d045cf9c12e64eb8c6e8e1. Latest consensus state: current_term: 1 leader_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } }
I20260809 09:23:13.761557 18619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } }
I20260809 09:23:13.761708 18619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:13.761708 18620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:13.762205 18628 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:23:13.764825 18628 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:23:13.770115 18628 catalog_manager.cc:1347] Generated new cluster ID: 67352674f28c4805b8e680baebaf2812
I20260809 09:23:13.770177 18628 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:23:13.794291 18628 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:23:13.795475 18628 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:23:13.802704 18628 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1: Generated new TSK 0
I20260809 09:23:13.803345 18628 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.99.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.99.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.99.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.193.keytab.
Entry for principal oryx/127.11.99.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.193.keytab.
I20260809 09:23:13.831445 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:0
--local_ip_for_outbound_sockets=127.11.99.193
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34359
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.193.keytab
--principal=oryx/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:34325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:13.937608 18640 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:13.937811 18640 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:13.937847 18640 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:13.941426 18640 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:13.941474 18640 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:13.941551 18640 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:23:13.946363 18640 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:34325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.193.keytab
--principal=oryx/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34359
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18640
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:13.947256 18640 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:13.948164 18640 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:13.957193 18646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:13.957259 18647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:13.957245 18640 server_base.cc:1034] running on GCE node
W20260809 09:23:13.957190 18649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:13.957702 18640 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:13.958277 18640 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:13.959446 18640 hybrid_clock.cc:648] HybridClock initialized: now 1786267393959433 us; error 24 us; skew 500 ppm
Aug 09 09:23:13 dist-test-slave-pgkr krb5kdc[18525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267393, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:13.962018 18640 init.cc:377] Logged in from keytab as oryx/127.11.99.193@KRBTEST.COM (short username oryx)
I20260809 09:23:13.962914 18640 webserver.cc:460] Webserver started at http://127.11.99.193:35703/ using document root <none> and password file <none>
I20260809 09:23:13.963402 18640 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:13.963482 18640 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:13.963681 18640 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:13.965442 18640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/data/instance:
uuid: "98e2cbb71746469e88c2e7df776fe386"
format_stamp: "Formatted at 2026-08-09 09:23:13 on dist-test-slave-pgkr"
server_key: "bdcf90a79596bebf1ad07bd4ea940985"
server_key_iv: "348073e0aff5d5a7485132de831f927a"
server_key_version: "encryptionkey@0"
I20260809 09:23:13.965958 18640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance:
uuid: "98e2cbb71746469e88c2e7df776fe386"
format_stamp: "Formatted at 2026-08-09 09:23:13 on dist-test-slave-pgkr"
server_key: "bdcf90a79596bebf1ad07bd4ea940985"
server_key_iv: "348073e0aff5d5a7485132de831f927a"
server_key_version: "encryptionkey@0"
I20260809 09:23:13.969373 18640 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 09:23:13.971503 18659 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:13.972585 18640 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:23:13.972705 18640 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "98e2cbb71746469e88c2e7df776fe386"
format_stamp: "Formatted at 2026-08-09 09:23:13 on dist-test-slave-pgkr"
server_key: "bdcf90a79596bebf1ad07bd4ea940985"
server_key_iv: "348073e0aff5d5a7485132de831f927a"
server_key_version: "encryptionkey@0"
I20260809 09:23:13.972802 18640 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:13.992750 18640 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:13.995191 18640 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:13.995380 18640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:13.995873 18640 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:13.996631 18640 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:13.996695 18640 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:13.996757 18640 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:13.996800 18640 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:14.005255 18640 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:44613
I20260809 09:23:14.005293 18784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:44613 every 8 connection(s)
I20260809 09:23:14.006049 18640 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:23:14.006983 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 18640
I20260809 09:23:14.007081 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance
I20260809 09:23:14.007422 11663 external_mini_cluster.cc:1428] Setting key 97e5ba8dbfbc949530fa51fec0be23af
Aug 09 09:23:14 dist-test-slave-pgkr krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267393, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM
WARNING: no policy specified for oryx/127.11.99.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.99.194@KRBTEST.COM" created.
I20260809 09:23:14.020697 18615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.007849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:40443 (local address 127.11.99.254:34359)
0809 09:23:14.008004 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:14.008009 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:14.008970 (+ 961us) server_negotiation.cc:407] Connection header received
0809 09:23:14.010965 (+ 1995us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:14.010967 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:14.011009 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:14.011120 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:14.012255 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.012793 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.014034 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.014270 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.014374 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.016869 (+ 2495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:14.016873 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:14.016876 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:14.016905 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:14.018441 (+ 1536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.019108 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.019112 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.019114 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.019199 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.019571 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.019575 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.019588 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.019789 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:14.019896 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:14.020388 (+ 492us) server_negotiation.cc:299] Negotiation successful
0809 09:23:14.020518 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 09:23:14.021607 18787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.008268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.11.99.193:40443)
0809 09:23:14.008809 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:14.008865 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:14.010753 (+ 1888us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:14.011293 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:14.011301 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:14.011653 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:14.012093 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.012106 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.012933 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.012936 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.013905 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.013914 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.014419 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.014423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.014591 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.015249 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:14.015265 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:14.016711 (+ 1446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:14.018606 (+ 1895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.018630 (+ 24us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.018643 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.018957 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.019302 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.019305 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.019307 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.019466 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.019894 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:14.019899 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:14.020151 (+ 252us) client_negotiation.cc:769] Sending connection context
0809 09:23:14.020329 (+ 178us) client_negotiation.cc:240] Negotiation successful
0809 09:23:14.020642 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":136,"threads_started":1}
I20260809 09:23:14.022873 18785 heartbeater.cc:347] Connected to a master server at 127.11.99.254:34359
I20260809 09:23:14.023098 18785 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:14.023564 18785 heartbeater.cc:511] Master 127.11.99.254:34359 requested a full tablet report, sending...
I20260809 09:23:14.024971 18573 ts_manager.cc:194] Registered new tserver with Master: 98e2cbb71746469e88c2e7df776fe386 (127.11.99.193:44613)
I20260809 09:23:14.026053 18573 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.99.193@KRBTEST.COM'} at 127.11.99.193:40443
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.99.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.194.keytab.
Entry for principal oryx/127.11.99.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.194.keytab.
I20260809 09:23:14.034732 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:0
--local_ip_for_outbound_sockets=127.11.99.194
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34359
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.194.keytab
--principal=oryx/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:34325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:14.138840 18790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:14.139057 18790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:14.139098 18790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:14.142870 18790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:14.142915 18790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:14.142966 18790 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:23:14.147603 18790 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:34325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.194.keytab
--principal=oryx/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34359
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18790
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:14.148372 18790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:14.149302 18790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:14.157907 18797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:14.157932 18799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:14.157932 18796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:14.158190 18790 server_base.cc:1034] running on GCE node
I20260809 09:23:14.158674 18790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:14.159264 18790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:14.160439 18790 hybrid_clock.cc:648] HybridClock initialized: now 1786267394160423 us; error 33 us; skew 500 ppm
Aug 09 09:23:14 dist-test-slave-pgkr krb5kdc[18525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267394, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:14.163094 18790 init.cc:377] Logged in from keytab as oryx/127.11.99.194@KRBTEST.COM (short username oryx)
I20260809 09:23:14.163872 18790 webserver.cc:460] Webserver started at http://127.11.99.194:39085/ using document root <none> and password file <none>
I20260809 09:23:14.164371 18790 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:14.164466 18790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:14.164667 18790 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:14.166366 18790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/data/instance:
uuid: "1af4d1976895429ea93b4b592a95a459"
format_stamp: "Formatted at 2026-08-09 09:23:14 on dist-test-slave-pgkr"
server_key: "0a4197f2861aff9c66ba6002d416a316"
server_key_iv: "14f8bd4d3c3893b0645dd2af9d311d44"
server_key_version: "encryptionkey@0"
I20260809 09:23:14.166901 18790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance:
uuid: "1af4d1976895429ea93b4b592a95a459"
format_stamp: "Formatted at 2026-08-09 09:23:14 on dist-test-slave-pgkr"
server_key: "0a4197f2861aff9c66ba6002d416a316"
server_key_iv: "14f8bd4d3c3893b0645dd2af9d311d44"
server_key_version: "encryptionkey@0"
I20260809 09:23:14.170351 18790 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 09:23:14.172487 18808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:14.173542 18790 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:23:14.173666 18790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "1af4d1976895429ea93b4b592a95a459"
format_stamp: "Formatted at 2026-08-09 09:23:14 on dist-test-slave-pgkr"
server_key: "0a4197f2861aff9c66ba6002d416a316"
server_key_iv: "14f8bd4d3c3893b0645dd2af9d311d44"
server_key_version: "encryptionkey@0"
I20260809 09:23:14.173763 18790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:14.196406 18790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:14.198792 18790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:14.198968 18790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:14.199458 18790 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:14.200183 18790 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:14.200274 18790 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:14.200337 18790 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:14.200387 18790 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:14.208524 18790 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:34079
I20260809 09:23:14.208560 18933 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:34079 every 8 connection(s)
I20260809 09:23:14.209329 18790 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:23:14.210492 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 18790
I20260809 09:23:14.210636 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance
I20260809 09:23:14.210911 11663 external_mini_cluster.cc:1428] Setting key 206bbdd8ac30d5b64c904a28fe3c893c
Aug 09 09:23:14 dist-test-slave-pgkr krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267394, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM
WARNING: no policy specified for oryx/127.11.99.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.99.195@KRBTEST.COM" created.
I20260809 09:23:14.222417 18615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.211093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:56443 (local address 127.11.99.254:34359)
0809 09:23:14.211248 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:14.211254 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:14.212102 (+ 848us) server_negotiation.cc:407] Connection header received
0809 09:23:14.213470 (+ 1368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:14.213474 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:14.213531 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:14.213635 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:14.214715 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.215271 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.216291 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.216504 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.216626 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.218853 (+ 2227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:14.218856 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:14.218859 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:14.218889 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:14.220232 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.220762 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.220768 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.220773 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.220865 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.221241 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.221247 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.221252 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.221498 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:14.221603 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:14.222131 (+ 528us) server_negotiation.cc:299] Negotiation successful
0809 09:23:14.222252 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 09:23:14.223141 18936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.211503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.11.99.194:56443)
0809 09:23:14.211975 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:14.212023 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:14.213241 (+ 1218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:14.213800 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:14.213806 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:14.214116 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:14.214540 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.214551 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.215392 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.215395 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.216163 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.216172 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.216661 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.216665 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.216823 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.217344 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:14.217358 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:14.218708 (+ 1350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:14.220379 (+ 1671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.220402 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.220415 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.220656 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.220960 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.220963 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.220965 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.221149 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.221601 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:14.221607 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:14.221883 (+ 276us) client_negotiation.cc:769] Sending connection context
0809 09:23:14.222052 (+ 169us) client_negotiation.cc:240] Negotiation successful
0809 09:23:14.222373 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":138,"threads_started":1}
I20260809 09:23:14.224272 18934 heartbeater.cc:347] Connected to a master server at 127.11.99.254:34359
I20260809 09:23:14.224509 18934 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:14.224949 18934 heartbeater.cc:511] Master 127.11.99.254:34359 requested a full tablet report, sending...
I20260809 09:23:14.225950 18573 ts_manager.cc:194] Registered new tserver with Master: 1af4d1976895429ea93b4b592a95a459 (127.11.99.194:34079)
I20260809 09:23:14.226835 18573 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.99.194@KRBTEST.COM'} at 127.11.99.194:56443
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.99.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.195.keytab.
Entry for principal oryx/127.11.99.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.195.keytab.
I20260809 09:23:14.236609 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:0
--local_ip_for_outbound_sockets=127.11.99.195
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34359
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.195.keytab
--principal=oryx/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:34325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:14.342990 18939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:14.343200 18939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:14.343236 18939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:14.347160 18939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:14.347205 18939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:14.347254 18939 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:23:14.352576 18939 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:34325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.195.keytab
--principal=oryx/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34359
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18939
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:14.353413 18939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:14.354290 18939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:14.362880 18944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:14.362885 18945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:14.362885 18947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:14.363044 18939 server_base.cc:1034] running on GCE node
I20260809 09:23:14.363675 18939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:14.364241 18939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:14.365420 18939 hybrid_clock.cc:648] HybridClock initialized: now 1786267394365405 us; error 36 us; skew 500 ppm
Aug 09 09:23:14 dist-test-slave-pgkr krb5kdc[18525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267394, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:14.368150 18939 init.cc:377] Logged in from keytab as oryx/127.11.99.195@KRBTEST.COM (short username oryx)
I20260809 09:23:14.368873 18939 webserver.cc:460] Webserver started at http://127.11.99.195:45777/ using document root <none> and password file <none>
I20260809 09:23:14.369333 18939 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:14.369387 18939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:14.369531 18939 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:14.371378 18939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/data/instance:
uuid: "38cfb4a35c25467da364b523c6f9d4aa"
format_stamp: "Formatted at 2026-08-09 09:23:14 on dist-test-slave-pgkr"
server_key: "eee2f8dd9db4b740e67aa8061d240e58"
server_key_iv: "6dbdf575f2299933f584696574baa1c2"
server_key_version: "encryptionkey@0"
I20260809 09:23:14.371919 18939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance:
uuid: "38cfb4a35c25467da364b523c6f9d4aa"
format_stamp: "Formatted at 2026-08-09 09:23:14 on dist-test-slave-pgkr"
server_key: "eee2f8dd9db4b740e67aa8061d240e58"
server_key_iv: "6dbdf575f2299933f584696574baa1c2"
server_key_version: "encryptionkey@0"
I20260809 09:23:14.375325 18939 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 09:23:14.377656 18956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:14.378870 18939 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:23:14.378976 18939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "38cfb4a35c25467da364b523c6f9d4aa"
format_stamp: "Formatted at 2026-08-09 09:23:14 on dist-test-slave-pgkr"
server_key: "eee2f8dd9db4b740e67aa8061d240e58"
server_key_iv: "6dbdf575f2299933f584696574baa1c2"
server_key_version: "encryptionkey@0"
I20260809 09:23:14.379065 18939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:14.393342 18939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:14.396296 18939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:14.396473 18939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:14.397004 18939 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:14.397845 18939 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:14.397893 18939 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:14.397931 18939 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:14.397989 18939 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:14.406538 18939 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:34179
I20260809 09:23:14.406571 19076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:34179 every 8 connection(s)
I20260809 09:23:14.407828 18939 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:23:14.412221 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 18939
I20260809 09:23:14.412403 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance
I20260809 09:23:14.412675 11663 external_mini_cluster.cc:1428] Setting key c4c8d2f7b79e9d6acc50822c370e2472
Aug 09 09:23:14 dist-test-slave-pgkr krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267394, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM
I20260809 09:23:14.421985 18615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.409664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:53603 (local address 127.11.99.254:34359)
0809 09:23:14.409827 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:14.409833 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:14.411123 (+ 1290us) server_negotiation.cc:407] Connection header received
0809 09:23:14.413001 (+ 1878us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:14.413005 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:14.413072 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:14.413168 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:14.414425 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.415070 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.416111 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.416308 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.416381 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.418482 (+ 2101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:14.418485 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:14.418486 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:14.418509 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:14.419959 (+ 1450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.420424 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.420427 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.420428 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.420501 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.420881 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.420885 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.420887 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.421072 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:14.421180 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:14.421703 (+ 523us) server_negotiation.cc:299] Negotiation successful
0809 09:23:14.421821 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 09:23:14.422763 19079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.409998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.11.99.195:53603)
0809 09:23:14.410955 (+ 957us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:14.411006 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:14.412743 (+ 1737us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:14.413328 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:14.413338 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:14.413721 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:14.414284 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.414303 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.415189 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.415191 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.415982 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.415991 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.416420 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.416423 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.416553 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.417034 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:14.417050 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:14.418348 (+ 1298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:14.420065 (+ 1717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.420069 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.420078 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.420341 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.420614 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.420619 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.420621 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.420779 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.421180 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:14.421186 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:14.421419 (+ 233us) client_negotiation.cc:769] Sending connection context
0809 09:23:14.421625 (+ 206us) client_negotiation.cc:240] Negotiation successful
0809 09:23:14.421924 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":737,"thread_start_us":101,"threads_started":1}
I20260809 09:23:14.423738 19077 heartbeater.cc:347] Connected to a master server at 127.11.99.254:34359
I20260809 09:23:14.423933 19077 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:14.424345 19077 heartbeater.cc:511] Master 127.11.99.254:34359 requested a full tablet report, sending...
I20260809 09:23:14.425235 18573 ts_manager.cc:194] Registered new tserver with Master: 38cfb4a35c25467da364b523c6f9d4aa (127.11.99.195:34179)
I20260809 09:23:14.425853 18573 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.99.195@KRBTEST.COM'} at 127.11.99.195:53603
I20260809 09:23:14.426451 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.99.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.99.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.99.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.253.keytab.
Entry for principal oryx/127.11.99.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.253.keytab.
I20260809 09:23:14.451634 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.253:33431
--webserver_interface=127.11.99.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.253.keytab
--principal=oryx/127.11.99.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:34325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:34359,127.11.99.253:33431
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:14.556313 19082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:14.556550 19082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:14.556623 19082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:14.560214 19082 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:23:14.560315 19082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:14.560350 19082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:14.560402 19082 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:23:14.560437 19082 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:23:14.565212 19082 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:34325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:34359,127.11.99.253:33431
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.253.keytab
--principal=oryx/127.11.99.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.253:33431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.99.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19082
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
W20260809 09:23:14.565420 19082 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.11.99.254:34359,127.11.99.253:33431'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260809 09:23:14.566151 19082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:14.567087 19082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:14.574623 19087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:14.574595 19091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:14.574595 19088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:14.574880 19082 server_base.cc:1034] running on GCE node
I20260809 09:23:14.575426 19082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:14.576447 19082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:14.577677 19082 hybrid_clock.cc:648] HybridClock initialized: now 1786267394577659 us; error 34 us; skew 500 ppm
Aug 09 09:23:14 dist-test-slave-pgkr krb5kdc[18525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267394, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:14.580199 19082 init.cc:377] Logged in from keytab as oryx/127.11.99.253@KRBTEST.COM (short username oryx)
I20260809 09:23:14.580997 19082 webserver.cc:460] Webserver started at http://127.11.99.253:45409/ using document root <none> and password file <none>
I20260809 09:23:14.581516 19082 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:14.581634 19082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:14.581835 19082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:14.583811 19082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-1/data/instance:
uuid: "26c03b4d789144e697e2ebe38db29541"
format_stamp: "Formatted at 2026-08-09 09:23:14 on dist-test-slave-pgkr"
server_key: "237e7c3ba377c20fed98b4c19d50e226"
server_key_iv: "96994f2cde5d5899df7aedce8c177bf5"
server_key_version: "encryptionkey@0"
I20260809 09:23:14.584275 19082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-1/wal/instance:
uuid: "26c03b4d789144e697e2ebe38db29541"
format_stamp: "Formatted at 2026-08-09 09:23:14 on dist-test-slave-pgkr"
server_key: "237e7c3ba377c20fed98b4c19d50e226"
server_key_iv: "96994f2cde5d5899df7aedce8c177bf5"
server_key_version: "encryptionkey@0"
I20260809 09:23:14.587584 19082 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260809 09:23:14.589603 19100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:14.590787 19082 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:23:14.590902 19082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-1/wal
uuid: "26c03b4d789144e697e2ebe38db29541"
format_stamp: "Formatted at 2026-08-09 09:23:14 on dist-test-slave-pgkr"
server_key: "237e7c3ba377c20fed98b4c19d50e226"
server_key_iv: "96994f2cde5d5899df7aedce8c177bf5"
server_key_version: "encryptionkey@0"
I20260809 09:23:14.590994 19082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:14.611532 19082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:14.613962 19082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:14.614152 19082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:14.620713 19082 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.253:33431
I20260809 09:23:14.621019 19158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.253:33431 every 8 connection(s)
I20260809 09:23:14.621757 19082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-1/data/info.pb
I20260809 09:23:14.624321 19160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:14.627190 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 19082
I20260809 09:23:14.627959 19160 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 09:23:14 dist-test-slave-pgkr krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267394, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.253@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM
Aug 09 09:23:14 dist-test-slave-pgkr krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.99.253@KRBTEST.COM
I20260809 09:23:14.640208 18615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.629707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56916 (local address 127.11.99.254:34359)
0809 09:23:14.629845 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:14.629851 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:14.630143 (+ 292us) server_negotiation.cc:407] Connection header received
0809 09:23:14.630451 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:14.630454 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:14.630524 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:14.630615 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:14.631369 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.631878 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.632853 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.633083 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.633191 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.635773 (+ 2582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:14.635777 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:14.635779 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:14.635802 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:14.637612 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.638211 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.638214 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.638215 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.638297 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.638710 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.638713 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.638715 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.639061 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:14.639250 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:14.639815 (+ 565us) server_negotiation.cc:299] Negotiation successful
0809 09:23:14.640046 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 09:23:14.640916 19165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.629667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.0.0.1:56916)
0809 09:23:14.630024 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:14.630059 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:14.630262 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:14.630684 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:14.630689 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:14.631008 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:14.631237 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.631249 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.632009 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.632012 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.632732 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.632741 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.633235 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.633239 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.633379 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.633932 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:14.633957 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:14.635614 (+ 1657us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:14.637737 (+ 2123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.637747 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.637756 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.638109 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.638393 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.638399 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.638403 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.638590 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.639261 (+ 671us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:14.639270 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:14.639546 (+ 276us) client_negotiation.cc:769] Sending connection context
0809 09:23:14.639747 (+ 201us) client_negotiation.cc:240] Negotiation successful
0809 09:23:14.640023 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":130,"threads_started":1}
I20260809 09:23:14.640914 19163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.628642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48644 (local address 127.11.99.253:33431)
0809 09:23:14.629020 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:14.629036 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:14.629070 (+ 34us) server_negotiation.cc:407] Connection header received
0809 09:23:14.629889 (+ 819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:14.629909 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:14.630269 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:14.630503 (+ 234us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:14.631323 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.632126 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.632929 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.633298 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.633413 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.636520 (+ 3107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:14.636527 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:14.636538 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:14.636568 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:14.638535 (+ 1967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.639096 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.639100 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.639101 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.639239 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.639533 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.639536 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.639538 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.639813 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:14.639979 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:14.640342 (+ 363us) server_negotiation.cc:299] Negotiation successful
0809 09:23:14.640467 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":116,"threads_started":1}
I20260809 09:23:14.642911 19160 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 09:23:14 dist-test-slave-pgkr krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267394, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.253@KRBTEST.COM for oryx/127.11.99.253@KRBTEST.COM
I20260809 09:23:14.649417 19165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.643355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:33431 (local address 127.0.0.1:48656)
0809 09:23:14.643462 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:14.643475 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:14.643542 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:14.643708 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:14.643710 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:14.643833 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:14.643911 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.643915 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.644574 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.644576 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.645047 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.645054 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.645413 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.645415 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.645479 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.645804 (+ 325us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:14.645814 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:14.646891 (+ 1077us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:14.648209 (+ 1318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.648211 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.648212 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.648382 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.648671 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.648673 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.648674 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.648748 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.649074 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:14.649076 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:14.649140 (+ 64us) client_negotiation.cc:769] Sending connection context
0809 09:23:14.649232 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 09:23:14.649317 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 09:23:14.649708 19163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.643413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48656 (local address 127.11.99.253:33431)
0809 09:23:14.643532 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:14.643535 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:14.643546 (+ 11us) server_negotiation.cc:407] Connection header received
0809 09:23:14.643595 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:14.643597 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:14.643625 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:14.643683 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:14.643997 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.644492 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.645133 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.645332 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.645400 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.647002 (+ 1602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:14.647004 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:14.647006 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:14.647033 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:14.648120 (+ 1087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.648492 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.648495 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.648496 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.648586 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.648826 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.648829 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.648830 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.648982 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:14.649068 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:14.649297 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 09:23:14.649429 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 09:23:14.652518 19160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541: Bootstrap starting.
I20260809 09:23:14.654516 19160 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:14.655242 19160 log.cc:824] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:14.656960 19160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541: No bootstrap required, opened a new log
I20260809 09:23:14.659874 19160 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } }
I20260809 09:23:14.660126 19160 raft_consensus.cc:374] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:14.660175 19160 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26c03b4d789144e697e2ebe38db29541, State: Initialized, Role: FOLLOWER
I20260809 09:23:14.660593 19160 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } }
I20260809 09:23:14.661024 19167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } } }
I20260809 09:23:14.661181 19167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:23:14.661778 19160 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 09:23:14.666311 19179 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 09:23:14.666400 19179 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 09:23:14.667922 19082 master_runner.cc:428] Detected that this master 26c03b4d789144e697e2ebe38db29541 is joining an existing cluster
I20260809 09:23:14.668016 19082 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.99.253:33431
I20260809 09:23:14.679854 19185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.670327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:33431 (local address 127.0.0.1:48662)
0809 09:23:14.670780 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:14.670794 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:14.670897 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:14.671128 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:14.671131 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:14.671409 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:14.671591 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.671598 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.672600 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.672604 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.673483 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.673494 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.673920 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.673923 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.674008 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.674514 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:14.674534 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:14.674973 (+ 439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:14.677233 (+ 2260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.677236 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.677238 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.678477 (+ 1239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.678796 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.678798 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.678800 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.678883 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.679273 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:14.679276 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:14.679363 (+ 87us) client_negotiation.cc:769] Sending connection context
0809 09:23:14.679468 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 09:23:14.679602 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"mutex_wait_us":15,"thread_start_us":167,"threads_started":1}
I20260809 09:23:14.679857 19163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.670408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48662 (local address 127.11.99.253:33431)
0809 09:23:14.670530 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:14.670536 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:14.670862 (+ 326us) server_negotiation.cc:407] Connection header received
0809 09:23:14.670968 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:14.670972 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:14.671006 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:14.671075 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:14.671718 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.672465 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.673594 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.673790 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.673904 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.675086 (+ 1182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:14.675090 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:14.675092 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:14.675111 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:14.677122 (+ 2011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.678573 (+ 1451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.678578 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.678579 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.678683 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.678973 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.678976 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.678978 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.679171 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:14.679269 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:14.679530 (+ 261us) server_negotiation.cc:299] Negotiation successful
0809 09:23:14.679669 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":44}
I20260809 09:23:14.679885 18615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.669960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56918 (local address 127.11.99.254:34359)
0809 09:23:14.670083 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:14.670093 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:14.670779 (+ 686us) server_negotiation.cc:407] Connection header received
0809 09:23:14.670930 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:14.670933 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:14.670985 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:14.671059 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:14.671673 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.672466 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.674599 (+ 2133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.674940 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.675063 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.676328 (+ 1265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:14.676332 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:14.676335 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:14.676362 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:14.678086 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.678676 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.678680 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.678682 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.678769 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.679043 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.679047 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.679048 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.679259 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:14.679345 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:14.679625 (+ 280us) server_negotiation.cc:299] Negotiation successful
0809 09:23:14.679744 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 09:23:14.680817 19186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.669882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.0.0.1:56918)
0809 09:23:14.670682 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:14.670695 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:14.670815 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:14.671170 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:14.671173 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:14.671410 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:14.671549 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.671555 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.673634 (+ 2079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.673637 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.674481 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.674490 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.675059 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.675063 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.675170 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.675682 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:14.675697 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:14.676170 (+ 473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:14.678201 (+ 2031us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.678204 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.678205 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.678501 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.678872 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.678875 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.678877 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.678963 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.679333 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:14.679336 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:14.679417 (+ 81us) client_negotiation.cc:769] Sending connection context
0809 09:23:14.680577 (+ 1160us) client_negotiation.cc:240] Negotiation successful
0809 09:23:14.680702 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":693,"mutex_wait_us":18,"thread_start_us":130,"threads_started":1}
Aug 09 09:23:14 dist-test-slave-pgkr krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267393, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.254@KRBTEST.COM for oryx/127.11.99.253@KRBTEST.COM
I20260809 09:23:14.693450 19163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.685143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48678 (local address 127.11.99.253:33431)
0809 09:23:14.685252 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:14.685256 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:14.685524 (+ 268us) server_negotiation.cc:407] Connection header received
0809 09:23:14.685708 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:14.685711 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:14.685780 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:14.685862 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:14.686435 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.686949 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.687785 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.687982 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.688077 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.690306 (+ 2229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:14.690309 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:14.690311 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:14.690349 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:14.691743 (+ 1394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.692188 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.692192 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.692211 (+ 19us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.692300 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.692583 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.692588 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.692590 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.692751 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:14.692856 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:14.693167 (+ 311us) server_negotiation.cc:299] Negotiation successful
0809 09:23:14.693320 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 09:23:14.693470 19188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.685098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:33431 (local address 127.0.0.1:48678)
0809 09:23:14.685418 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:14.685455 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:14.685588 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:14.685893 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:14.685899 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:14.686231 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:14.686323 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.686329 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.687053 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.687058 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.687642 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.687650 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.688080 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.688084 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.688189 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.688643 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:14.688659 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:14.690137 (+ 1478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:14.691854 (+ 1717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.691864 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.691869 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.692088 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.692394 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.692399 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.692401 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.692493 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.692858 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:14.692865 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:14.692980 (+ 115us) client_negotiation.cc:769] Sending connection context
0809 09:23:14.693114 (+ 134us) client_negotiation.cc:240] Negotiation successful
0809 09:23:14.693308 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":114,"threads_started":1}
I20260809 09:23:14.695035 18572 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.99.253:33431: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "26c03b4d789144e697e2ebe38db29541"
member_type: NON_VOTER
last_known_addr {
host: "127.11.99.253"
port: 33431
}
attrs {
promote: true
}
}
dest_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1"
cas_config_opid_index: -1
I20260809 09:23:14.695648 18572 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: NON_VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: true } }
I20260809 09:23:14.697351 19190 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 26c03b4d789144e697e2ebe38db29541 (127.11.99.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: NON_VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: true } } }
I20260809 09:23:14.697860 19131 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:14.699167 19190 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.99.253:33431
I20260809 09:23:14.699273 19131 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [term 1 FOLLOWER]: Refusing update from remote peer 4d21e91659d045cf9c12e64eb8c6e8e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260809 09:23:14.699450 19190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: NON_VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: true } } }
I20260809 09:23:14.699538 19190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:14.699796 19082 master.cc:537] Master@127.11.99.253:33431 shutting down...
I20260809 09:23:14.700707 19189 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: NON_VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.001s
I20260809 09:23:14.704231 19082 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:23:14.704474 19082 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:23:14.704588 19082 tablet_replica.cc:330] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541: stopping tablet replica
WARNING: no policy specified for oryx/127.11.99.252@KRBTEST.COM; defaulting to no policy
W20260809 09:23:14.705050 18560 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260809 09:23:14.705981 18560 consensus_peers.cc:487] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 -> Peer 26c03b4d789144e697e2ebe38db29541 (127.11.99.253:33431): Couldn't send request to peer 26c03b4d789144e697e2ebe38db29541. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.99.252@KRBTEST.COM" created.
I20260809 09:23:14.719507 19082 master.cc:552] Master@127.11.99.253:33431 shutdown complete.
I20260809 09:23:14.719561 19082 master_runner.cc:305] Clearing existing system tablet
I20260809 09:23:14.719818 19082 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:14.719882 19082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.99.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.252.keytab.
Entry for principal oryx/127.11.99.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.252.keytab.
I20260809 09:23:14.721274 19082 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 09:23:14.721964 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.252:42189
--webserver_interface=127.11.99.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.252.keytab
--principal=oryx/127.11.99.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:34325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:34359,127.11.99.253:33431,127.11.99.252:42189
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 09:23:14.722203 19196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:14.722425 19082 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:14.722581 19082 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 09:23:14.722642 19082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-1/wal
uuid: "26c03b4d789144e697e2ebe38db29541"
format_stamp: "Formatted at 2026-08-09 09:23:14 on dist-test-slave-pgkr"
server_key: "237e7c3ba377c20fed98b4c19d50e226"
server_key_iv: "96994f2cde5d5899df7aedce8c177bf5"
server_key_version: "encryptionkey@0"
I20260809 09:23:14.724561 19082 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:23:14.726334 19082 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 09:23:14.726431 19082 log.cc:1196] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260809 09:23:14.726699 19082 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541: Deleting consensus metadata
I20260809 09:23:14.726859 19082 master_runner.cc:315] Copying system tablet from 127.11.99.254:34359
I20260809 09:23:14.727895 19082 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541: tablet copy: Beginning tablet copy session from remote peer at address 127.11.99.254:34359
I20260809 09:23:14.735483 18615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.728448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56926 (local address 127.11.99.254:34359)
0809 09:23:14.728589 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:14.728593 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:14.728786 (+ 193us) server_negotiation.cc:407] Connection header received
0809 09:23:14.728906 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:14.728909 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:14.728952 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:14.729042 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:14.729485 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.729998 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.730880 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.731108 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.731212 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.732299 (+ 1087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:14.732302 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:14.732304 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:14.732326 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:14.733745 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.734158 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.734162 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.734164 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.734248 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.734532 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.734535 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.734537 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.734812 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:14.734898 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:14.735225 (+ 327us) server_negotiation.cc:299] Negotiation successful
0809 09:23:14.735326 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 09:23:14.735492 19203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.728404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.0.0.1:56926)
0809 09:23:14.728701 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:14.728712 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:14.728830 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:14.729056 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:14.729058 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:14.729266 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:14.729370 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.729376 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.730107 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.730112 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.730758 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.730767 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.731227 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.731230 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.731317 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.731845 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:14.731856 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:14.732155 (+ 299us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:14.733856 (+ 1701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.733862 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.733864 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.734061 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.734340 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.734356 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.734358 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.734438 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.734940 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:14.734943 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:14.735033 (+ 90us) client_negotiation.cc:769] Sending connection context
0809 09:23:14.735175 (+ 142us) client_negotiation.cc:240] Negotiation successful
0809 09:23:14.735312 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":102,"threads_started":1}
I20260809 09:23:14.736356 18595 tablet_copy_service.cc:140] P 4d21e91659d045cf9c12e64eb8c6e8e1: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 26c03b4d789144e697e2ebe38db29541 ({username='oryx', principal='oryx/127.11.99.253@KRBTEST.COM'} at 127.0.0.1:56926)
I20260809 09:23:14.736516 18595 tablet_copy_service.cc:161] P 4d21e91659d045cf9c12e64eb8c6e8e1: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 26c03b4d789144e697e2ebe38db29541 at {username='oryx', principal='oryx/127.11.99.253@KRBTEST.COM'} at 127.0.0.1:56926: session id = 26c03b4d789144e697e2ebe38db29541-00000000000000000000000000000000
I20260809 09:23:14.737845 18595 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 09:23:14.739300 19082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 09:23:14.740934 19082 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541: tablet copy: Starting download of 0 data blocks...
I20260809 09:23:14.741138 19082 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541: tablet copy: Starting download of 1 WAL segments...
I20260809 09:23:14.742726 19082 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 09:23:14.744180 18595 tablet_copy_service.cc:342] P 4d21e91659d045cf9c12e64eb8c6e8e1: Request end of tablet copy session 26c03b4d789144e697e2ebe38db29541-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.99.253@KRBTEST.COM'} at 127.0.0.1:56926
I20260809 09:23:14.744298 18595 tablet_copy_service.cc:433] P 4d21e91659d045cf9c12e64eb8c6e8e1: ending tablet copy session 26c03b4d789144e697e2ebe38db29541-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 26c03b4d789144e697e2ebe38db29541
I20260809 09:23:14.750547 19082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:14.752061 19207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:14.752153 19204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:14.752421 19205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:14.752657 19082 server_base.cc:1034] running on GCE node
I20260809 09:23:14.752808 19082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:14.753048 19082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:14.754172 19082 hybrid_clock.cc:648] HybridClock initialized: now 1786267394754160 us; error 29 us; skew 500 ppm
Aug 09 09:23:14 dist-test-slave-pgkr krb5kdc[18525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267394, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:14.755687 19082 init.cc:377] Logged in from keytab as oryx/127.11.99.253@KRBTEST.COM (short username oryx)
I20260809 09:23:14.756139 19082 webserver.cc:460] Webserver started at http://127.11.99.253:39675/ using document root <none> and password file <none>
I20260809 09:23:14.756317 19082 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:14.756368 19082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:14.757339 19082 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 09:23:14.758255 19217 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:14.758464 19082 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 09:23:14.758559 19082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-1/wal
uuid: "26c03b4d789144e697e2ebe38db29541"
format_stamp: "Formatted at 2026-08-09 09:23:14 on dist-test-slave-pgkr"
server_key: "237e7c3ba377c20fed98b4c19d50e226"
server_key_iv: "96994f2cde5d5899df7aedce8c177bf5"
server_key_version: "encryptionkey@0"
I20260809 09:23:14.758687 19082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:14.779274 19082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:14.781068 19082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:14.785681 19082 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.253:33431
I20260809 09:23:14.786135 19082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-1/data/info.pb
I20260809 09:23:14.786674 19270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.253:33431 every 8 connection(s)
I20260809 09:23:14.787717 19271 sys_catalog.cc:263] Verifying existing consensus state
I20260809 09:23:14.788458 19271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541: Bootstrap starting.
I20260809 09:23:14.795644 19271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 09:23:14.795923 19271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541: Bootstrap complete.
I20260809 09:23:14.796329 19271 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: NON_VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: true } }
I20260809 09:23:14.796469 19271 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 26c03b4d789144e697e2ebe38db29541, State: Initialized, Role: LEARNER
I20260809 09:23:14.796702 19271 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: NON_VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: true } }
I20260809 09:23:14.797004 19274 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: NON_VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: true } } }
I20260809 09:23:14.797173 19271 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:23:14.797179 19274 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [sys.catalog]: This master's current role is: LEARNER
I20260809 09:23:14.799711 19285 catalog_manager.cc:1259] Loaded cluster ID: 67352674f28c4805b8e680baebaf2812
I20260809 09:23:14.799810 19285 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541: loading cluster ID for follower catalog manager: success
I20260809 09:23:14.801364 19285 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541: acquiring CA information for follower catalog manager: success
I20260809 09:23:14.802309 19285 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 09:23:14.865273 19197 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:14.865496 19197 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:14.865535 19197 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:14.869347 19197 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:23:14.869396 19197 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:14.869414 19197 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:14.869429 19197 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:23:14.869444 19197 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:23:14.874312 19197 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:34325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:34359,127.11.99.253:33431,127.11.99.252:42189
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.252.keytab
--principal=oryx/127.11.99.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.252:42189
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.99.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19197
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:14.875213 19197 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:14.876176 19197 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:14.884158 19296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:14.884133 19293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:14.884161 19292 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:14.884389 19197 server_base.cc:1034] running on GCE node
I20260809 09:23:14.885028 19197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:14.885952 19197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:14.887125 19197 hybrid_clock.cc:648] HybridClock initialized: now 1786267394887109 us; error 33 us; skew 500 ppm
Aug 09 09:23:14 dist-test-slave-pgkr krb5kdc[18525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267394, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:14.889532 19197 init.cc:377] Logged in from keytab as oryx/127.11.99.252@KRBTEST.COM (short username oryx)
I20260809 09:23:14.890352 19197 webserver.cc:460] Webserver started at http://127.11.99.252:40891/ using document root <none> and password file <none>
I20260809 09:23:14.890928 19197 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:14.891014 19197 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:14.891229 19197 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:14.893095 19197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-2/data/instance:
uuid: "4108f000946244afb83c1071e331520c"
format_stamp: "Formatted at 2026-08-09 09:23:14 on dist-test-slave-pgkr"
server_key: "bfc47136999fe565fafb36e1bfaad9ce"
server_key_iv: "5912fdc26d128a37dc086b441c3e59d4"
server_key_version: "encryptionkey@0"
I20260809 09:23:14.893595 19197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-2/wal/instance:
uuid: "4108f000946244afb83c1071e331520c"
format_stamp: "Formatted at 2026-08-09 09:23:14 on dist-test-slave-pgkr"
server_key: "bfc47136999fe565fafb36e1bfaad9ce"
server_key_iv: "5912fdc26d128a37dc086b441c3e59d4"
server_key_version: "encryptionkey@0"
I20260809 09:23:14.896989 19197 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 09:23:14.899195 19303 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:14.900255 19197 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:23:14.900421 19197 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-2/wal
uuid: "4108f000946244afb83c1071e331520c"
format_stamp: "Formatted at 2026-08-09 09:23:14 on dist-test-slave-pgkr"
server_key: "bfc47136999fe565fafb36e1bfaad9ce"
server_key_iv: "5912fdc26d128a37dc086b441c3e59d4"
server_key_version: "encryptionkey@0"
I20260809 09:23:14.900522 19197 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:14.912789 19197 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:14.915176 19197 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:14.915349 19197 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:14.922302 19197 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.252:42189
I20260809 09:23:14.922586 19363 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.252:42189 every 8 connection(s)
I20260809 09:23:14.923260 19197 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-2/data/info.pb
I20260809 09:23:14.925678 19364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:14.928419 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 19197
I20260809 09:23:14.929385 19364 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 09:23:14 dist-test-slave-pgkr krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267394, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.252@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM
Aug 09 09:23:14 dist-test-slave-pgkr krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.99.252@KRBTEST.COM
I20260809 09:23:14.941632 18615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.931324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56934 (local address 127.11.99.254:34359)
0809 09:23:14.931447 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:14.931451 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:14.931565 (+ 114us) server_negotiation.cc:407] Connection header received
0809 09:23:14.931750 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:14.931756 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:14.931809 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:14.931880 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:14.932845 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.933588 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.935017 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.935245 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.935356 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.937798 (+ 2442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:14.937801 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:14.937802 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:14.937824 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:14.939522 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.940020 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.940023 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.940025 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.940111 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.940526 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.940529 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.940531 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.940769 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:14.940840 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:14.941339 (+ 499us) server_negotiation.cc:299] Negotiation successful
0809 09:23:14.941472 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 09:23:14.942332 19366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.929975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47014 (local address 127.11.99.252:42189)
0809 09:23:14.930369 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:14.930383 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:14.930415 (+ 32us) server_negotiation.cc:407] Connection header received
0809 09:23:14.931127 (+ 712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:14.931173 (+ 46us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:14.931576 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:14.931845 (+ 269us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:14.932710 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.933952 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.934977 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.935347 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.935512 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.938249 (+ 2737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:14.938258 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:14.938269 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:14.938293 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:14.940048 (+ 1755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.940535 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.940541 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.940542 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.940615 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.940905 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.940908 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.940910 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.941127 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:14.941314 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:14.941522 (+ 208us) server_negotiation.cc:299] Negotiation successful
0809 09:23:14.941781 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":275,"spinlock_wait_cycles":3328,"thread_start_us":127,"threads_started":1}
I20260809 09:23:14.942332 19367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.931072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.0.0.1:56934)
0809 09:23:14.931434 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:14.931476 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:14.931599 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:14.931947 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:14.931954 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:14.932387 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:14.932710 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.932723 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.933776 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.933781 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.934882 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.934892 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.935392 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.935396 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.935517 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.936229 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:14.936243 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:14.937629 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:14.939634 (+ 2005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.939642 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.939648 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.939925 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.940197 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.940221 (+ 24us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.940245 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.940420 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.940873 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:14.940879 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:14.941093 (+ 214us) client_negotiation.cc:769] Sending connection context
0809 09:23:14.941269 (+ 176us) client_negotiation.cc:240] Negotiation successful
0809 09:23:14.941565 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"mutex_wait_us":4,"spinlock_wait_cycles":2944,"thread_start_us":144,"threads_started":1}
I20260809 09:23:14.943434 19364 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 09:23:14 dist-test-slave-pgkr krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267394, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.252@KRBTEST.COM for oryx/127.11.99.253@KRBTEST.COM
I20260809 09:23:14.951452 19367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.943869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:33431 (local address 127.0.0.1:48694)
0809 09:23:14.944008 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:14.944018 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:14.944071 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:14.944539 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:14.944542 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:14.944702 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:14.944785 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.944790 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.945679 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.945684 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.946173 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.946180 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.946660 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.946663 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.946773 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.947223 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:14.947239 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:14.948300 (+ 1061us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:14.949904 (+ 1604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.949909 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.949910 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.950147 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.950432 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.950436 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.950438 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.950525 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.950974 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:14.950978 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:14.951069 (+ 91us) client_negotiation.cc:769] Sending connection context
0809 09:23:14.951173 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 09:23:14.951302 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91}
I20260809 09:23:14.951529 19368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.943992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48694 (local address 127.11.99.253:33431)
0809 09:23:14.944259 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:14.944263 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:14.944295 (+ 32us) server_negotiation.cc:407] Connection header received
0809 09:23:14.944361 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:14.944366 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:14.944417 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:14.944524 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:14.944900 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.945571 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.946298 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.946535 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.946656 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.948433 (+ 1777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:14.948436 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:14.948438 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:14.948467 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:14.949797 (+ 1330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.950230 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.950235 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.950240 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.950338 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.950693 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.950696 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.950697 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.950865 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:14.950969 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:14.951225 (+ 256us) server_negotiation.cc:299] Negotiation successful
0809 09:23:14.951342 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":85,"threads_started":1}
I20260809 09:23:14.952270 19364 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.252" port: 42189 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 09:23:14 dist-test-slave-pgkr krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267394, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.252@KRBTEST.COM for oryx/127.11.99.252@KRBTEST.COM
I20260809 09:23:14.958465 19367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.952588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:42189 (local address 127.0.0.1:47026)
0809 09:23:14.952683 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:14.952695 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:14.952757 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:14.952913 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:14.952914 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:14.953022 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:14.953078 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.953082 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.953655 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.953657 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.954068 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.954074 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.954426 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.954428 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.954476 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.954839 (+ 363us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:14.954848 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:14.955859 (+ 1011us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:14.957318 (+ 1459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.957320 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.957321 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.957467 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.957705 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.957707 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.957708 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.957768 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.958072 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:14.958074 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:14.958130 (+ 56us) client_negotiation.cc:769] Sending connection context
0809 09:23:14.958192 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 09:23:14.958324 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 09:23:14.958496 19366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.952667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47026 (local address 127.11.99.252:42189)
0809 09:23:14.952757 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:14.952760 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:14.952772 (+ 12us) server_negotiation.cc:407] Connection header received
0809 09:23:14.952805 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:14.952807 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:14.952833 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:14.952889 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:14.953159 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.953567 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.954148 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.954346 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.954412 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.955982 (+ 1570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:14.955984 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:14.955985 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:14.956004 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:14.957242 (+ 1238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.957560 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.957567 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.957568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.957631 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.957843 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.957845 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.957847 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.958003 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:14.958092 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:14.958235 (+ 143us) server_negotiation.cc:299] Negotiation successful
0809 09:23:14.958388 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":56,"server-negotiator.queue_time_us":35}
I20260809 09:23:14.961771 19364 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c: Bootstrap starting.
I20260809 09:23:14.963912 19364 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:14.964516 19364 log.cc:824] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:14.966048 19364 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c: No bootstrap required, opened a new log
I20260809 09:23:14.968618 19364 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 42189 } }
I20260809 09:23:14.968796 19364 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:14.968835 19364 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4108f000946244afb83c1071e331520c, State: Initialized, Role: FOLLOWER
I20260809 09:23:14.969203 19364 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 42189 } }
I20260809 09:23:14.969575 19371 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 42189 } } }
I20260809 09:23:14.969695 19371 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:23:14.970275 19364 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [sys.catalog]: configured and running, proceeding with master startup.
W20260809 09:23:14.975521 19382 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 09:23:14.975605 19382 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 09:23:14.978515 19197 master_runner.cc:428] Detected that this master 4108f000946244afb83c1071e331520c is joining an existing cluster
I20260809 09:23:14.978577 19197 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.99.252:42189
I20260809 09:23:14.987951 19366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.981306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47040 (local address 127.11.99.252:42189)
0809 09:23:14.981426 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:14.981431 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:14.981444 (+ 13us) server_negotiation.cc:407] Connection header received
0809 09:23:14.981478 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:14.981481 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:14.981518 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:14.981597 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:14.982047 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.982529 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.983498 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.983712 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.983830 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.985170 (+ 1340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:14.985173 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:14.985175 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:14.985196 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:14.986486 (+ 1290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.986906 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.986912 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.986914 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.986981 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.987218 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.987223 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.987225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.987369 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:14.987456 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:14.987697 (+ 241us) server_negotiation.cc:299] Negotiation successful
0809 09:23:14.987832 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":52}
I20260809 09:23:14.987964 19392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.980473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:42189 (local address 127.0.0.1:47040)
0809 09:23:14.981290 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:14.981303 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:14.981385 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:14.981629 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:14.981633 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:14.981823 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:14.981943 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.981949 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.982708 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.982714 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.983382 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.983391 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.983829 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.983832 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.983910 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.984725 (+ 815us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:14.984738 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:14.985044 (+ 306us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:14.986599 (+ 1555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.986601 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.986603 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.986823 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.987064 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.987066 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.987068 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.987144 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.987456 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:14.987458 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:14.987531 (+ 73us) client_negotiation.cc:769] Sending connection context
0809 09:23:14.987657 (+ 126us) client_negotiation.cc:240] Negotiation successful
0809 09:23:14.987783 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":751,"mutex_wait_us":1,"thread_start_us":99,"threads_started":1}
I20260809 09:23:14.995008 19391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.980962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:33431 (local address 127.0.0.1:48702)
0809 09:23:14.988289 (+ 7327us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:14.988301 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:14.988416 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:14.988673 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:14.988675 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:14.988858 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:14.989037 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.989043 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.989894 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.989896 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.990408 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.990415 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.990953 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.990955 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.991016 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.991410 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:14.991429 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:14.991715 (+ 286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:14.993576 (+ 1861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.993579 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.993580 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.993749 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.994049 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:14.994051 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:14.994052 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:14.994131 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:14.994510 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:14.994513 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:14.994597 (+ 84us) client_negotiation.cc:769] Sending connection context
0809 09:23:14.994723 (+ 126us) client_negotiation.cc:240] Negotiation successful
0809 09:23:14.994845 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7270,"thread_start_us":122,"threads_started":1}
I20260809 09:23:14.995034 19368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.980844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48702 (local address 127.11.99.253:33431)
0809 09:23:14.980947 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:14.980951 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:14.988365 (+ 7414us) server_negotiation.cc:407] Connection header received
0809 09:23:14.988522 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:14.988525 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:14.988566 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:14.988628 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:14.989143 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.989796 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.990505 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.990844 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.990936 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:14.991856 (+ 920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:14.991859 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:14.991862 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:14.991882 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:14.993459 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.993870 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.993874 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.993875 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.993962 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:14.994207 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:14.994210 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:14.994212 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:14.994398 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:14.994482 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:14.994799 (+ 317us) server_negotiation.cc:299] Negotiation successful
0809 09:23:14.994906 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 09:23:14.995641 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 18640
I20260809 09:23:15.004420 19371 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:23:15.004627 19371 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 42189 } }
I20260809 09:23:15.004859 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:44613
--local_ip_for_outbound_sockets=127.11.99.193
--tserver_master_addrs=127.11.99.254:34359
--webserver_port=35703
--webserver_interface=127.11.99.193
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.193.keytab
--principal=oryx/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:34325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.99.254:34359,127.11.99.253:33431
--tserver_master_addrs=127.11.99.254:34359,127.11.99.253:33431,127.11.99.252:42189 with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 09:23:15.005662 19371 leader_election.cc:288] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d21e91659d045cf9c12e64eb8c6e8e1 (127.11.99.254:34359), 26c03b4d789144e697e2ebe38db29541 (127.11.99.253:33431)
I20260809 09:23:15.006150 19235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4108f000946244afb83c1071e331520c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26c03b4d789144e697e2ebe38db29541" is_pre_election: true
I20260809 09:23:15.006258 18584 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4108f000946244afb83c1071e331520c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" is_pre_election: true
I20260809 09:23:15.006357 19235 raft_consensus.cc:1799] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [term 1 LEARNER]: Handling vote request from an unknown peer 4108f000946244afb83c1071e331520c
I20260809 09:23:15.006527 19235 raft_consensus.cc:2396] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [term 1 LEARNER]: Leader pre-election vote request: Denying vote to candidate 4108f000946244afb83c1071e331520c for term 1 because replica has last-logged OpId of term: 1 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260809 09:23:15.007366 19308 leader_election.cc:302] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4108f000946244afb83c1071e331520c; no voters: 26c03b4d789144e697e2ebe38db29541, 4d21e91659d045cf9c12e64eb8c6e8e1
I20260809 09:23:15.007653 19371 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:15.008884 19371 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260809 09:23:15.011121 18615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.980752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56944 (local address 127.11.99.254:34359)
0809 09:23:14.980932 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:14.980936 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:14.980950 (+ 14us) server_negotiation.cc:407] Connection header received
0809 09:23:14.980987 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:14.980989 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:14.981064 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:14.981160 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:14.981928 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.982751 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.983923 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.984225 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.984293 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.007882 (+ 23589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:15.007885 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:15.007887 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:15.007911 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:15.009460 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.009894 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.009898 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.009899 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.009982 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.010265 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.010268 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.010270 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.010456 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:15.010565 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.010868 (+ 303us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.010980 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260809 09:23:15.011281 19390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:14.980393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.0.0.1:56944)
0809 09:23:14.980669 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:14.980686 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:14.980786 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:14.981396 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:14.981399 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:14.981642 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:14.981793 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.981803 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.982906 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.982909 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.983793 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:14.983803 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:14.984430 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:14.984433 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:14.984517 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.007290 (+ 22773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:15.007305 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:15.007714 (+ 409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:15.009583 (+ 1869us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:15.009588 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:15.009590 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:15.009790 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:15.010075 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:15.010079 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:15.010081 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:15.010168 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:15.010555 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:15.010558 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:15.010700 (+ 142us) client_negotiation.cc:769] Sending connection context
0809 09:23:15.010812 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 09:23:15.010958 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":105,"threads_started":1}
Aug 09 09:23:15 dist-test-slave-pgkr krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267393, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.254@KRBTEST.COM for oryx/127.11.99.252@KRBTEST.COM
I20260809 09:23:15.022044 19366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.014808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47052 (local address 127.11.99.252:42189)
0809 09:23:15.014928 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:15.014932 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:15.014944 (+ 12us) server_negotiation.cc:407] Connection header received
0809 09:23:15.015048 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:15.015051 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:15.015100 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:15.015188 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:15.015587 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.016045 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.016807 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.017024 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.017126 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.019026 (+ 1900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:15.019029 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:15.019032 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:15.019053 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:15.020475 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.020908 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.020911 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.020912 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.020991 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.021265 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.021269 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.021273 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.021478 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:15.021577 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.021816 (+ 239us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.021916 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 09:23:15.022075 19188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.014681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:42189 (local address 127.0.0.1:47052)
0809 09:23:15.014855 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:15.014870 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:15.014945 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:15.015203 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:15.015206 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:15.015400 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:15.015478 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.015484 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.016163 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.016167 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.016680 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.016688 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.017129 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.017132 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.017217 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.017662 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:15.017676 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:15.018899 (+ 1223us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:15.020574 (+ 1675us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:15.020578 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:15.020580 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:15.020784 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:15.021079 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:15.021083 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:15.021085 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:15.021171 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:15.021578 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:15.021581 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:15.021670 (+ 89us) client_negotiation.cc:769] Sending connection context
0809 09:23:15.021768 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 09:23:15.021895 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105}
I20260809 09:23:15.023089 18572 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.99.252:42189: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "4108f000946244afb83c1071e331520c"
member_type: NON_VOTER
last_known_addr {
host: "127.11.99.252"
port: 42189
}
attrs {
promote: true
}
}
dest_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1"
cas_config_opid_index: 5
I20260809 09:23:15.023638 18572 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: NON_VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: true } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: NON_VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: true } }
I20260809 09:23:15.024722 19189 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 4108f000946244afb83c1071e331520c (127.11.99.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: NON_VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: true } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: NON_VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: true } } }
I20260809 09:23:15.026060 19189 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.99.252:42189
I20260809 09:23:15.026230 19189 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: NON_VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: true } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: NON_VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: true } } }
I20260809 09:23:15.026361 19189 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:15.027439 19334 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 1 FOLLOWER]: Refusing update from remote peer 4d21e91659d045cf9c12e64eb8c6e8e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 09:23:15.028051 19190 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: NON_VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:23:15.030884 19188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.024837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:33431 (local address 127.0.0.1:48706)
0809 09:23:15.025149 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:15.025163 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:15.025264 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:15.027107 (+ 1843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:15.027110 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:15.027126 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:15.027198 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.027205 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.028372 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.028375 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.029413 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.029423 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.030469 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.030472 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.030556 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.030603 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 09:23:15.030707 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 09:23:15.030772 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226}
I20260809 09:23:15.031478 19368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.026568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48706 (local address 127.11.99.253:33431)
0809 09:23:15.026718 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:15.026723 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:15.026737 (+ 14us) server_negotiation.cc:407] Connection header received
0809 09:23:15.026784 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:15.026790 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:15.026861 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:15.026954 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:15.027346 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.028114 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.029550 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.030143 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.030256 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.030405 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.031295 (+ 890us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.031364 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 09:23:15.032138 19334 raft_consensus.cc:858] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 42189 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: NON_VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: NON_VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: true } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: NON_VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: true } }
W20260809 09:23:15.032229 19334 raft_consensus.cc:1565] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 42189 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: NON_VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: NON_VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: true } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: NON_VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: true } }
I20260809 09:23:15.032786 19235 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [term 1 LEARNER]: Refusing update from remote peer 4d21e91659d045cf9c12e64eb8c6e8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 09:23:15.033241 19190 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: NON_VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260809 09:23:15.033763 19334 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 26c03b4d789144e697e2ebe38db29541 (127.11.99.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: NON_VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: true } } }
I20260809 09:23:15.034914 19235 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 4108f000946244afb83c1071e331520c (127.11.99.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: NON_VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: true } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: NON_VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: true } } }
I20260809 09:23:15.036420 19371 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d21e91659d045cf9c12e64eb8c6e8e1. Latest consensus state: current_term: 1 leader_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: NON_VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: true } } }
I20260809 09:23:15.036520 19371 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260809 09:23:15.036602 19371 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: NON_VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: true } } }
I20260809 09:23:15.036665 19371 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260809 09:23:15.036744 19371 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: NON_VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: true } } }
I20260809 09:23:15.036803 19371 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260809 09:23:15.037093 19197 master.cc:537] Master@127.11.99.252:42189 shutting down...
I20260809 09:23:15.037134 19274 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d21e91659d045cf9c12e64eb8c6e8e1. Latest consensus state: current_term: 1 leader_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: NON_VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: true } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: NON_VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: true } } }
I20260809 09:23:15.037247 19274 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [sys.catalog]: This master's current role is: LEARNER
I20260809 09:23:15.037340 19274 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: NON_VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: true } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: NON_VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: true } } }
I20260809 09:23:15.037423 19274 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [sys.catalog]: This master's current role is: LEARNER
I20260809 09:23:15.040158 19190 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1: attempting to promote NON_VOTER 26c03b4d789144e697e2ebe38db29541 to VOTER
I20260809 09:23:15.040632 19190 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: NON_VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: true } }
I20260809 09:23:15.042289 19235 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [term 1 LEARNER]: Refusing update from remote peer 4d21e91659d045cf9c12e64eb8c6e8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260809 09:23:15.042749 19189 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260809 09:23:15.043340 18558 consensus_peers.cc:487] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 -> Peer 4108f000946244afb83c1071e331520c (127.11.99.252:42189): Couldn't send request to peer 4108f000946244afb83c1071e331520c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 09:23:15.044458 19394 mvcc.cc:205] Tried to move back new op lower bound from 7316551245012795392 to 7316551244841168896. Current Snapshot: MvccSnapshot[applied={T|T < 7316551244873535488}]
I20260809 09:23:15.044888 19189 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 26c03b4d789144e697e2ebe38db29541 (127.11.99.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: NON_VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: true } } }
I20260809 09:23:15.045987 19197 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260809 09:23:15.046252 19197 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260809 09:23:15.046351 19197 tablet_replica.cc:330] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c: stopping tablet replica
I20260809 09:23:15.046442 19189 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: NON_VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: true } } }
I20260809 09:23:15.046522 19189 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:15.046650 19189 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: NON_VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: true } } }
I20260809 09:23:15.046722 19189 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:15.047366 19235 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 26c03b4d789144e697e2ebe38db29541 (127.11.99.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: NON_VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: true } } }
I20260809 09:23:15.048446 19400 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: NON_VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: true } } }
I20260809 09:23:15.048621 19400 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:23:15.065518 19197 master.cc:552] Master@127.11.99.252:42189 shutdown complete.
I20260809 09:23:15.065588 19197 master_runner.cc:305] Clearing existing system tablet
I20260809 09:23:15.065800 19197 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:15.065871 19197 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:15.066933 19197 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 09:23:15.067766 19407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:15.068001 19197 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:15.068147 19197 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 09:23:15.068184 19197 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-2/wal
uuid: "4108f000946244afb83c1071e331520c"
format_stamp: "Formatted at 2026-08-09 09:23:14 on dist-test-slave-pgkr"
server_key: "bfc47136999fe565fafb36e1bfaad9ce"
server_key_iv: "5912fdc26d128a37dc086b441c3e59d4"
server_key_version: "encryptionkey@0"
I20260809 09:23:15.069514 19197 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:23:15.071908 19197 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 09:23:15.072010 19197 log.cc:1196] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260809 09:23:15.072337 19197 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c: Deleting consensus metadata
I20260809 09:23:15.072533 19197 master_runner.cc:315] Copying system tablet from 127.11.99.254:34359
I20260809 09:23:15.073668 19197 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c: tablet copy: Beginning tablet copy session from remote peer at address 127.11.99.254:34359
I20260809 09:23:15.081889 19413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.074198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.0.0.1:56956)
0809 09:23:15.074542 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:15.074554 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:15.074738 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:15.074998 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:15.075000 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:15.075198 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:15.075724 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.075733 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.076505 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.076508 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.077131 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.077140 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.077597 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.077600 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.077685 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.078249 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:15.078271 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:15.078579 (+ 308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:15.080394 (+ 1815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:15.080398 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:15.080400 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:15.080642 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:15.080949 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:15.080951 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:15.080952 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:15.081019 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:15.081382 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:15.081384 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:15.081482 (+ 98us) client_negotiation.cc:769] Sending connection context
0809 09:23:15.081583 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 09:23:15.081724 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":92,"threads_started":1}
I20260809 09:23:15.082254 18615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.074296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56956 (local address 127.11.99.254:34359)
0809 09:23:15.074424 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:15.074428 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:15.074675 (+ 247us) server_negotiation.cc:407] Connection header received
0809 09:23:15.074845 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:15.074848 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:15.074897 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:15.074983 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:15.075847 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.076338 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.077248 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.077487 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.077586 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.078788 (+ 1202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:15.078791 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:15.078794 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:15.078818 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:15.080286 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.080754 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.080757 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.080759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.080846 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.081113 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.081116 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.081117 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.081288 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:15.081390 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.081636 (+ 246us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.081828 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 09:23:15.082577 18595 tablet_copy_service.cc:140] P 4d21e91659d045cf9c12e64eb8c6e8e1: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 4108f000946244afb83c1071e331520c ({username='oryx', principal='oryx/127.11.99.252@KRBTEST.COM'} at 127.0.0.1:56956)
I20260809 09:23:15.082763 18595 tablet_copy_service.cc:161] P 4d21e91659d045cf9c12e64eb8c6e8e1: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 4108f000946244afb83c1071e331520c at {username='oryx', principal='oryx/127.11.99.252@KRBTEST.COM'} at 127.0.0.1:56956: session id = 4108f000946244afb83c1071e331520c-00000000000000000000000000000000
I20260809 09:23:15.083629 18595 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 09:23:15.084741 19197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 09:23:15.086293 19197 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c: tablet copy: Starting download of 0 data blocks...
I20260809 09:23:15.086479 19197 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c: tablet copy: Starting download of 1 WAL segments...
I20260809 09:23:15.087716 19197 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 09:23:15.089056 18595 tablet_copy_service.cc:342] P 4d21e91659d045cf9c12e64eb8c6e8e1: Request end of tablet copy session 4108f000946244afb83c1071e331520c-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.99.252@KRBTEST.COM'} at 127.0.0.1:56956
I20260809 09:23:15.089143 18595 tablet_copy_service.cc:433] P 4d21e91659d045cf9c12e64eb8c6e8e1: ending tablet copy session 4108f000946244afb83c1071e331520c-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 4108f000946244afb83c1071e331520c
I20260809 09:23:15.095487 19197 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:15.096900 19417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:15.096975 19414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:15.097188 19415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:15.097688 19197 server_base.cc:1034] running on GCE node
I20260809 09:23:15.097847 19197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:15.098158 19197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:15.099293 19197 hybrid_clock.cc:648] HybridClock initialized: now 1786267395099312 us; error 64 us; skew 500 ppm
Aug 09 09:23:15 dist-test-slave-pgkr krb5kdc[18525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267395, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:15.100740 19197 init.cc:377] Logged in from keytab as oryx/127.11.99.252@KRBTEST.COM (short username oryx)
I20260809 09:23:15.101202 19197 webserver.cc:460] Webserver started at http://127.11.99.252:41299/ using document root <none> and password file <none>
I20260809 09:23:15.101382 19197 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:15.101449 19197 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:15.102415 19197 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 09:23:15.103397 19426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:15.103631 19197 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 09:23:15.103734 19197 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-2/wal
uuid: "4108f000946244afb83c1071e331520c"
format_stamp: "Formatted at 2026-08-09 09:23:14 on dist-test-slave-pgkr"
server_key: "bfc47136999fe565fafb36e1bfaad9ce"
server_key_iv: "5912fdc26d128a37dc086b441c3e59d4"
server_key_version: "encryptionkey@0"
I20260809 09:23:15.103812 19197 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:15.113834 19197 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:15.115705 19197 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:15.120384 19197 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.252:42189
I20260809 09:23:15.120414 19485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.252:42189 every 8 connection(s)
I20260809 09:23:15.121054 19197 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/master-2/data/info.pb
I20260809 09:23:15.122816 19486 sys_catalog.cc:263] Verifying existing consensus state
I20260809 09:23:15.123708 19486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c: Bootstrap starting.
I20260809 09:23:15.129724 19486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 09:23:15.130009 19486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c: Bootstrap complete.
I20260809 09:23:15.130486 19486 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: NON_VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: true } }
I20260809 09:23:15.130612 19486 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4108f000946244afb83c1071e331520c, State: Initialized, Role: LEARNER
I20260809 09:23:15.130774 19486 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: NON_VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: true } }
I20260809 09:23:15.131211 19486 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:23:15.133828 19490 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: NON_VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: true } } }
I20260809 09:23:15.133942 19490 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [sys.catalog]: This master's current role is: LEARNER
I20260809 09:23:15.135244 19503 catalog_manager.cc:1259] Loaded cluster ID: 67352674f28c4805b8e680baebaf2812
I20260809 09:23:15.135329 19503 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c: loading cluster ID for follower catalog manager: success
I20260809 09:23:15.136747 19503 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c: acquiring CA information for follower catalog manager: success
I20260809 09:23:15.137794 19503 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 09:23:15.158989 19393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:15.159291 19393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:15.159379 19393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:15.165483 19393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:15.165568 19393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:15.165647 19393 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:23:15.173202 19393 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:34325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.193.keytab
--principal=oryx/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:44613
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=35703
--tserver_master_addrs=127.11.99.254:34359,127.11.99.253:33431,127.11.99.252:42189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19393
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:15.174306 19393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:15.175361 19393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:15.184386 19509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:15.184394 19508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:15.184454 19511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:15.184626 19393 server_base.cc:1034] running on GCE node
I20260809 09:23:15.184990 19393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:15.185530 19393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:15.186729 19393 hybrid_clock.cc:648] HybridClock initialized: now 1786267395186701 us; error 37 us; skew 500 ppm
Aug 09 09:23:15 dist-test-slave-pgkr krb5kdc[18525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267395, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:15.189220 19393 init.cc:377] Logged in from keytab as oryx/127.11.99.193@KRBTEST.COM (short username oryx)
I20260809 09:23:15.189966 19393 webserver.cc:460] Webserver started at http://127.11.99.193:35703/ using document root <none> and password file <none>
I20260809 09:23:15.190474 19393 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:15.190582 19393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:15.194038 19393 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260809 09:23:15.195892 19520 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:15.196858 19393 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 09:23:15.196977 19393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "98e2cbb71746469e88c2e7df776fe386"
format_stamp: "Formatted at 2026-08-09 09:23:13 on dist-test-slave-pgkr"
server_key: "bdcf90a79596bebf1ad07bd4ea940985"
server_key_iv: "348073e0aff5d5a7485132de831f927a"
server_key_version: "encryptionkey@0"
I20260809 09:23:15.197430 19393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:15.208848 19393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:15.211724 19393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:15.211899 19393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:15.212538 19393 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:15.213303 19393 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:15.213372 19393 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:15.213443 19393 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:15.213487 19393 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:15.227265 19393 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:44613
I20260809 09:23:15.227330 19644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:44613 every 8 connection(s)
I20260809 09:23:15.228206 19393 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:23:15.228593 18934 heartbeater.cc:503] Master 127.11.99.254:34359 was elected leader, sending a full tablet report...
I20260809 09:23:15.235303 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 19393
I20260809 09:23:15.235492 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 18790
Aug 09 09:23:15 dist-test-slave-pgkr krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267395, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.252@KRBTEST.COM
I20260809 09:23:15.244206 19649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.230018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:39057 (local address 127.11.99.252:42189)
0809 09:23:15.230417 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:15.230423 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:15.231846 (+ 1423us) server_negotiation.cc:407] Connection header received
0809 09:23:15.232951 (+ 1105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:15.232954 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:15.233002 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:15.233087 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:15.234371 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.235464 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.236758 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.236997 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.237104 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.239766 (+ 2662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:15.239770 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:15.239774 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:15.239804 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:15.241295 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.241790 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.241794 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.241796 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.241874 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.242191 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.242195 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.242196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.242403 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:15.242509 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.243899 (+ 1390us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.244033 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":90,"threads_started":1}
Aug 09 09:23:15 dist-test-slave-pgkr krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267395, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.253@KRBTEST.COM
Aug 09 09:23:15 dist-test-slave-pgkr krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267395, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM
I20260809 09:23:15.251838 19368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.231931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:60337 (local address 127.11.99.253:33431)
0809 09:23:15.232067 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:15.232073 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:15.232260 (+ 187us) server_negotiation.cc:407] Connection header received
0809 09:23:15.233193 (+ 933us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:15.233196 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:15.233242 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:15.233328 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:15.234358 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.235014 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.242697 (+ 7683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.243025 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.243143 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.245870 (+ 2727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:15.245876 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:15.245880 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:15.245917 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:15.249812 (+ 3895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.250322 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.250328 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.250332 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.250421 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.250745 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.250751 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.250755 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.250989 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:15.251077 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.251467 (+ 390us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.251607 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 09:23:15.252252 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:34079
--local_ip_for_outbound_sockets=127.11.99.194
--tserver_master_addrs=127.11.99.254:34359
--webserver_port=39085
--webserver_interface=127.11.99.194
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.194.keytab
--principal=oryx/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:34325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.99.254:34359,127.11.99.253:33431
--tserver_master_addrs=127.11.99.254:34359,127.11.99.253:33431,127.11.99.252:42189 with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 09:23:15.253206 19652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.231830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:33431 (local address 127.11.99.193:60337)
0809 09:23:15.232137 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:15.232152 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:15.232578 (+ 426us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:15.233345 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:15.233347 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:15.233657 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:15.234209 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.234222 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.235266 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.235270 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.242546 (+ 7276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.242562 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.243278 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.243283 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.243374 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.243858 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:15.243870 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:15.245670 (+ 1800us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:15.249931 (+ 4261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:15.249936 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:15.249941 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:15.250194 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:15.250532 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:15.250534 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:15.250536 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:15.250640 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:15.251156 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:15.251162 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:15.251270 (+ 108us) client_negotiation.cc:769] Sending connection context
0809 09:23:15.252389 (+ 1119us) client_negotiation.cc:240] Negotiation successful
0809 09:23:15.252536 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"mutex_wait_us":5762,"thread_start_us":82,"threads_started":1}
I20260809 09:23:15.253235 19651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.230477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:42189 (local address 127.11.99.193:39057)
0809 09:23:15.231726 (+ 1249us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:15.231740 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:15.232535 (+ 795us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:15.233111 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:15.233113 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:15.233664 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:15.234220 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.234233 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.235589 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.235592 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.236629 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.236639 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.237134 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.237137 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.237348 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.237913 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:15.237928 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:15.239604 (+ 1676us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:15.241430 (+ 1826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:15.241436 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:15.241460 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:15.241689 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:15.241962 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:15.241966 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:15.241968 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:15.242101 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:15.242510 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:15.242517 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:15.242832 (+ 315us) client_negotiation.cc:769] Sending connection context
0809 09:23:15.243013 (+ 181us) client_negotiation.cc:240] Negotiation successful
0809 09:23:15.243313 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1171,"mutex_wait_us":124,"spinlock_wait_cycles":43904,"thread_start_us":279,"threads_started":1}
I20260809 09:23:15.254781 19647 heartbeater.cc:347] Connected to a master server at 127.11.99.253:33431
I20260809 09:23:15.254992 19647 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:15.255139 19645 heartbeater.cc:347] Connected to a master server at 127.11.99.252:42189
I20260809 09:23:15.255240 19645 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:15.255635 19645 heartbeater.cc:511] Master 127.11.99.252:42189 requested a full tablet report, sending...
I20260809 09:23:15.255646 19647 heartbeater.cc:511] Master 127.11.99.253:33431 requested a full tablet report, sending...
I20260809 09:23:15.257241 19234 ts_manager.cc:194] Registered new tserver with Master: 98e2cbb71746469e88c2e7df776fe386 (127.11.99.193:44613)
I20260809 09:23:15.257321 19447 ts_manager.cc:194] Registered new tserver with Master: 98e2cbb71746469e88c2e7df776fe386 (127.11.99.193:44613)
I20260809 09:23:15.258086 18615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.230196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:46143 (local address 127.11.99.254:34359)
0809 09:23:15.230316 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:15.230321 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:15.231377 (+ 1056us) server_negotiation.cc:407] Connection header received
0809 09:23:15.232781 (+ 1404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:15.232784 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:15.232835 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:15.232933 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:15.234371 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.235237 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.243892 (+ 8655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.244371 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.244487 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.248664 (+ 4177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:15.248670 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:15.248676 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:15.248708 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:15.251341 (+ 2633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.256542 (+ 5201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.256548 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.256553 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.256662 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.257017 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.257020 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.257022 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.257271 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:15.257360 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.257721 (+ 361us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.257859 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 09:23:15.258787 19650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.230477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.11.99.193:46143)
0809 09:23:15.231247 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:15.231285 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:15.232535 (+ 1250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:15.233098 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:15.233106 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:15.233658 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:15.234211 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.234225 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.235373 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.235376 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.243723 (+ 8347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.243737 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.244720 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.244726 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.244873 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.246959 (+ 2086us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:15.246978 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:15.248508 (+ 1530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:15.252054 (+ 3546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:15.252058 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:15.252059 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:15.252303 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:15.256804 (+ 4501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:15.256809 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:15.256814 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:15.256905 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:15.257423 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:15.257427 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:15.257522 (+ 95us) client_negotiation.cc:769] Sending connection context
0809 09:23:15.258270 (+ 748us) client_negotiation.cc:240] Negotiation successful
0809 09:23:15.258430 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"mutex_wait_us":7051,"spinlock_wait_cycles":3840,"thread_start_us":863,"threads_started":1}
I20260809 09:23:15.259491 19646 heartbeater.cc:347] Connected to a master server at 127.11.99.254:34359
I20260809 09:23:15.259580 19646 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:15.259801 19646 heartbeater.cc:511] Master 127.11.99.254:34359 requested a full tablet report, sending...
I20260809 09:23:15.260612 18572 ts_manager.cc:194] Re-registered known tserver with Master: 98e2cbb71746469e88c2e7df776fe386 (127.11.99.193:44613)
I20260809 09:23:15.261263 18572 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.99.193@KRBTEST.COM'} at 127.11.99.193:46143
W20260809 09:23:15.361768 19653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:15.362028 19653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:15.362094 19653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:15.365823 19653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:15.365895 19653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:15.365970 19653 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:23:15.373420 19653 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:34325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.194.keytab
--principal=oryx/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:34079
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=39085
--tserver_master_addrs=127.11.99.254:34359,127.11.99.253:33431,127.11.99.252:42189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19653
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:15.374754 19653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:15.375792 19653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:15.387358 19662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:15.387941 19653 server_base.cc:1034] running on GCE node
W20260809 09:23:15.390556 19659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:15.390784 19658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:15.391255 19653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:15.391923 19653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:15.393085 19653 hybrid_clock.cc:648] HybridClock initialized: now 1786267395393066 us; error 34 us; skew 500 ppm
Aug 09 09:23:15 dist-test-slave-pgkr krb5kdc[18525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267395, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:15.395813 19653 init.cc:377] Logged in from keytab as oryx/127.11.99.194@KRBTEST.COM (short username oryx)
I20260809 09:23:15.396688 19653 webserver.cc:460] Webserver started at http://127.11.99.194:39085/ using document root <none> and password file <none>
I20260809 09:23:15.397274 19653 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:15.397359 19653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:15.401569 19653 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 09:23:15.403415 19670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:15.404517 19653 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 09:23:15.404626 19653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "1af4d1976895429ea93b4b592a95a459"
format_stamp: "Formatted at 2026-08-09 09:23:14 on dist-test-slave-pgkr"
server_key: "0a4197f2861aff9c66ba6002d416a316"
server_key_iv: "14f8bd4d3c3893b0645dd2af9d311d44"
server_key_version: "encryptionkey@0"
I20260809 09:23:15.405112 19653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:15.423416 19653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:15.426088 19653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:15.426283 19653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:15.426972 19653 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:15.427800 19653 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:15.427852 19653 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:15.428050 19077 heartbeater.cc:503] Master 127.11.99.254:34359 was elected leader, sending a full tablet report...
I20260809 09:23:15.428318 19653 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:15.428368 19653 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:15.442191 19653 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:34079
I20260809 09:23:15.442217 19792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:34079 every 8 connection(s)
I20260809 09:23:15.443156 19653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:23:15.449931 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 19653
I20260809 09:23:15.450125 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 18939
Aug 09 09:23:15 dist-test-slave-pgkr krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267395, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM
Aug 09 09:23:15 dist-test-slave-pgkr krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267395, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.253@KRBTEST.COM
Aug 09 09:23:15 dist-test-slave-pgkr krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267395, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.252@KRBTEST.COM
I20260809 09:23:15.464372 19368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.445162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:49659 (local address 127.11.99.253:33431)
0809 09:23:15.445471 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:15.445477 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:15.446211 (+ 734us) server_negotiation.cc:407] Connection header received
0809 09:23:15.447664 (+ 1453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:15.447668 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:15.447723 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:15.447777 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:15.449690 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.450497 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.452505 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.452833 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.452906 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.460427 (+ 7521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:15.460430 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:15.460432 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:15.460466 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:15.462322 (+ 1856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.462794 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.462797 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.462799 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.462873 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.463173 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.463176 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.463178 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.463409 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:15.463482 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.464089 (+ 607us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.464207 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217}
I20260809 09:23:15.465270 19799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.445426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:42189 (local address 127.11.99.194:54035)
0809 09:23:15.446387 (+ 961us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:15.446402 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:15.447432 (+ 1030us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:15.448091 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:15.448100 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:15.448742 (+ 642us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:15.449514 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.449537 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.455837 (+ 6300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.455841 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.456693 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.456705 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.457494 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.457498 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.457612 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.458066 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:15.458079 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:15.459807 (+ 1728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:15.462116 (+ 2309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:15.462122 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:15.462137 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:15.462455 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:15.462775 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:15.462779 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:15.462781 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:15.462946 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:15.463422 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:15.463430 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:15.463762 (+ 332us) client_negotiation.cc:769] Sending connection context
0809 09:23:15.464008 (+ 246us) client_negotiation.cc:240] Negotiation successful
0809 09:23:15.464308 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":865,"mutex_wait_us":82,"spinlock_wait_cycles":57216,"thread_start_us":173,"threads_started":1}
I20260809 09:23:15.465663 19649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.445010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:54035 (local address 127.11.99.252:42189)
0809 09:23:15.445338 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:15.445362 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:15.446500 (+ 1138us) server_negotiation.cc:407] Connection header received
0809 09:23:15.447761 (+ 1261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:15.447766 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:15.447842 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:15.447936 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:15.455112 (+ 7176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.455674 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.456868 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.457234 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.457354 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.459941 (+ 2587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:15.459945 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:15.459948 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:15.459987 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:15.461986 (+ 1999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.462565 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.462568 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.462570 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.462674 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.463045 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.463048 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.463050 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.463284 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:15.463370 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.465365 (+ 1995us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.465494 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204}
I20260809 09:23:15.465689 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:34179
--local_ip_for_outbound_sockets=127.11.99.195
--tserver_master_addrs=127.11.99.254:34359
--webserver_port=45777
--webserver_interface=127.11.99.195
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.195.keytab
--principal=oryx/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:34325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.99.254:34359,127.11.99.253:33431
--tserver_master_addrs=127.11.99.254:34359,127.11.99.253:33431,127.11.99.252:42189 with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 09:23:15.465272 19798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.445426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:33431 (local address 127.11.99.194:49659)
0809 09:23:15.446018 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:15.446081 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:15.447428 (+ 1347us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:15.448089 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:15.448097 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:15.448727 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:15.449520 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.449537 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.450782 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.450787 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.452368 (+ 1581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.452378 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.453096 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.453099 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.453389 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.457683 (+ 4294us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:15.457699 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:15.460261 (+ 2562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:15.462459 (+ 2198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:15.462461 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:15.462463 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:15.462694 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:15.462973 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:15.462978 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:15.462982 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:15.463073 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:15.463532 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:15.463534 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:15.463762 (+ 228us) client_negotiation.cc:769] Sending connection context
0809 09:23:15.464701 (+ 939us) client_negotiation.cc:240] Negotiation successful
0809 09:23:15.464837 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"mutex_wait_us":297,"spinlock_wait_cycles":42368,"thread_start_us":195,"threads_started":1}
I20260809 09:23:15.466696 19796 heartbeater.cc:347] Connected to a master server at 127.11.99.253:33431
I20260809 09:23:15.466887 19796 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:15.467309 19796 heartbeater.cc:511] Master 127.11.99.253:33431 requested a full tablet report, sending...
I20260809 09:23:15.468371 19793 heartbeater.cc:347] Connected to a master server at 127.11.99.252:42189
I20260809 09:23:15.468466 19793 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:15.468446 19234 ts_manager.cc:194] Registered new tserver with Master: 1af4d1976895429ea93b4b592a95a459 (127.11.99.194:34079)
I20260809 09:23:15.468652 19793 heartbeater.cc:511] Master 127.11.99.252:42189 requested a full tablet report, sending...
I20260809 09:23:15.469429 19447 ts_manager.cc:194] Registered new tserver with Master: 1af4d1976895429ea93b4b592a95a459 (127.11.99.194:34079)
I20260809 09:23:15.470098 18615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.446547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:54397 (local address 127.11.99.254:34359)
0809 09:23:15.446685 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:15.446690 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:15.447189 (+ 499us) server_negotiation.cc:407] Connection header received
0809 09:23:15.447664 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:15.447668 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:15.447723 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:15.447777 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:15.449690 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.450497 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.452505 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.452833 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.452906 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.459296 (+ 6390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:15.459300 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:15.459303 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:15.459333 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:15.462476 (+ 3143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.468579 (+ 6103us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.468583 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.468584 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.468694 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.469022 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.469026 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.469027 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.469279 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:15.469367 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.469737 (+ 370us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.469874 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 09:23:15.470808 19800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.446465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.11.99.194:54397)
0809 09:23:15.447070 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:15.447087 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:15.447429 (+ 342us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:15.448089 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:15.448097 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:15.448727 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:15.449522 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.449538 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.451208 (+ 1670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.451211 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.452368 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.452378 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.453096 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.453099 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.453386 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.456074 (+ 2688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:15.456093 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:15.459072 (+ 2979us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:15.468172 (+ 9100us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:15.468175 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:15.468177 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:15.468453 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:15.468826 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:15.468829 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:15.468831 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:15.468914 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:15.469429 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:15.469432 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:15.469530 (+ 98us) client_negotiation.cc:769] Sending connection context
0809 09:23:15.470338 (+ 808us) client_negotiation.cc:240] Negotiation successful
0809 09:23:15.470513 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"mutex_wait_us":263,"spinlock_wait_cycles":28032,"thread_start_us":89,"threads_started":1}
I20260809 09:23:15.471545 19794 heartbeater.cc:347] Connected to a master server at 127.11.99.254:34359
I20260809 09:23:15.471645 19794 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:15.471849 19794 heartbeater.cc:511] Master 127.11.99.254:34359 requested a full tablet report, sending...
I20260809 09:23:15.472584 18572 ts_manager.cc:194] Re-registered known tserver with Master: 1af4d1976895429ea93b4b592a95a459 (127.11.99.194:34079)
I20260809 09:23:15.473440 18572 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.99.194@KRBTEST.COM'} at 127.11.99.194:54397
I20260809 09:23:15.505682 19188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.500541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:42189 (local address 127.0.0.1:41512)
0809 09:23:15.500718 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:15.500738 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:15.500876 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:15.501361 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:15.501365 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:15.501388 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:15.501522 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.501530 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.502813 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.502817 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.504016 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.504028 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.505255 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.505258 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.505352 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.505381 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 09:23:15.505450 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 09:23:15.505532 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260809 09:23:15.505769 19649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.500870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41512 (local address 127.11.99.252:42189)
0809 09:23:15.501020 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:15.501028 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:15.501044 (+ 16us) server_negotiation.cc:407] Connection header received
0809 09:23:15.501113 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:15.501118 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:15.501197 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:15.501324 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:15.501686 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.502694 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.504156 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.505115 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.505255 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.505448 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.505492 (+ 44us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.505583 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 09:23:15.506510 19459 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260809 09:23:15.507081 19490 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d21e91659d045cf9c12e64eb8c6e8e1. Latest consensus state: current_term: 1 leader_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: NON_VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: true } } }
I20260809 09:23:15.507233 19490 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [sys.catalog]: This master's current role is: LEARNER
W20260809 09:23:15.581827 19802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:15.582048 19802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:15.582129 19802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:15.586058 19802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:15.586138 19802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:15.586228 19802 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:23:15.591214 19802 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:34325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.195.keytab
--principal=oryx/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:34179
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=45777
--tserver_master_addrs=127.11.99.254:34359,127.11.99.253:33431,127.11.99.252:42189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19802
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:15.592173 19802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:15.593159 19802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:15.603019 19810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:15.603025 19808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:15.603029 19807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:15.603075 19802 server_base.cc:1034] running on GCE node
I20260809 09:23:15.603696 19802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:15.604367 19802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:15.605551 19802 hybrid_clock.cc:648] HybridClock initialized: now 1786267395605533 us; error 66 us; skew 500 ppm
Aug 09 09:23:15 dist-test-slave-pgkr krb5kdc[18525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267395, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:15.608227 19802 init.cc:377] Logged in from keytab as oryx/127.11.99.195@KRBTEST.COM (short username oryx)
I20260809 09:23:15.609107 19802 webserver.cc:460] Webserver started at http://127.11.99.195:45777/ using document root <none> and password file <none>
I20260809 09:23:15.609686 19802 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:15.609843 19802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:15.613552 19802 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.001s
I20260809 09:23:15.615490 19817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:15.616801 19802 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:23:15.616943 19802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "38cfb4a35c25467da364b523c6f9d4aa"
format_stamp: "Formatted at 2026-08-09 09:23:14 on dist-test-slave-pgkr"
server_key: "eee2f8dd9db4b740e67aa8061d240e58"
server_key_iv: "6dbdf575f2299933f584696574baa1c2"
server_key_version: "encryptionkey@0"
I20260809 09:23:15.617583 19802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:15.670109 19802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:15.673487 19802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:15.673699 19802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:15.674304 19802 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:15.675204 19802 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:15.675282 19802 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:15.675357 19802 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:15.675420 19802 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:15.684504 19802 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:34179
I20260809 09:23:15.684538 19939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:34179 every 8 connection(s)
I20260809 09:23:15.685468 19802 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:23:15.694326 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 19802
Aug 09 09:23:15 dist-test-slave-pgkr krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267395, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.253@KRBTEST.COM
Aug 09 09:23:15 dist-test-slave-pgkr krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267395, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.252@KRBTEST.COM
Aug 09 09:23:15 dist-test-slave-pgkr krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267395, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM
I20260809 09:23:15.704008 19946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.688856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.11.99.195:35227)
0809 09:23:15.689268 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:15.689286 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:15.689454 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:15.690002 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:15.690008 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:15.690467 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:15.691104 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.691118 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.691941 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.691944 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.692792 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.692801 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.693283 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.693287 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.693493 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.694847 (+ 1354us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:15.694863 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:15.698110 (+ 3247us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:15.700978 (+ 2868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:15.700981 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:15.700983 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:15.701254 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:15.701780 (+ 526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:15.701783 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:15.701785 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:15.701880 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:15.702386 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:15.702389 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:15.702479 (+ 90us) client_negotiation.cc:769] Sending connection context
0809 09:23:15.702638 (+ 159us) client_negotiation.cc:240] Negotiation successful
0809 09:23:15.702977 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"mutex_wait_us":45,"spinlock_wait_cycles":3456,"thread_start_us":107,"threads_started":1}
I20260809 09:23:15.704466 19649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.687263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:45581 (local address 127.11.99.252:42189)
0809 09:23:15.687403 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:15.687407 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:15.688465 (+ 1058us) server_negotiation.cc:407] Connection header received
0809 09:23:15.689688 (+ 1223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:15.689692 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:15.689751 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:15.689836 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:15.691262 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.692063 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.693429 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.693774 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.693887 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.698292 (+ 4405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:15.698296 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:15.698299 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:15.698326 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:15.700690 (+ 2364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.702000 (+ 1310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.702003 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.702005 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.702090 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.702399 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.702405 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.702410 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.702683 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:15.702793 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.704115 (+ 1322us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.704247 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 09:23:15.704777 19368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.687277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:42887 (local address 127.11.99.253:33431)
0809 09:23:15.687403 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:15.687407 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:15.688466 (+ 1059us) server_negotiation.cc:407] Connection header received
0809 09:23:15.689689 (+ 1223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:15.689693 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:15.689747 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:15.689809 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:15.691262 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.692063 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.693442 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.693655 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.693709 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.698292 (+ 4583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:15.698296 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:15.698299 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:15.698326 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:15.700234 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.700902 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.700906 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.700907 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.701007 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.701430 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.701434 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.701436 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.701718 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:15.701810 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.704528 (+ 2718us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.704650 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":45}
I20260809 09:23:15.705358 19945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.687784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:33431 (local address 127.11.99.195:42887)
0809 09:23:15.688301 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:15.688360 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:15.689474 (+ 1114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:15.690003 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:15.690026 (+ 23us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:15.690519 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:15.691117 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.691124 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.692203 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.692206 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.693310 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.693320 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.693892 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.693896 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.694122 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.694760 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:15.694772 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:15.698097 (+ 3325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:15.700375 (+ 2278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:15.700381 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:15.700396 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:15.700773 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:15.701130 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:15.701132 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:15.701134 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:15.701309 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:15.701928 (+ 619us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:15.701936 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:15.702259 (+ 323us) client_negotiation.cc:769] Sending connection context
0809 09:23:15.704975 (+ 2716us) client_negotiation.cc:240] Negotiation successful
0809 09:23:15.705132 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"mutex_wait_us":338,"spinlock_wait_cycles":78720,"thread_start_us":161,"threads_started":1}
I20260809 09:23:15.705651 18615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.688982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:35227 (local address 127.11.99.254:34359)
0809 09:23:15.689120 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:15.689124 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:15.689402 (+ 278us) server_negotiation.cc:407] Connection header received
0809 09:23:15.689652 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:15.689655 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:15.689712 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:15.689806 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:15.691249 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.691795 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.692915 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.693132 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.693241 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.698332 (+ 5091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:15.698336 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:15.698341 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:15.698376 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:15.700804 (+ 2428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.701571 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.701576 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.701577 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.701669 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.701969 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.701974 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.701977 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.702223 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:15.702334 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.705350 (+ 3016us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.705490 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 09:23:15.704010 19944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.687784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:42189 (local address 127.11.99.195:45581)
0809 09:23:15.688301 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:15.688360 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:15.689466 (+ 1106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:15.690003 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:15.690011 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:15.690529 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:15.691115 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.691124 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.692203 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.692206 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.693310 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.693320 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.693888 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.693892 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.694108 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.694690 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:15.694719 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:15.698097 (+ 3378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:15.700861 (+ 2764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:15.700864 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:15.700866 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:15.701462 (+ 596us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:15.702192 (+ 730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:15.702195 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:15.702197 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:15.702289 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:15.702841 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:15.702849 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:15.702964 (+ 115us) client_negotiation.cc:769] Sending connection context
0809 09:23:15.703083 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 09:23:15.703221 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"mutex_wait_us":304,"spinlock_wait_cycles":43904,"thread_start_us":129,"threads_started":1}
I20260809 09:23:15.706743 19942 heartbeater.cc:347] Connected to a master server at 127.11.99.253:33431
I20260809 09:23:15.706844 19941 heartbeater.cc:347] Connected to a master server at 127.11.99.254:34359
I20260809 09:23:15.706975 19941 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:15.707574 19941 heartbeater.cc:511] Master 127.11.99.254:34359 requested a full tablet report, sending...
I20260809 09:23:15.706977 19942 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:15.708518 19940 heartbeater.cc:347] Connected to a master server at 127.11.99.252:42189
I20260809 09:23:15.708595 19940 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:15.708717 19942 heartbeater.cc:511] Master 127.11.99.253:33431 requested a full tablet report, sending...
I20260809 09:23:15.708758 19940 heartbeater.cc:511] Master 127.11.99.252:42189 requested a full tablet report, sending...
I20260809 09:23:15.709548 18572 ts_manager.cc:194] Re-registered known tserver with Master: 38cfb4a35c25467da364b523c6f9d4aa (127.11.99.195:34179)
I20260809 09:23:15.709754 19447 ts_manager.cc:194] Registered new tserver with Master: 38cfb4a35c25467da364b523c6f9d4aa (127.11.99.195:34179)
I20260809 09:23:15.710256 19234 ts_manager.cc:194] Registered new tserver with Master: 38cfb4a35c25467da364b523c6f9d4aa (127.11.99.195:34179)
I20260809 09:23:15.710279 18572 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.99.195@KRBTEST.COM'} at 127.11.99.195:35227
I20260809 09:23:15.710829 19955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.697215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58778 (local address 127.11.99.253:33431)
0809 09:23:15.698966 (+ 1751us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:15.698971 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:15.701325 (+ 2354us) server_negotiation.cc:407] Connection header received
0809 09:23:15.701362 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:15.701364 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:15.701407 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:15.701480 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:15.702722 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.703514 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.704647 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.705003 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.705112 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.706892 (+ 1780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:15.706895 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:15.706898 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:15.706921 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:15.708674 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.709175 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.709182 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.709186 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.709308 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.709625 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.709628 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.709630 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.709853 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:15.709979 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.710518 (+ 539us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.710667 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":1683,"thread_start_us":88,"threads_started":1}
I20260809 09:23:15.714658 19953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.696707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41526 (local address 127.11.99.252:42189)
0809 09:23:15.697267 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:15.697272 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:15.697593 (+ 321us) server_negotiation.cc:407] Connection header received
0809 09:23:15.697692 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:15.697694 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:15.697748 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:15.698449 (+ 701us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:15.699103 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.699936 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.701173 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.701538 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.701638 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.703993 (+ 2355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:15.703998 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:15.704004 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:15.704030 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:15.712831 (+ 8801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.713341 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.713344 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.713345 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.713419 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.713762 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.713765 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.713766 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.713954 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:15.714097 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.714333 (+ 236us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.714458 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":109,"threads_started":1}
I20260809 09:23:15.716540 19951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.696589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57438 (local address 127.11.99.254:34359)
0809 09:23:15.705611 (+ 9022us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:15.705615 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:15.705628 (+ 13us) server_negotiation.cc:407] Connection header received
0809 09:23:15.705663 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:15.705668 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:15.705717 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:15.706865 (+ 1148us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:15.706959 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.707481 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.708398 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.711247 (+ 2849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.712060 (+ 813us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.712962 (+ 902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:15.712966 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:15.712968 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:15.712994 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:15.714852 (+ 1858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.715556 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.715558 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.715560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.715636 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.715827 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.715829 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.715830 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.715975 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:15.716086 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.716252 (+ 166us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.716339 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8954,"thread_start_us":90,"threads_started":1}
I20260809 09:23:15.718918 18572 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57438:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 09:23:15.722102 18572 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:23:15.724550 19959 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: NON_VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: true } } }
I20260809 09:23:15.724695 19959 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:15.726378 19404 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1: attempting to promote NON_VOTER 4108f000946244afb83c1071e331520c to VOTER
I20260809 09:23:15.726753 19404 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: false } }
I20260809 09:23:15.727865 19459 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 1 LEARNER]: Refusing update from remote peer 4d21e91659d045cf9c12e64eb8c6e8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260809 09:23:15.727880 19235 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [term 1 FOLLOWER]: Refusing update from remote peer 4d21e91659d045cf9c12e64eb8c6e8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260809 09:23:15.728257 19959 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260809 09:23:15.728390 19958 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260809 09:23:15.730029 19404 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 4108f000946244afb83c1071e331520c (127.11.99.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: false } } }
I20260809 09:23:15.730422 19235 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 4108f000946244afb83c1071e331520c (127.11.99.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: false } } }
I20260809 09:23:15.730450 19459 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 4108f000946244afb83c1071e331520c (127.11.99.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: false } } }
I20260809 09:23:15.731805 19404 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: false } } }
I20260809 09:23:15.731947 19404 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:15.732123 19404 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: false } } }
I20260809 09:23:15.732287 19404 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:15.733700 19968 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: false } } }
I20260809 09:23:15.733824 19968 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:23:15.732285 19959 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: false } } }
I20260809 09:23:15.734232 19959 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1 [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:15.734916 19490 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: false } } }
I20260809 09:23:15.735038 19490 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:23:15.744458 19971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.738508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:34079 (local address 127.0.0.1:43488)
0809 09:23:15.739414 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:15.739431 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:15.739516 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:15.740766 (+ 1250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:15.740769 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:15.740787 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:15.740888 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.740894 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.742207 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.742212 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.743022 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.743030 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.744091 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.744094 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.744175 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.744196 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 09:23:15.744248 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 09:23:15.744317 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":825,"mutex_wait_us":3}
I20260809 09:23:15.744692 19973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.739157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:34179 (local address 127.0.0.1:42198)
0809 09:23:15.739740 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:15.739754 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:15.739893 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:15.740388 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:15.740391 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:15.740409 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:15.740510 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.740515 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.741881 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.741884 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.743140 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.743150 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.744086 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.744089 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.744397 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.744423 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 09:23:15.744486 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 09:23:15.744555 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"mutex_wait_us":1,"thread_start_us":112,"threads_started":1}
I20260809 09:23:15.745236 19972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.739298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42198 (local address 127.11.99.195:34179)
0809 09:23:15.739773 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:15.739788 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:15.739867 (+ 79us) server_negotiation.cc:407] Connection header received
0809 09:23:15.740004 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:15.740011 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:15.740246 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:15.740421 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:15.740601 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.741741 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.743244 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.743972 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.744086 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.744227 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.744939 (+ 712us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.745054 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":115,"threads_started":1}
I20260809 09:23:15.745271 19969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.738825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43488 (local address 127.11.99.194:34079)
0809 09:23:15.740295 (+ 1470us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:15.740322 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:15.740346 (+ 24us) server_negotiation.cc:407] Connection header received
0809 09:23:15.740425 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:15.740430 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:15.740608 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:15.741026 (+ 418us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:15.741149 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.742104 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.743136 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.743937 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.744891 (+ 954us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.745035 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.745080 (+ 45us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.745167 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1374,"thread_start_us":128,"threads_started":1}
I20260809 09:23:15.748014 19721 tablet_service.cc:1467] Processing CreateTablet for tablet 0b741bdb0a28490a91328749472f555f (DEFAULT_TABLE table=test-table [id=755f1b21c8d34e3293749372908d7264]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:15.748106 19869 tablet_service.cc:1467] Processing CreateTablet for tablet 0b741bdb0a28490a91328749472f555f (DEFAULT_TABLE table=test-table [id=755f1b21c8d34e3293749372908d7264]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:15.749106 19869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b741bdb0a28490a91328749472f555f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:15.749176 19721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b741bdb0a28490a91328749472f555f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:15.750444 19971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.739497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:44613 (local address 127.0.0.1:49822)
0809 09:23:15.744605 (+ 5108us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:15.744619 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:15.744692 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:15.746363 (+ 1671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:15.746366 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:15.746383 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:15.746452 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.746458 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.747984 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.747987 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.749037 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.749048 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.750107 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.750111 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.750194 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.750218 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 09:23:15.750269 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 09:23:15.750328 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5050,"thread_start_us":103,"threads_started":1}
I20260809 09:23:15.751212 19974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.739902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49822 (local address 127.11.99.193:44613)
0809 09:23:15.740171 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:15.740178 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:15.745955 (+ 5777us) server_negotiation.cc:407] Connection header received
0809 09:23:15.746036 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:15.746041 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:15.746207 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:15.746599 (+ 392us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:15.746753 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.747778 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.749232 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.749969 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.750764 (+ 795us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.750892 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.750940 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.751032 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":92,"threads_started":1}
I20260809 09:23:15.753840 19573 tablet_service.cc:1467] Processing CreateTablet for tablet 0b741bdb0a28490a91328749472f555f (DEFAULT_TABLE table=test-table [id=755f1b21c8d34e3293749372908d7264]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:15.754819 19573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b741bdb0a28490a91328749472f555f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:15.756950 19975 tablet_bootstrap.cc:492] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa: Bootstrap starting.
I20260809 09:23:15.758351 19976 tablet_bootstrap.cc:492] T 0b741bdb0a28490a91328749472f555f P 1af4d1976895429ea93b4b592a95a459: Bootstrap starting.
I20260809 09:23:15.759256 19975 tablet_bootstrap.cc:654] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:15.760247 19975 log.cc:824] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:15.760712 19976 tablet_bootstrap.cc:654] T 0b741bdb0a28490a91328749472f555f P 1af4d1976895429ea93b4b592a95a459: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:15.761523 19976 log.cc:824] T 0b741bdb0a28490a91328749472f555f P 1af4d1976895429ea93b4b592a95a459: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:15.762648 19975 tablet_bootstrap.cc:492] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa: No bootstrap required, opened a new log
I20260809 09:23:15.762835 19975 ts_tablet_manager.cc:1397] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 09:23:15.763517 19979 tablet_bootstrap.cc:492] T 0b741bdb0a28490a91328749472f555f P 98e2cbb71746469e88c2e7df776fe386: Bootstrap starting.
I20260809 09:23:15.763546 19976 tablet_bootstrap.cc:492] T 0b741bdb0a28490a91328749472f555f P 1af4d1976895429ea93b4b592a95a459: No bootstrap required, opened a new log
I20260809 09:23:15.763696 19976 ts_tablet_manager.cc:1397] T 0b741bdb0a28490a91328749472f555f P 1af4d1976895429ea93b4b592a95a459: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 09:23:15.765414 19979 tablet_bootstrap.cc:654] T 0b741bdb0a28490a91328749472f555f P 98e2cbb71746469e88c2e7df776fe386: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:15.766284 19979 log.cc:824] T 0b741bdb0a28490a91328749472f555f P 98e2cbb71746469e88c2e7df776fe386: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:15.767712 19979 tablet_bootstrap.cc:492] T 0b741bdb0a28490a91328749472f555f P 98e2cbb71746469e88c2e7df776fe386: No bootstrap required, opened a new log
I20260809 09:23:15.767557 19975 raft_consensus.cc:348] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af4d1976895429ea93b4b592a95a459" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34079 } } peers { permanent_uuid: "98e2cbb71746469e88c2e7df776fe386" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 44613 } } peers { permanent_uuid: "38cfb4a35c25467da364b523c6f9d4aa" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 34179 } }
I20260809 09:23:15.767839 19975 raft_consensus.cc:374] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:15.767897 19975 raft_consensus.cc:729] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38cfb4a35c25467da364b523c6f9d4aa, State: Initialized, Role: FOLLOWER
I20260809 09:23:15.767899 19979 ts_tablet_manager.cc:1397] T 0b741bdb0a28490a91328749472f555f P 98e2cbb71746469e88c2e7df776fe386: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260809 09:23:15.768380 19975 consensus_queue.cc:260] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af4d1976895429ea93b4b592a95a459" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34079 } } peers { permanent_uuid: "98e2cbb71746469e88c2e7df776fe386" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 44613 } } peers { permanent_uuid: "38cfb4a35c25467da364b523c6f9d4aa" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 34179 } }
I20260809 09:23:15.768440 19976 raft_consensus.cc:348] T 0b741bdb0a28490a91328749472f555f P 1af4d1976895429ea93b4b592a95a459 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af4d1976895429ea93b4b592a95a459" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34079 } } peers { permanent_uuid: "98e2cbb71746469e88c2e7df776fe386" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 44613 } } peers { permanent_uuid: "38cfb4a35c25467da364b523c6f9d4aa" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 34179 } }
I20260809 09:23:15.768664 19976 raft_consensus.cc:374] T 0b741bdb0a28490a91328749472f555f P 1af4d1976895429ea93b4b592a95a459 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:15.768719 19976 raft_consensus.cc:729] T 0b741bdb0a28490a91328749472f555f P 1af4d1976895429ea93b4b592a95a459 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1af4d1976895429ea93b4b592a95a459, State: Initialized, Role: FOLLOWER
I20260809 09:23:15.769124 19976 consensus_queue.cc:260] T 0b741bdb0a28490a91328749472f555f P 1af4d1976895429ea93b4b592a95a459 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af4d1976895429ea93b4b592a95a459" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34079 } } peers { permanent_uuid: "98e2cbb71746469e88c2e7df776fe386" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 44613 } } peers { permanent_uuid: "38cfb4a35c25467da364b523c6f9d4aa" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 34179 } }
I20260809 09:23:15.769359 19975 ts_tablet_manager.cc:1428] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 09:23:15.770555 19794 heartbeater.cc:503] Master 127.11.99.254:34359 was elected leader, sending a full tablet report...
I20260809 09:23:15.771057 19941 heartbeater.cc:503] Master 127.11.99.254:34359 was elected leader, sending a full tablet report...
I20260809 09:23:15.773336 19979 raft_consensus.cc:348] T 0b741bdb0a28490a91328749472f555f P 98e2cbb71746469e88c2e7df776fe386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af4d1976895429ea93b4b592a95a459" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34079 } } peers { permanent_uuid: "98e2cbb71746469e88c2e7df776fe386" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 44613 } } peers { permanent_uuid: "38cfb4a35c25467da364b523c6f9d4aa" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 34179 } }
I20260809 09:23:15.773571 19979 raft_consensus.cc:374] T 0b741bdb0a28490a91328749472f555f P 98e2cbb71746469e88c2e7df776fe386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:15.773633 19979 raft_consensus.cc:729] T 0b741bdb0a28490a91328749472f555f P 98e2cbb71746469e88c2e7df776fe386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98e2cbb71746469e88c2e7df776fe386, State: Initialized, Role: FOLLOWER
I20260809 09:23:15.773999 19979 consensus_queue.cc:260] T 0b741bdb0a28490a91328749472f555f P 98e2cbb71746469e88c2e7df776fe386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af4d1976895429ea93b4b592a95a459" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34079 } } peers { permanent_uuid: "98e2cbb71746469e88c2e7df776fe386" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 44613 } } peers { permanent_uuid: "38cfb4a35c25467da364b523c6f9d4aa" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 34179 } }
I20260809 09:23:15.775017 19979 ts_tablet_manager.cc:1428] T 0b741bdb0a28490a91328749472f555f P 98e2cbb71746469e88c2e7df776fe386: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260809 09:23:15.775350 19976 ts_tablet_manager.cc:1428] T 0b741bdb0a28490a91328749472f555f P 1af4d1976895429ea93b4b592a95a459: Time spent starting tablet: real 0.012s user 0.007s sys 0.000s
I20260809 09:23:15.776455 19646 heartbeater.cc:503] Master 127.11.99.254:34359 was elected leader, sending a full tablet report...
I20260809 09:23:15.813716 19981 raft_consensus.cc:482] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:23:15.813935 19981 raft_consensus.cc:504] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af4d1976895429ea93b4b592a95a459" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34079 } } peers { permanent_uuid: "98e2cbb71746469e88c2e7df776fe386" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 44613 } } peers { permanent_uuid: "38cfb4a35c25467da364b523c6f9d4aa" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 34179 } }
I20260809 09:23:15.814972 19981 leader_election.cc:288] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1af4d1976895429ea93b4b592a95a459 (127.11.99.194:34079), 98e2cbb71746469e88c2e7df776fe386 (127.11.99.193:44613)
I20260809 09:23:15.820088 19969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.815485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:37299 (local address 127.11.99.194:34079)
0809 09:23:15.815629 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:15.815633 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:15.815647 (+ 14us) server_negotiation.cc:407] Connection header received
0809 09:23:15.815765 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:15.815770 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:15.815823 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:15.815899 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:15.816267 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.817134 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.818857 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.819430 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.819550 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.819608 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.819895 (+ 287us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.819963 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 09:23:15.820089 19974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.815875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:39295 (local address 127.11.99.193:44613)
0809 09:23:15.816013 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:15.816025 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:15.816039 (+ 14us) server_negotiation.cc:407] Connection header received
0809 09:23:15.816079 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:15.816080 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:15.816123 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:15.816180 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:15.816448 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.817139 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.818857 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.819430 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.819550 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.819601 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.819895 (+ 294us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.819963 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 09:23:15.820163 19945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.815752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:44613 (local address 127.11.99.195:39295)
0809 09:23:15.815858 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:15.815875 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:15.815968 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:15.816219 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:15.816225 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:15.816251 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:15.816343 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.816348 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.817254 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.817257 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.818733 (+ 1476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.818745 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.819552 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.819556 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.819733 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.819782 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 09:23:15.819875 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 09:23:15.819990 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":129,"spinlock_wait_cycles":384}
I20260809 09:23:15.820163 19944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.815406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:34079 (local address 127.11.99.195:37299)
0809 09:23:15.815542 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:15.815558 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:15.815648 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:15.815940 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:15.815943 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:15.815970 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:15.816130 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.816137 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.817254 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.817257 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.818733 (+ 1476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:15.818745 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.819552 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.819556 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:15.819773 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.819792 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 09:23:15.819877 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 09:23:15.819983 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":158,"spinlock_wait_cycles":4224}
I20260809 09:23:15.820955 19596 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b741bdb0a28490a91328749472f555f" candidate_uuid: "38cfb4a35c25467da364b523c6f9d4aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98e2cbb71746469e88c2e7df776fe386" is_pre_election: true
I20260809 09:23:15.821025 19745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b741bdb0a28490a91328749472f555f" candidate_uuid: "38cfb4a35c25467da364b523c6f9d4aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1af4d1976895429ea93b4b592a95a459" is_pre_election: true
I20260809 09:23:15.821259 19745 raft_consensus.cc:2454] T 0b741bdb0a28490a91328749472f555f P 1af4d1976895429ea93b4b592a95a459 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38cfb4a35c25467da364b523c6f9d4aa in term 0.
I20260809 09:23:15.821260 19596 raft_consensus.cc:2454] T 0b741bdb0a28490a91328749472f555f P 98e2cbb71746469e88c2e7df776fe386 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38cfb4a35c25467da364b523c6f9d4aa in term 0.
I20260809 09:23:15.821803 19821 leader_election.cc:302] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38cfb4a35c25467da364b523c6f9d4aa, 98e2cbb71746469e88c2e7df776fe386; no voters:
I20260809 09:23:15.822086 19981 raft_consensus.cc:2781] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:23:15.822180 19981 raft_consensus.cc:482] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:23:15.822224 19981 raft_consensus.cc:3037] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:15.823395 19981 raft_consensus.cc:504] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af4d1976895429ea93b4b592a95a459" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34079 } } peers { permanent_uuid: "98e2cbb71746469e88c2e7df776fe386" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 44613 } } peers { permanent_uuid: "38cfb4a35c25467da364b523c6f9d4aa" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 34179 } }
I20260809 09:23:15.823688 19981 leader_election.cc:288] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa [CANDIDATE]: Term 1 election: Requested vote from peers 1af4d1976895429ea93b4b592a95a459 (127.11.99.194:34079), 98e2cbb71746469e88c2e7df776fe386 (127.11.99.193:44613)
I20260809 09:23:15.824018 19745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b741bdb0a28490a91328749472f555f" candidate_uuid: "38cfb4a35c25467da364b523c6f9d4aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1af4d1976895429ea93b4b592a95a459"
I20260809 09:23:15.824154 19596 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b741bdb0a28490a91328749472f555f" candidate_uuid: "38cfb4a35c25467da364b523c6f9d4aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98e2cbb71746469e88c2e7df776fe386"
I20260809 09:23:15.824167 19745 raft_consensus.cc:3037] T 0b741bdb0a28490a91328749472f555f P 1af4d1976895429ea93b4b592a95a459 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:15.824270 19596 raft_consensus.cc:3037] T 0b741bdb0a28490a91328749472f555f P 98e2cbb71746469e88c2e7df776fe386 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:15.825632 19745 raft_consensus.cc:2454] T 0b741bdb0a28490a91328749472f555f P 1af4d1976895429ea93b4b592a95a459 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38cfb4a35c25467da364b523c6f9d4aa in term 1.
I20260809 09:23:15.825832 19596 raft_consensus.cc:2454] T 0b741bdb0a28490a91328749472f555f P 98e2cbb71746469e88c2e7df776fe386 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38cfb4a35c25467da364b523c6f9d4aa in term 1.
I20260809 09:23:15.825948 19821 leader_election.cc:302] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1af4d1976895429ea93b4b592a95a459, 38cfb4a35c25467da364b523c6f9d4aa; no voters:
I20260809 09:23:15.826165 19981 raft_consensus.cc:2781] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:23:15.826400 19981 raft_consensus.cc:686] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa [term 1 LEADER]: Becoming Leader. State: Replica: 38cfb4a35c25467da364b523c6f9d4aa, State: Running, Role: LEADER
I20260809 09:23:15.826763 19981 consensus_queue.cc:237] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af4d1976895429ea93b4b592a95a459" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34079 } } peers { permanent_uuid: "98e2cbb71746469e88c2e7df776fe386" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 44613 } } peers { permanent_uuid: "38cfb4a35c25467da364b523c6f9d4aa" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 34179 } }
I20260809 09:23:15.830188 18572 catalog_manager.cc:5495] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa reported cstate change: term changed from 0 to 1, leader changed from <none> to 38cfb4a35c25467da364b523c6f9d4aa (127.11.99.195). New cstate: current_term: 1 leader_uuid: "38cfb4a35c25467da364b523c6f9d4aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af4d1976895429ea93b4b592a95a459" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98e2cbb71746469e88c2e7df776fe386" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 44613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38cfb4a35c25467da364b523c6f9d4aa" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 34179 } health_report { overall_health: HEALTHY } } }
I20260809 09:23:15.849145 19972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.845237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42212 (local address 127.11.99.195:34179)
0809 09:23:15.845482 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:15.845508 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:15.845523 (+ 15us) server_negotiation.cc:407] Connection header received
0809 09:23:15.845683 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:15.845685 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:15.845740 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:15.845852 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:23:15.846125 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.846798 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.847659 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.847871 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.847984 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.848290 (+ 306us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:23:15.848684 (+ 394us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:23:15.848816 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.848883 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.848939 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153}
I20260809 09:23:15.854995 19596 raft_consensus.cc:1261] T 0b741bdb0a28490a91328749472f555f P 98e2cbb71746469e88c2e7df776fe386 [term 1 FOLLOWER]: Refusing update from remote peer 38cfb4a35c25467da364b523c6f9d4aa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:23:15.854995 19745 raft_consensus.cc:1261] T 0b741bdb0a28490a91328749472f555f P 1af4d1976895429ea93b4b592a95a459 [term 1 FOLLOWER]: Refusing update from remote peer 38cfb4a35c25467da364b523c6f9d4aa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:23:15.855777 19981 consensus_queue.cc:1035] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "98e2cbb71746469e88c2e7df776fe386" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 44613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:23:15.855976 19984 consensus_queue.cc:1035] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "1af4d1976895429ea93b4b592a95a459" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:23:15.863639 19988 mvcc.cc:205] Tried to move back new op lower bound from 7316551253414789120 to 7316551253308850176. Current Snapshot: MvccSnapshot[applied={T|T < 7316551253414789120}]
I20260809 09:23:15.868942 19989 mvcc.cc:205] Tried to move back new op lower bound from 7316551253414789120 to 7316551253308850176. Current Snapshot: MvccSnapshot[applied={T|T < 7316551253414789120}]
I20260809 09:23:15.875814 18572 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57438:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:23:15.875976 18572 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57438:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:23:15.880362 18572 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4d21e91659d045cf9c12e64eb8c6e8e1: Sending DeleteTablet for 3 replicas of tablet 0b741bdb0a28490a91328749472f555f
I20260809 09:23:15.881251 19721 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b741bdb0a28490a91328749472f555f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:15 UTC) from {username='oryx', principal='oryx/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:43488
I20260809 09:23:15.881717 19573 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b741bdb0a28490a91328749472f555f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:15 UTC) from {username='oryx', principal='oryx/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:49822
I20260809 09:23:15.881784 19999 tablet_replica.cc:330] T 0b741bdb0a28490a91328749472f555f P 1af4d1976895429ea93b4b592a95a459: stopping tablet replica
I20260809 09:23:15.882313 20000 tablet_replica.cc:330] T 0b741bdb0a28490a91328749472f555f P 98e2cbb71746469e88c2e7df776fe386: stopping tablet replica
I20260809 09:23:15.882387 19999 raft_consensus.cc:2229] T 0b741bdb0a28490a91328749472f555f P 1af4d1976895429ea93b4b592a95a459 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:23:15.882565 19869 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b741bdb0a28490a91328749472f555f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:15 UTC) from {username='oryx', principal='oryx/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:42198
I20260809 09:23:15.882716 19999 raft_consensus.cc:2258] T 0b741bdb0a28490a91328749472f555f P 1af4d1976895429ea93b4b592a95a459 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:23:15.882812 20000 raft_consensus.cc:2229] T 0b741bdb0a28490a91328749472f555f P 98e2cbb71746469e88c2e7df776fe386 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:23:15.883456 20000 raft_consensus.cc:2258] T 0b741bdb0a28490a91328749472f555f P 98e2cbb71746469e88c2e7df776fe386 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:23:15.883498 20001 tablet_replica.cc:330] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa: stopping tablet replica
I20260809 09:23:15.883739 20001 raft_consensus.cc:2229] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa [term 1 LEADER]: Raft consensus shutting down.
I20260809 09:23:15.884066 20001 raft_consensus.cc:2258] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:23:15.884865 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 18540
I20260809 09:23:15.886204 20001 ts_tablet_manager.cc:1905] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:23:15.887079 20000 ts_tablet_manager.cc:1905] T 0b741bdb0a28490a91328749472f555f P 98e2cbb71746469e88c2e7df776fe386: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:23:15.889220 20001 ts_tablet_manager.cc:1918] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:23:15.889315 20001 log.cc:1196] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/0b741bdb0a28490a91328749472f555f
I20260809 09:23:15.889631 20001 ts_tablet_manager.cc:1939] T 0b741bdb0a28490a91328749472f555f P 38cfb4a35c25467da364b523c6f9d4aa: Deleting consensus metadata
I20260809 09:23:15.890308 20000 ts_tablet_manager.cc:1918] T 0b741bdb0a28490a91328749472f555f P 98e2cbb71746469e88c2e7df776fe386: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:23:15.890403 20000 log.cc:1196] T 0b741bdb0a28490a91328749472f555f P 98e2cbb71746469e88c2e7df776fe386: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-0/wal/wals/0b741bdb0a28490a91328749472f555f
I20260809 09:23:15.890763 20000 ts_tablet_manager.cc:1939] T 0b741bdb0a28490a91328749472f555f P 98e2cbb71746469e88c2e7df776fe386: Deleting consensus metadata
I20260809 09:23:15.892750 19999 ts_tablet_manager.cc:1905] T 0b741bdb0a28490a91328749472f555f P 1af4d1976895429ea93b4b592a95a459: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 09:23:15.895715 19522 connection.cc:535] server connection from 127.0.0.1:49822 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 09:23:15.896090 19999 ts_tablet_manager.cc:1918] T 0b741bdb0a28490a91328749472f555f P 1af4d1976895429ea93b4b592a95a459: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260809 09:23:15.896164 19819 connection.cc:535] server connection from 127.0.0.1:42198 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 09:23:15.896190 19999 log.cc:1196] T 0b741bdb0a28490a91328749472f555f P 1af4d1976895429ea93b4b592a95a459: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/0b741bdb0a28490a91328749472f555f
I20260809 09:23:15.896524 19999 ts_tablet_manager.cc:1939] T 0b741bdb0a28490a91328749472f555f P 1af4d1976895429ea93b4b592a95a459: Deleting consensus metadata
W20260809 09:23:15.897828 19671 connection.cc:441] server connection from 127.0.0.1:43488 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43488 (request call id 1) could send its response
I20260809 09:23:15.904239 19955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.885285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58792 (local address 127.11.99.253:33431)
0809 09:23:15.886446 (+ 1161us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:15.886452 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:15.894468 (+ 8016us) server_negotiation.cc:407] Connection header received
0809 09:23:15.894702 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:15.894705 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:15.894754 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:15.894803 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:15.895891 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.896670 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.897819 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.898205 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.898303 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.900638 (+ 2335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:15.900642 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:15.900645 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:15.900669 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:15.902297 (+ 1628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.902767 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.902770 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.902772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.902847 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.903146 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.903149 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.903151 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.903339 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:15.903439 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.903741 (+ 302us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.903850 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1078}
I20260809 09:23:15.908978 19649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.899854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41544 (local address 127.11.99.252:42189)
0809 09:23:15.899961 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:15.899966 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:15.900172 (+ 206us) server_negotiation.cc:407] Connection header received
0809 09:23:15.900377 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:15.900382 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:15.900457 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:15.900511 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:15.901435 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.902151 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.903199 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.903480 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.903556 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.905182 (+ 1626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:15.905185 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:15.905187 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:15.905211 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:15.907033 (+ 1822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.907564 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.907568 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.907570 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.907663 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.907983 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.907987 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.907989 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.908219 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:15.908340 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.908700 (+ 360us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.908815 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 09:23:15.911206 19368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.900538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58802 (local address 127.11.99.253:33431)
0809 09:23:15.900653 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:15.900657 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:15.901443 (+ 786us) server_negotiation.cc:407] Connection header received
0809 09:23:15.901594 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:15.901596 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:15.901632 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:15.901676 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:15.902416 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.903080 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.904113 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.904413 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.904538 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.907254 (+ 2716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:15.907258 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:15.907261 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:15.907283 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:15.908881 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.909652 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.909655 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.909656 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.909747 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.910128 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.910131 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.910132 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.910301 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:15.910456 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.910878 (+ 422us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.911027 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 09:23:15.913674 19953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:15.885758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41532 (local address 127.11.99.252:42189)
0809 09:23:15.885947 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:15.885953 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:15.905407 (+ 19454us) server_negotiation.cc:407] Connection header received
0809 09:23:15.905566 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:15.905569 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:15.905612 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:15.905658 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:15.906541 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.907314 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.908362 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:15.908674 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:15.908738 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:15.910499 (+ 1761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:15.910502 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:15.910504 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:15.910527 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:15.912178 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.912635 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.912638 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.912639 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.912710 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:15.912985 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:15.912987 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:15.912988 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:15.913128 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:15.913212 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:15.913421 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 09:23:15.913504 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":102}
I20260809 09:23:16.867973 20011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:16.867439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.11.99.194:48279)
0809 09:23:16.867737 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:16.867853 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":88,"threads_started":1}
W20260809 09:23:16.868261 19794 heartbeater.cc:644] Failed to heartbeat to 127.11.99.254:34359 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
I20260809 09:23:16.871853 20012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:16.871487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.11.99.195:45983)
0809 09:23:16.871702 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:16.871774 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":67,"threads_started":1}
W20260809 09:23:16.872128 19941 heartbeater.cc:644] Failed to heartbeat to 127.11.99.254:34359 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
I20260809 09:23:16.874953 20013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:16.874560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.11.99.193:57989)
0809 09:23:16.874812 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:16.874881 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":113,"threads_started":1}
W20260809 09:23:16.875269 19646 heartbeater.cc:644] Failed to heartbeat to 127.11.99.254:34359 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
I20260809 09:23:17.380271 20014 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d21e91659d045cf9c12e64eb8c6e8e1)
I20260809 09:23:17.380445 20014 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: false } }
I20260809 09:23:17.381053 20014 leader_election.cc:288] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d21e91659d045cf9c12e64eb8c6e8e1 (127.11.99.254:34359), 26c03b4d789144e697e2ebe38db29541 (127.11.99.253:33431)
I20260809 09:23:17.381433 20016 raft_consensus.cc:482] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d21e91659d045cf9c12e64eb8c6e8e1)
I20260809 09:23:17.381635 20016 raft_consensus.cc:504] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: false } }
I20260809 09:23:17.381731 20015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.381199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.0.0.1:57888)
0809 09:23:17.381451 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.381625 (+ 174us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":63,"threads_started":1}
W20260809 09:23:17.381965 19432 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
I20260809 09:23:17.382843 20015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.382566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.0.0.1:57892)
0809 09:23:17.382696 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.382762 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260809 09:23:17.382934 19432 leader_election.cc:334] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d21e91659d045cf9c12e64eb8c6e8e1 (127.11.99.254:34359): Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
I20260809 09:23:17.383412 20020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.382873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.0.0.1:57902)
0809 09:23:17.383203 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.383301 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":65,"threads_started":1}
W20260809 09:23:17.383581 19221 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
I20260809 09:23:17.383795 20016 leader_election.cc:288] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d21e91659d045cf9c12e64eb8c6e8e1 (127.11.99.254:34359), 4108f000946244afb83c1071e331520c (127.11.99.252:42189)
I20260809 09:23:17.384636 20023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.384231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.0.0.1:57918)
0809 09:23:17.384494 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.384547 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":106,"threads_started":1}
W20260809 09:23:17.384756 19221 leader_election.cc:334] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d21e91659d045cf9c12e64eb8c6e8e1 (127.11.99.254:34359): Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
I20260809 09:23:17.385828 20017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.381542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:33431 (local address 127.0.0.1:58810)
0809 09:23:17.381821 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.381838 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:17.381941 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:17.382443 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:17.382446 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:17.382470 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:17.382578 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:17.382584 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:17.383611 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:17.383617 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:17.384772 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:17.384784 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:17.385478 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:17.385481 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:17.385588 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:17.385613 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 09:23:17.385678 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 09:23:17.385739 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":58,"threads_started":1}
I20260809 09:23:17.385921 20018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.381615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58810 (local address 127.11.99.253:33431)
0809 09:23:17.382168 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:17.382172 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:17.382200 (+ 28us) server_negotiation.cc:407] Connection header received
0809 09:23:17.382254 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:17.382259 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:17.382312 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:17.382416 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:17.382746 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:17.383509 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:17.384946 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:17.385361 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:17.385451 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:17.385509 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:17.385713 (+ 204us) server_negotiation.cc:299] Negotiation successful
0809 09:23:17.385787 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":62,"threads_started":1}
I20260809 09:23:17.386417 19235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4108f000946244afb83c1071e331520c" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "26c03b4d789144e697e2ebe38db29541" is_pre_election: true
I20260809 09:23:17.386554 19235 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4108f000946244afb83c1071e331520c in term 1.
I20260809 09:23:17.386878 19432 leader_election.cc:302] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26c03b4d789144e697e2ebe38db29541, 4108f000946244afb83c1071e331520c; no voters: 4d21e91659d045cf9c12e64eb8c6e8e1
I20260809 09:23:17.387053 20014 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 09:23:17.387113 20014 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d21e91659d045cf9c12e64eb8c6e8e1)
I20260809 09:23:17.387166 20014 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 1 FOLLOWER]: Advancing to term 2
I20260809 09:23:17.387964 20021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.383445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41552 (local address 127.11.99.252:42189)
0809 09:23:17.383746 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:17.383756 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:17.384091 (+ 335us) server_negotiation.cc:407] Connection header received
0809 09:23:17.384269 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:17.384274 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:17.384313 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:17.384403 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:17.384818 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:17.385484 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:17.386821 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:17.387372 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:17.387503 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:17.387566 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:17.387766 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 09:23:17.387835 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":106,"threads_started":1}
I20260809 09:23:17.387953 20020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.383884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:42189 (local address 127.0.0.1:41552)
0809 09:23:17.384012 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.384025 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:17.384160 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:17.384505 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:17.384508 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:17.384525 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:17.384618 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:17.384624 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:17.385593 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:17.385595 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:17.386647 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:17.386677 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:17.387498 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:17.387502 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:17.387610 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:17.387635 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 09:23:17.387747 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 09:23:17.387822 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73}
I20260809 09:23:17.388279 20014 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: false } }
I20260809 09:23:17.388463 19459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "26c03b4d789144e697e2ebe38db29541" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4108f000946244afb83c1071e331520c" is_pre_election: true
I20260809 09:23:17.388628 20014 leader_election.cc:288] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [CANDIDATE]: Term 2 election: Requested vote from peers 4d21e91659d045cf9c12e64eb8c6e8e1 (127.11.99.254:34359), 26c03b4d789144e697e2ebe38db29541 (127.11.99.253:33431)
I20260809 09:23:17.388675 19459 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26c03b4d789144e697e2ebe38db29541 in current term 2: Already voted for candidate 4108f000946244afb83c1071e331520c in this term.
I20260809 09:23:17.388916 20017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.388712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.0.0.1:57926)
0809 09:23:17.388797 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.388847 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 09:23:17.389086 19220 leader_election.cc:302] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26c03b4d789144e697e2ebe38db29541; no voters: 4108f000946244afb83c1071e331520c, 4d21e91659d045cf9c12e64eb8c6e8e1
I20260809 09:23:17.389081 19235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4108f000946244afb83c1071e331520c" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "26c03b4d789144e697e2ebe38db29541"
I20260809 09:23:17.389231 19235 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [term 1 FOLLOWER]: Advancing to term 2
I20260809 09:23:17.389622 20017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.389427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.0.0.1:57928)
0809 09:23:17.389528 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.389575 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 09:23:17.389742 19432 leader_election.cc:334] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4d21e91659d045cf9c12e64eb8c6e8e1 (127.11.99.254:34359): Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
I20260809 09:23:17.390326 19235 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4108f000946244afb83c1071e331520c in term 2.
I20260809 09:23:17.390458 20016 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 09:23:17.390715 19432 leader_election.cc:302] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26c03b4d789144e697e2ebe38db29541, 4108f000946244afb83c1071e331520c; no voters: 4d21e91659d045cf9c12e64eb8c6e8e1
I20260809 09:23:17.390893 20014 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 2 FOLLOWER]: Leader election won for term 2
I20260809 09:23:17.391095 20014 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [term 2 LEADER]: Becoming Leader. State: Replica: 4108f000946244afb83c1071e331520c, State: Running, Role: LEADER
I20260809 09:23:17.391346 20014 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: false } }
I20260809 09:23:17.392448 20025 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4108f000946244afb83c1071e331520c. Latest consensus state: current_term: 2 leader_uuid: "4108f000946244afb83c1071e331520c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: false } } }
I20260809 09:23:17.392545 20025 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:17.392824 20027 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:23:17.395167 20027 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:23:17.395540 20027 catalog_manager.cc:1259] Loaded cluster ID: 67352674f28c4805b8e680baebaf2812
I20260809 09:23:17.395617 20027 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:23:17.396123 20027 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:23:17.396498 20027 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c: Loaded TSK: 0
I20260809 09:23:17.397166 20027 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:23:17.420337 19447 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41544:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 09:23:17.423458 19447 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:23:17.426075 20017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.425842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.0.0.1:57946)
0809 09:23:17.425969 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.426014 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 09:23:17.426093 19235 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [term 2 FOLLOWER]: Refusing update from remote peer 4108f000946244afb83c1071e331520c: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260809 09:23:17.426733 20017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.426504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.0.0.1:57948)
0809 09:23:17.426606 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.426673 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 09:23:17.426810 20014 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [LEADER]: Connected to new peer: Peer: permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260809 09:23:17.427012 19432 consensus_peers.cc:487] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c -> Peer 4d21e91659d045cf9c12e64eb8c6e8e1 (127.11.99.254:34359): Couldn't send request to peer 4d21e91659d045cf9c12e64eb8c6e8e1. Status: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 09:23:17.428311 20016 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4108f000946244afb83c1071e331520c. Latest consensus state: current_term: 2 leader_uuid: "4108f000946244afb83c1071e331520c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: false } } }
I20260809 09:23:17.428428 20016 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:23:17.429584 20014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "4108f000946244afb83c1071e331520c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: false } } }
I20260809 09:23:17.429955 20016 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "4108f000946244afb83c1071e331520c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4d21e91659d045cf9c12e64eb8c6e8e1" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34359 } } peers { permanent_uuid: "26c03b4d789144e697e2ebe38db29541" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33431 } attrs { promote: false } } peers { permanent_uuid: "4108f000946244afb83c1071e331520c" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 42189 } attrs { promote: false } } }
I20260809 09:23:17.430081 20016 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26c03b4d789144e697e2ebe38db29541 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:23:17.429834 20014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:17.430795 20029 mvcc.cc:205] Tried to move back new op lower bound from 7316551259853078528 to 7316551259717394432. Current Snapshot: MvccSnapshot[applied={T|T < 7316551259853078528 or (T in {7316551259853078528})}]
I20260809 09:23:17.440330 20038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.436474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49830 (local address 127.11.99.193:44613)
0809 09:23:17.436738 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:17.436742 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:17.437092 (+ 350us) server_negotiation.cc:407] Connection header received
0809 09:23:17.437206 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:17.437208 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:17.437258 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:17.437347 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:17.437597 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:17.438151 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:17.439360 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:17.439767 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:17.439881 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:17.439943 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:17.440116 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 09:23:17.440196 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":97,"threads_started":1}
I20260809 09:23:17.440331 20037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.436362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:44613 (local address 127.0.0.1:49830)
0809 09:23:17.437003 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.437014 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:17.437124 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:17.437354 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:17.437357 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:17.437373 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:17.437493 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:17.437498 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:17.438265 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:17.438268 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:17.439253 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:17.439265 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:17.439890 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:17.439893 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:17.439988 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:17.440009 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 09:23:17.440099 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 09:23:17.440201 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"mutex_wait_us":4,"spinlock_wait_cycles":1408,"thread_start_us":90,"threads_started":1}
I20260809 09:23:17.440543 20017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.435719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:34079 (local address 127.0.0.1:43490)
0809 09:23:17.435866 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.435881 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:17.435963 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:17.436944 (+ 981us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:17.436947 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:17.436963 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:17.437052 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:17.437059 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:17.438042 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:17.438045 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:17.439178 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:17.439189 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:17.440122 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:17.440125 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:17.440234 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:17.440257 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 09:23:17.440322 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 09:23:17.440404 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71,"mutex_wait_us":17}
I20260809 09:23:17.440791 20015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.436010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:34179 (local address 127.0.0.1:42216)
0809 09:23:17.436252 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.436284 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:17.436364 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:17.437385 (+ 1021us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:17.437388 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:17.437414 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:17.437499 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:17.437504 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:17.438505 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:17.438508 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:17.439598 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:17.439606 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:17.440446 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:17.440450 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:17.440527 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:17.440547 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 09:23:17.440600 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 09:23:17.440666 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"spinlock_wait_cycles":768}
I20260809 09:23:17.441008 20036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.436132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43490 (local address 127.11.99.194:34079)
0809 09:23:17.436715 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:17.436719 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:17.436735 (+ 16us) server_negotiation.cc:407] Connection header received
0809 09:23:17.436787 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:17.436790 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:17.436839 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:17.436935 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:17.437175 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:17.437920 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:17.439311 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:17.439914 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:17.440003 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:17.440068 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:17.440780 (+ 712us) server_negotiation.cc:299] Negotiation successful
0809 09:23:17.440865 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":80,"threads_started":1}
I20260809 09:23:17.441351 20039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.436524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42216 (local address 127.11.99.195:34179)
0809 09:23:17.437159 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:17.437163 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:17.437175 (+ 12us) server_negotiation.cc:407] Connection header received
0809 09:23:17.437224 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:17.437226 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:17.437269 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:17.437599 (+ 330us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:17.437698 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:17.438385 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:17.439734 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:17.440332 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:17.441056 (+ 724us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:17.441117 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:17.441159 (+ 42us) server_negotiation.cc:299] Negotiation successful
0809 09:23:17.441225 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":87,"threads_started":1}
I20260809 09:23:17.441533 19573 tablet_service.cc:1467] Processing CreateTablet for tablet bd07d7842a2743648fa07e3edbe780f3 (DEFAULT_TABLE table=test-table [id=c7b7ebc6fbe14c6a832002c4d4c8d4f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:17.441543 19721 tablet_service.cc:1467] Processing CreateTablet for tablet bd07d7842a2743648fa07e3edbe780f3 (DEFAULT_TABLE table=test-table [id=c7b7ebc6fbe14c6a832002c4d4c8d4f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:17.441830 19573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd07d7842a2743648fa07e3edbe780f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:17.441790 19869 tablet_service.cc:1467] Processing CreateTablet for tablet bd07d7842a2743648fa07e3edbe780f3 (DEFAULT_TABLE table=test-table [id=c7b7ebc6fbe14c6a832002c4d4c8d4f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:17.441846 19721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd07d7842a2743648fa07e3edbe780f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:17.442027 19869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd07d7842a2743648fa07e3edbe780f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:17.444152 20040 tablet_bootstrap.cc:492] T bd07d7842a2743648fa07e3edbe780f3 P 1af4d1976895429ea93b4b592a95a459: Bootstrap starting.
I20260809 09:23:17.445047 20040 tablet_bootstrap.cc:654] T bd07d7842a2743648fa07e3edbe780f3 P 1af4d1976895429ea93b4b592a95a459: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:17.446206 20040 tablet_bootstrap.cc:492] T bd07d7842a2743648fa07e3edbe780f3 P 1af4d1976895429ea93b4b592a95a459: No bootstrap required, opened a new log
I20260809 09:23:17.446321 20040 ts_tablet_manager.cc:1397] T bd07d7842a2743648fa07e3edbe780f3 P 1af4d1976895429ea93b4b592a95a459: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 09:23:17.446827 20040 raft_consensus.cc:348] T bd07d7842a2743648fa07e3edbe780f3 P 1af4d1976895429ea93b4b592a95a459 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af4d1976895429ea93b4b592a95a459" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34079 } } peers { permanent_uuid: "38cfb4a35c25467da364b523c6f9d4aa" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 34179 } } peers { permanent_uuid: "98e2cbb71746469e88c2e7df776fe386" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 44613 } }
I20260809 09:23:17.446936 20040 raft_consensus.cc:374] T bd07d7842a2743648fa07e3edbe780f3 P 1af4d1976895429ea93b4b592a95a459 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:17.446974 20040 raft_consensus.cc:729] T bd07d7842a2743648fa07e3edbe780f3 P 1af4d1976895429ea93b4b592a95a459 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1af4d1976895429ea93b4b592a95a459, State: Initialized, Role: FOLLOWER
I20260809 09:23:17.447111 20040 consensus_queue.cc:260] T bd07d7842a2743648fa07e3edbe780f3 P 1af4d1976895429ea93b4b592a95a459 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af4d1976895429ea93b4b592a95a459" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34079 } } peers { permanent_uuid: "38cfb4a35c25467da364b523c6f9d4aa" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 34179 } } peers { permanent_uuid: "98e2cbb71746469e88c2e7df776fe386" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 44613 } }
I20260809 09:23:17.447467 20040 ts_tablet_manager.cc:1428] T bd07d7842a2743648fa07e3edbe780f3 P 1af4d1976895429ea93b4b592a95a459: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260809 09:23:17.448140 20046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.447760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.11.99.194:40891)
0809 09:23:17.447989 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.448050 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":97,"threads_started":1}
I20260809 09:23:17.448225 20041 tablet_bootstrap.cc:492] T bd07d7842a2743648fa07e3edbe780f3 P 98e2cbb71746469e88c2e7df776fe386: Bootstrap starting.
I20260809 09:23:17.448941 20041 tablet_bootstrap.cc:654] T bd07d7842a2743648fa07e3edbe780f3 P 98e2cbb71746469e88c2e7df776fe386: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:17.449441 20042 tablet_bootstrap.cc:492] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa: Bootstrap starting.
I20260809 09:23:17.449611 19793 heartbeater.cc:503] Master 127.11.99.252:42189 was elected leader, sending a full tablet report...
I20260809 09:23:17.450255 20042 tablet_bootstrap.cc:654] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:17.451066 20041 tablet_bootstrap.cc:492] T bd07d7842a2743648fa07e3edbe780f3 P 98e2cbb71746469e88c2e7df776fe386: No bootstrap required, opened a new log
I20260809 09:23:17.451152 20041 ts_tablet_manager.cc:1397] T bd07d7842a2743648fa07e3edbe780f3 P 98e2cbb71746469e88c2e7df776fe386: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260809 09:23:17.451360 20046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.451107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.11.99.194:60209)
0809 09:23:17.451255 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.451304 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260809 09:23:17.451589 20041 raft_consensus.cc:348] T bd07d7842a2743648fa07e3edbe780f3 P 98e2cbb71746469e88c2e7df776fe386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af4d1976895429ea93b4b592a95a459" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34079 } } peers { permanent_uuid: "38cfb4a35c25467da364b523c6f9d4aa" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 34179 } } peers { permanent_uuid: "98e2cbb71746469e88c2e7df776fe386" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 44613 } }
I20260809 09:23:17.451699 20041 raft_consensus.cc:374] T bd07d7842a2743648fa07e3edbe780f3 P 98e2cbb71746469e88c2e7df776fe386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:17.451722 20041 raft_consensus.cc:729] T bd07d7842a2743648fa07e3edbe780f3 P 98e2cbb71746469e88c2e7df776fe386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98e2cbb71746469e88c2e7df776fe386, State: Initialized, Role: FOLLOWER
I20260809 09:23:17.451844 20041 consensus_queue.cc:260] T bd07d7842a2743648fa07e3edbe780f3 P 98e2cbb71746469e88c2e7df776fe386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af4d1976895429ea93b4b592a95a459" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34079 } } peers { permanent_uuid: "38cfb4a35c25467da364b523c6f9d4aa" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 34179 } } peers { permanent_uuid: "98e2cbb71746469e88c2e7df776fe386" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 44613 } }
I20260809 09:23:17.452148 20041 ts_tablet_manager.cc:1428] T bd07d7842a2743648fa07e3edbe780f3 P 98e2cbb71746469e88c2e7df776fe386: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 09:23:17.453271 20042 tablet_bootstrap.cc:492] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa: No bootstrap required, opened a new log
I20260809 09:23:17.453372 20042 ts_tablet_manager.cc:1397] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260809 09:23:17.453639 20050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.452677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.11.99.193:37511)
0809 09:23:17.452903 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.452975 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":105,"threads_started":1}
I20260809 09:23:17.453832 20042 raft_consensus.cc:348] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af4d1976895429ea93b4b592a95a459" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34079 } } peers { permanent_uuid: "38cfb4a35c25467da364b523c6f9d4aa" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 34179 } } peers { permanent_uuid: "98e2cbb71746469e88c2e7df776fe386" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 44613 } }
I20260809 09:23:17.453941 20042 raft_consensus.cc:374] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:17.453984 20042 raft_consensus.cc:729] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38cfb4a35c25467da364b523c6f9d4aa, State: Initialized, Role: FOLLOWER
I20260809 09:23:17.454106 20042 consensus_queue.cc:260] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af4d1976895429ea93b4b592a95a459" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34079 } } peers { permanent_uuid: "38cfb4a35c25467da364b523c6f9d4aa" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 34179 } } peers { permanent_uuid: "98e2cbb71746469e88c2e7df776fe386" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 44613 } }
I20260809 09:23:17.454226 19645 heartbeater.cc:503] Master 127.11.99.252:42189 was elected leader, sending a full tablet report...
I20260809 09:23:17.454313 20050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.454102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.11.99.193:38931)
0809 09:23:17.454190 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.454244 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260809 09:23:17.454424 20042 ts_tablet_manager.cc:1428] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 09:23:17.455590 20052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.454830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.11.99.195:39063)
0809 09:23:17.455416 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.455471 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":86,"threads_started":1}
I20260809 09:23:17.455978 19940 heartbeater.cc:503] Master 127.11.99.252:42189 was elected leader, sending a full tablet report...
I20260809 09:23:17.456386 20052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.455984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.11.99.195:40343)
0809 09:23:17.456256 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.456308 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":94,"threads_started":1}
W20260809 09:23:17.482025 19648 tablet.cc:2369] T bd07d7842a2743648fa07e3edbe780f3 P 98e2cbb71746469e88c2e7df776fe386: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 09:23:17.687970 19943 tablet.cc:2369] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 09:23:17.695902 19797 tablet.cc:2369] T bd07d7842a2743648fa07e3edbe780f3 P 1af4d1976895429ea93b4b592a95a459: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:23:17.780730 20051 raft_consensus.cc:482] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:23:17.780884 20051 raft_consensus.cc:504] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af4d1976895429ea93b4b592a95a459" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34079 } } peers { permanent_uuid: "38cfb4a35c25467da364b523c6f9d4aa" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 34179 } } peers { permanent_uuid: "98e2cbb71746469e88c2e7df776fe386" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 44613 } }
I20260809 09:23:17.781365 20051 leader_election.cc:288] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1af4d1976895429ea93b4b592a95a459 (127.11.99.194:34079), 98e2cbb71746469e88c2e7df776fe386 (127.11.99.193:44613)
I20260809 09:23:17.781898 19745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd07d7842a2743648fa07e3edbe780f3" candidate_uuid: "38cfb4a35c25467da364b523c6f9d4aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1af4d1976895429ea93b4b592a95a459" is_pre_election: true
I20260809 09:23:17.781951 19596 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd07d7842a2743648fa07e3edbe780f3" candidate_uuid: "38cfb4a35c25467da364b523c6f9d4aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98e2cbb71746469e88c2e7df776fe386" is_pre_election: true
I20260809 09:23:17.782069 19745 raft_consensus.cc:2454] T bd07d7842a2743648fa07e3edbe780f3 P 1af4d1976895429ea93b4b592a95a459 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38cfb4a35c25467da364b523c6f9d4aa in term 0.
I20260809 09:23:17.782091 19596 raft_consensus.cc:2454] T bd07d7842a2743648fa07e3edbe780f3 P 98e2cbb71746469e88c2e7df776fe386 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38cfb4a35c25467da364b523c6f9d4aa in term 0.
I20260809 09:23:17.782428 19821 leader_election.cc:302] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38cfb4a35c25467da364b523c6f9d4aa, 98e2cbb71746469e88c2e7df776fe386; no voters:
I20260809 09:23:17.782692 20051 raft_consensus.cc:2781] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:23:17.782750 20051 raft_consensus.cc:482] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:23:17.782778 20051 raft_consensus.cc:3037] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:17.783821 20051 raft_consensus.cc:504] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af4d1976895429ea93b4b592a95a459" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34079 } } peers { permanent_uuid: "38cfb4a35c25467da364b523c6f9d4aa" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 34179 } } peers { permanent_uuid: "98e2cbb71746469e88c2e7df776fe386" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 44613 } }
I20260809 09:23:17.784145 20051 leader_election.cc:288] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa [CANDIDATE]: Term 1 election: Requested vote from peers 1af4d1976895429ea93b4b592a95a459 (127.11.99.194:34079), 98e2cbb71746469e88c2e7df776fe386 (127.11.99.193:44613)
I20260809 09:23:17.784529 19745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd07d7842a2743648fa07e3edbe780f3" candidate_uuid: "38cfb4a35c25467da364b523c6f9d4aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1af4d1976895429ea93b4b592a95a459"
I20260809 09:23:17.784657 19745 raft_consensus.cc:3037] T bd07d7842a2743648fa07e3edbe780f3 P 1af4d1976895429ea93b4b592a95a459 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:17.784802 19596 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd07d7842a2743648fa07e3edbe780f3" candidate_uuid: "38cfb4a35c25467da364b523c6f9d4aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98e2cbb71746469e88c2e7df776fe386"
I20260809 09:23:17.784907 19596 raft_consensus.cc:3037] T bd07d7842a2743648fa07e3edbe780f3 P 98e2cbb71746469e88c2e7df776fe386 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:17.785619 19745 raft_consensus.cc:2454] T bd07d7842a2743648fa07e3edbe780f3 P 1af4d1976895429ea93b4b592a95a459 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38cfb4a35c25467da364b523c6f9d4aa in term 1.
I20260809 09:23:17.785909 19821 leader_election.cc:302] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1af4d1976895429ea93b4b592a95a459, 38cfb4a35c25467da364b523c6f9d4aa; no voters:
I20260809 09:23:17.786054 19596 raft_consensus.cc:2454] T bd07d7842a2743648fa07e3edbe780f3 P 98e2cbb71746469e88c2e7df776fe386 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38cfb4a35c25467da364b523c6f9d4aa in term 1.
I20260809 09:23:17.786103 20051 raft_consensus.cc:2781] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:23:17.786317 20051 raft_consensus.cc:686] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa [term 1 LEADER]: Becoming Leader. State: Replica: 38cfb4a35c25467da364b523c6f9d4aa, State: Running, Role: LEADER
I20260809 09:23:17.786442 20051 consensus_queue.cc:237] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af4d1976895429ea93b4b592a95a459" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34079 } } peers { permanent_uuid: "38cfb4a35c25467da364b523c6f9d4aa" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 34179 } } peers { permanent_uuid: "98e2cbb71746469e88c2e7df776fe386" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 44613 } }
I20260809 09:23:17.787261 20053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.786927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.11.99.195:53481)
0809 09:23:17.787129 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.787187 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130}
I20260809 09:23:17.788143 19447 catalog_manager.cc:5495] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa reported cstate change: term changed from 0 to 1, leader changed from <none> to 38cfb4a35c25467da364b523c6f9d4aa (127.11.99.195). New cstate: current_term: 1 leader_uuid: "38cfb4a35c25467da364b523c6f9d4aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af4d1976895429ea93b4b592a95a459" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38cfb4a35c25467da364b523c6f9d4aa" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 34179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98e2cbb71746469e88c2e7df776fe386" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 44613 } health_report { overall_health: UNKNOWN } } }
I20260809 09:23:17.800232 20039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.796877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42226 (local address 127.11.99.195:34179)
0809 09:23:17.796985 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:17.796989 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:17.797069 (+ 80us) server_negotiation.cc:407] Connection header received
0809 09:23:17.797228 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:17.797231 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:17.797278 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:17.797351 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:23:17.797631 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:17.798266 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:17.799229 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:17.799463 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:17.799568 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:17.799801 (+ 233us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:23:17.799872 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:23:17.799954 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:17.800070 (+ 116us) server_negotiation.cc:299] Negotiation successful
0809 09:23:17.800118 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 09:23:17.802241 19596 raft_consensus.cc:1261] T bd07d7842a2743648fa07e3edbe780f3 P 98e2cbb71746469e88c2e7df776fe386 [term 1 FOLLOWER]: Refusing update from remote peer 38cfb4a35c25467da364b523c6f9d4aa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:23:17.802451 19745 raft_consensus.cc:1261] T bd07d7842a2743648fa07e3edbe780f3 P 1af4d1976895429ea93b4b592a95a459 [term 1 FOLLOWER]: Refusing update from remote peer 38cfb4a35c25467da364b523c6f9d4aa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:23:17.802796 20051 consensus_queue.cc:1035] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "98e2cbb71746469e88c2e7df776fe386" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 44613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:23:17.802917 20054 consensus_queue.cc:1035] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "1af4d1976895429ea93b4b592a95a459" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:23:17.804874 20046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.804595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.11.99.194:37169)
0809 09:23:17.804754 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.804810 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260809 09:23:17.805141 20050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.804763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.11.99.193:44011)
0809 09:23:17.805024 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.805078 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189}
I20260809 09:23:17.807196 20053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.806640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.11.99.195:46555)
0809 09:23:17.807081 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.807134 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375}
I20260809 09:23:17.808192 20050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.807952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.11.99.193:55795)
0809 09:23:17.808080 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.808133 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 09:23:17.809707 20053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.809475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.11.99.195:49885)
0809 09:23:17.809595 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.809647 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 09:23:17.811269 20046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.811053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34359 (local address 127.11.99.194:50059)
0809 09:23:17.811151 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.811206 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 09:23:17.813510 19447 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41544:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:23:17.813663 19447 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41544:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:23:17.817195 19447 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4108f000946244afb83c1071e331520c: Sending DeleteTablet for 3 replicas of tablet bd07d7842a2743648fa07e3edbe780f3
I20260809 09:23:17.817974 19721 tablet_service.cc:1514] Processing DeleteTablet for tablet bd07d7842a2743648fa07e3edbe780f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:17 UTC) from {username='oryx', principal='oryx/127.11.99.252@KRBTEST.COM'} at 127.0.0.1:43490
I20260809 09:23:17.818212 19869 tablet_service.cc:1514] Processing DeleteTablet for tablet bd07d7842a2743648fa07e3edbe780f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:17 UTC) from {username='oryx', principal='oryx/127.11.99.252@KRBTEST.COM'} at 127.0.0.1:42216
I20260809 09:23:17.818245 19573 tablet_service.cc:1514] Processing DeleteTablet for tablet bd07d7842a2743648fa07e3edbe780f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:17 UTC) from {username='oryx', principal='oryx/127.11.99.252@KRBTEST.COM'} at 127.0.0.1:49830
I20260809 09:23:17.818300 20066 tablet_replica.cc:330] T bd07d7842a2743648fa07e3edbe780f3 P 1af4d1976895429ea93b4b592a95a459: stopping tablet replica
I20260809 09:23:17.818439 20066 raft_consensus.cc:2229] T bd07d7842a2743648fa07e3edbe780f3 P 1af4d1976895429ea93b4b592a95a459 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:23:17.818516 20067 tablet_replica.cc:330] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa: stopping tablet replica
I20260809 09:23:17.818568 20066 raft_consensus.cc:2258] T bd07d7842a2743648fa07e3edbe780f3 P 1af4d1976895429ea93b4b592a95a459 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:23:17.818673 20067 raft_consensus.cc:2229] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa [term 1 LEADER]: Raft consensus shutting down.
I20260809 09:23:17.818851 20067 raft_consensus.cc:2258] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:23:17.818988 20069 tablet_replica.cc:330] T bd07d7842a2743648fa07e3edbe780f3 P 98e2cbb71746469e88c2e7df776fe386: stopping tablet replica
I20260809 09:23:17.819108 20069 raft_consensus.cc:2229] T bd07d7842a2743648fa07e3edbe780f3 P 98e2cbb71746469e88c2e7df776fe386 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:23:17.819248 20069 raft_consensus.cc:2258] T bd07d7842a2743648fa07e3edbe780f3 P 98e2cbb71746469e88c2e7df776fe386 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:23:17.819475 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 19393
I20260809 09:23:17.819480 20066 ts_tablet_manager.cc:1905] T bd07d7842a2743648fa07e3edbe780f3 P 1af4d1976895429ea93b4b592a95a459: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:23:17.821797 20066 ts_tablet_manager.cc:1918] T bd07d7842a2743648fa07e3edbe780f3 P 1af4d1976895429ea93b4b592a95a459: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:23:17.821893 20066 log.cc:1196] T bd07d7842a2743648fa07e3edbe780f3 P 1af4d1976895429ea93b4b592a95a459: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/bd07d7842a2743648fa07e3edbe780f3
I20260809 09:23:17.822140 20066 ts_tablet_manager.cc:1939] T bd07d7842a2743648fa07e3edbe780f3 P 1af4d1976895429ea93b4b592a95a459: Deleting consensus metadata
I20260809 09:23:17.822911 19432 catalog_manager.cc:4841] TS 1af4d1976895429ea93b4b592a95a459 (127.11.99.194:34079): tablet bd07d7842a2743648fa07e3edbe780f3 (table test-table [id=c7b7ebc6fbe14c6a832002c4d4c8d4f4]) successfully deleted
I20260809 09:23:17.826997 20067 ts_tablet_manager.cc:1905] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:23:17.829041 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 19653
I20260809 09:23:17.829118 20067 ts_tablet_manager.cc:1918] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:23:17.829195 20067 log.cc:1196] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/bd07d7842a2743648fa07e3edbe780f3
I20260809 09:23:17.829502 20067 ts_tablet_manager.cc:1939] T bd07d7842a2743648fa07e3edbe780f3 P 38cfb4a35c25467da364b523c6f9d4aa: Deleting consensus metadata
I20260809 09:23:17.829520 20015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:17.829213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:44613 (local address 127.0.0.1:49846)
0809 09:23:17.829382 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:17.829435 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.193:44613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
W20260809 09:23:17.829704 19432 catalog_manager.cc:4584] TS 98e2cbb71746469e88c2e7df776fe386 (127.11.99.193:44613): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bd07d7842a2743648fa07e3edbe780f3: Network error: Client connection negotiation failed: client connection to 127.11.99.193:44613: connect: Connection refused (error 111)
I20260809 09:23:17.830246 19428 catalog_manager.cc:4841] TS 38cfb4a35c25467da364b523c6f9d4aa (127.11.99.195:34179): tablet bd07d7842a2743648fa07e3edbe780f3 (table test-table [id=c7b7ebc6fbe14c6a832002c4d4c8d4f4]) successfully deleted
I20260809 09:23:17.836879 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 19802
I20260809 09:23:17.845315 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 19082
I20260809 09:23:17.853012 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 19197
2026-08-09T09:23:17Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5420 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:23:17 dist-test-slave-pgkr krb5kdc[20073](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:23:17 dist-test-slave-pgkr krb5kdc[20073](info): set up 2 sockets
Aug 09 09:23:17 dist-test-slave-pgkr krb5kdc[20073](info): commencing operation
krb5kdc: starting...
W20260809 09:23:18.917019 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:23:18 dist-test-slave-pgkr krb5kdc[20073](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267398, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:23:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:23:19Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.254.keytab.
Entry for principal oryx/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.254.keytab.
I20260809 09:23:19.029559 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:35617
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.254.keytab
--principal=oryx/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:43175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:35617
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:19.134821 20088 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:19.135040 20088 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:19.135076 20088 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:19.138890 20088 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:23:19.138938 20088 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 09:23:19.138954 20088 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:19.138971 20088 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:19.139022 20088 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:23:19.139045 20088 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:23:19.143882 20088 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:43175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:35617
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.254.keytab
--principal=oryx/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:35617
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20088
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:19.144763 20088 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:19.145618 20088 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:19.153304 20094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:19.153308 20095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:19.153389 20088 server_base.cc:1034] running on GCE node
W20260809 09:23:19.153308 20097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:19.154080 20088 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:19.155140 20088 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:19.156319 20088 hybrid_clock.cc:648] HybridClock initialized: now 1786267399156296 us; error 34 us; skew 500 ppm
Aug 09 09:23:19 dist-test-slave-pgkr krb5kdc[20073](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267399, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:19.165165 20088 init.cc:377] Logged in from keytab as oryx/127.11.99.254@KRBTEST.COM (short username oryx)
I20260809 09:23:19.166033 20088 webserver.cc:460] Webserver started at http://127.11.99.254:33301/ using document root <none> and password file <none>
I20260809 09:23:19.166559 20088 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:19.166676 20088 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:19.166914 20088 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:19.168812 20088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "f765f921e6bf454d911e73c148b49c2f"
format_stamp: "Formatted at 2026-08-09 09:23:19 on dist-test-slave-pgkr"
server_key: "8e8c6cafe7e1826dc1b30f723031f21e"
server_key_iv: "f489669df5c61d9b9dc6da15c4f19aaa"
server_key_version: "encryptionkey@0"
I20260809 09:23:19.169342 20088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "f765f921e6bf454d911e73c148b49c2f"
format_stamp: "Formatted at 2026-08-09 09:23:19 on dist-test-slave-pgkr"
server_key: "8e8c6cafe7e1826dc1b30f723031f21e"
server_key_iv: "f489669df5c61d9b9dc6da15c4f19aaa"
server_key_version: "encryptionkey@0"
I20260809 09:23:19.172842 20088 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:23:19.175137 20104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:19.176227 20088 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:23:19.176375 20088 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "f765f921e6bf454d911e73c148b49c2f"
format_stamp: "Formatted at 2026-08-09 09:23:19 on dist-test-slave-pgkr"
server_key: "8e8c6cafe7e1826dc1b30f723031f21e"
server_key_iv: "f489669df5c61d9b9dc6da15c4f19aaa"
server_key_version: "encryptionkey@0"
I20260809 09:23:19.176479 20088 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:19.191005 20088 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:19.194039 20088 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:19.194231 20088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:19.201205 20088 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:35617
I20260809 09:23:19.201215 20171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:35617 every 8 connection(s)
I20260809 09:23:19.201996 20088 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:23:19.204573 20172 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:19.205261 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 20088
I20260809 09:23:19.205374 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:23:19.205678 11663 external_mini_cluster.cc:1428] Setting key a4a64685cdcba847eb9925581a1bd834
I20260809 09:23:19.210210 20172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f: Bootstrap starting.
I20260809 09:23:19.212272 20172 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:19.212904 20172 log.cc:824] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f: Log is configured to *not* fsync() on all Append() calls
Aug 09 09:23:19 dist-test-slave-pgkr krb5kdc[20073](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267398, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM
I20260809 09:23:19.214978 20172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f: No bootstrap required, opened a new log
I20260809 09:23:19.217518 20172 raft_consensus.cc:348] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f765f921e6bf454d911e73c148b49c2f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35617 } }
I20260809 09:23:19.217756 20172 raft_consensus.cc:374] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:19.217856 20172 raft_consensus.cc:729] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f765f921e6bf454d911e73c148b49c2f, State: Initialized, Role: FOLLOWER
I20260809 09:23:19.218304 20172 consensus_queue.cc:260] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f765f921e6bf454d911e73c148b49c2f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35617 } }
I20260809 09:23:19.218467 20172 raft_consensus.cc:388] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:23:19.218530 20172 raft_consensus.cc:482] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:23:19.218648 20172 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:19.219578 20172 raft_consensus.cc:504] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f765f921e6bf454d911e73c148b49c2f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35617 } }
I20260809 09:23:19.219890 20172 leader_election.cc:302] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f765f921e6bf454d911e73c148b49c2f; no voters:
I20260809 09:23:19.220166 20172 leader_election.cc:288] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:23:19.220184 20175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:19.207147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37664 (local address 127.11.99.254:35617)
0809 09:23:19.207545 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:19.207575 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:19.207618 (+ 43us) server_negotiation.cc:407] Connection header received
0809 09:23:19.208330 (+ 712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:19.208345 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:19.208634 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:19.208948 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:19.209760 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.210788 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.211623 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.212066 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.212220 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:19.214988 (+ 2768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:19.214992 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:19.215002 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:19.215046 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:19.217119 (+ 2073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:19.217634 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:19.217638 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:19.217642 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:19.217813 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:19.218145 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:19.218148 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:19.218150 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:19.218667 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:19.218867 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:19.219087 (+ 220us) server_negotiation.cc:299] Negotiation successful
0809 09:23:19.219352 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":122,"threads_started":1}
I20260809 09:23:19.220311 20177 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:23:19.220508 20177 raft_consensus.cc:686] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f [term 1 LEADER]: Becoming Leader. State: Replica: f765f921e6bf454d911e73c148b49c2f, State: Running, Role: LEADER
I20260809 09:23:19.220829 20177 consensus_queue.cc:237] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f765f921e6bf454d911e73c148b49c2f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35617 } }
I20260809 09:23:19.221262 20172 sys_catalog.cc:564] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:23:19.221956 20177 sys_catalog.cc:455] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f [sys.catalog]: SysCatalogTable state changed. Reason: New leader f765f921e6bf454d911e73c148b49c2f. Latest consensus state: current_term: 1 leader_uuid: "f765f921e6bf454d911e73c148b49c2f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f765f921e6bf454d911e73c148b49c2f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35617 } } }
I20260809 09:23:19.222132 20177 sys_catalog.cc:458] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:19.222837 20188 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:23:19.222863 20178 sys_catalog.cc:455] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f765f921e6bf454d911e73c148b49c2f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f765f921e6bf454d911e73c148b49c2f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35617 } } }
I20260809 09:23:19.222954 20178 sys_catalog.cc:458] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:19.225378 20188 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:23:19.230086 20188 catalog_manager.cc:1347] Generated new cluster ID: 52f4dab82817432e898431c493a8962d
I20260809 09:23:19.230146 20188 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:23:19.240778 20188 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:23:19.241609 20188 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:23:19.252835 20188 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f: Generated new TSK 0
I20260809 09:23:19.253576 20188 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.99.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.99.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.99.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.193.keytab.
Entry for principal oryx/127.11.99.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.193.keytab.
I20260809 09:23:19.285069 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:0
--local_ip_for_outbound_sockets=127.11.99.193
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:35617
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.193.keytab
--principal=oryx/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:43175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:19.424782 20200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:19.425002 20200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:19.425048 20200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:19.428742 20200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:19.428791 20200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:19.428839 20200 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 09:23:19.428869 20200 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:23:19.433802 20200 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:43175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.193.keytab
--principal=oryx/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.99.254:35617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:19.434780 20200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:19.435667 20200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:19.445039 20206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:19.445008 20205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:19.445078 20200 server_base.cc:1034] running on GCE node
W20260809 09:23:19.445019 20208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:19.445609 20200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:19.446187 20200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:19.447365 20200 hybrid_clock.cc:648] HybridClock initialized: now 1786267399447348 us; error 27 us; skew 500 ppm
Aug 09 09:23:19 dist-test-slave-pgkr krb5kdc[20073](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267399, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:19.449836 20200 init.cc:377] Logged in from keytab as oryx/127.11.99.193@KRBTEST.COM (short username oryx)
I20260809 09:23:19.450532 20200 webserver.cc:460] Webserver started at http://127.11.99.193:43099/ using document root <none> and password file <none>
I20260809 09:23:19.451067 20200 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:19.451153 20200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:19.451381 20200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:19.453222 20200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-0/data/instance:
uuid: "9474147985324fd396ecaa3df8f8bd49"
format_stamp: "Formatted at 2026-08-09 09:23:19 on dist-test-slave-pgkr"
server_key: "3e56fc9d567c38ad64be016d15323899"
server_key_iv: "ce4006ed0363d0d366e7c156e2d47cf6"
server_key_version: "encryptionkey@0"
I20260809 09:23:19.453768 20200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance:
uuid: "9474147985324fd396ecaa3df8f8bd49"
format_stamp: "Formatted at 2026-08-09 09:23:19 on dist-test-slave-pgkr"
server_key: "3e56fc9d567c38ad64be016d15323899"
server_key_iv: "ce4006ed0363d0d366e7c156e2d47cf6"
server_key_version: "encryptionkey@0"
I20260809 09:23:19.457140 20200 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 09:23:19.459363 20217 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:19.460424 20200 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:23:19.460554 20200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "9474147985324fd396ecaa3df8f8bd49"
format_stamp: "Formatted at 2026-08-09 09:23:19 on dist-test-slave-pgkr"
server_key: "3e56fc9d567c38ad64be016d15323899"
server_key_iv: "ce4006ed0363d0d366e7c156e2d47cf6"
server_key_version: "encryptionkey@0"
I20260809 09:23:19.460654 20200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:19.478003 20200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:19.481252 20200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:19.481442 20200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:19.482744 20200 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:19.482811 20200 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:19.482870 20200 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:19.482918 20200 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 09:23:19 dist-test-slave-pgkr krb5kdc[20073](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267399, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM
I20260809 09:23:19.493182 20200 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:38573
I20260809 09:23:19.493261 20341 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:38573 every 8 connection(s)
I20260809 09:23:19.494280 20200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:23:19.496898 20175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:19.483436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:33359 (local address 127.11.99.254:35617)
0809 09:23:19.483595 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:19.483600 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:19.484375 (+ 775us) server_negotiation.cc:407] Connection header received
0809 09:23:19.485248 (+ 873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:19.485251 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:19.485328 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:19.485421 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:19.487044 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.487702 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.488762 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.488987 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.489102 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:19.493279 (+ 4177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:19.493283 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:19.493286 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:19.493313 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:19.494891 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:19.495446 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:19.495451 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:19.495452 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:19.495540 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:19.495880 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:19.495884 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:19.495886 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:19.496066 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:19.496173 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:19.496619 (+ 446us) server_negotiation.cc:299] Negotiation successful
0809 09:23:19.496738 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 09:23:19.497551 20227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:19.483803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:35617 (local address 127.11.99.193:33359)
0809 09:23:19.484192 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:19.484234 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:19.485043 (+ 809us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:19.485719 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:19.485729 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:19.486190 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:19.486845 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:19.486867 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.487831 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.487835 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:19.488639 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:19.488648 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.489144 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.489147 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:19.489289 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:19.489826 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:19.489850 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:19.493097 (+ 3247us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:19.495004 (+ 1907us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:19.495010 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:19.495022 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:19.495342 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:19.495639 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:19.495642 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:19.495644 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:19.495784 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:19.496173 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:19.496179 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:19.496396 (+ 217us) client_negotiation.cc:769] Sending connection context
0809 09:23:19.496578 (+ 182us) client_negotiation.cc:240] Negotiation successful
0809 09:23:19.496852 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":123,"threads_started":1}
I20260809 09:23:19.498577 20342 heartbeater.cc:347] Connected to a master server at 127.11.99.254:35617
I20260809 09:23:19.498713 20342 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:19.499212 20342 heartbeater.cc:511] Master 127.11.99.254:35617 requested a full tablet report, sending...
I20260809 09:23:19.500766 20122 ts_manager.cc:194] Registered new tserver with Master: 9474147985324fd396ecaa3df8f8bd49 (127.11.99.193:38573)
I20260809 09:23:19.501521 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 20200
I20260809 09:23:19.501655 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance
I20260809 09:23:19.501987 11663 external_mini_cluster.cc:1428] Setting key 147cd6b77c5612874e942b473f1812b3
I20260809 09:23:19.502230 20122 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.99.193@KRBTEST.COM'} at 127.11.99.193:33359
I20260809 09:23:19.508311 20175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:19.500693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:40085 (local address 127.11.99.254:35617)
0809 09:23:19.500819 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:19.500822 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:19.501051 (+ 229us) server_negotiation.cc:407] Connection header received
0809 09:23:19.501154 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:19.501156 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:19.501191 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:19.501252 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:19.501722 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.502451 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.503510 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.503858 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.503974 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:19.505013 (+ 1039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:19.505019 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:19.505024 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:19.505055 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:19.506498 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:19.506946 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:19.506951 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:19.506952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:19.507036 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:19.507429 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:19.507432 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:19.507434 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:19.507663 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:19.507779 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:19.508049 (+ 270us) server_negotiation.cc:299] Negotiation successful
0809 09:23:19.508154 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":40}
I20260809 09:23:19.508313 20348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:19.500622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:35617 (local address 127.11.99.193:40085)
0809 09:23:19.500973 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:19.500987 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:19.501079 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:19.501290 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:19.501292 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:19.501477 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:19.501590 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:19.501597 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.502562 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.502566 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:19.503384 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:19.503394 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.503986 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.503990 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:19.504082 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:19.504554 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:19.504568 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:19.504879 (+ 311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:19.506642 (+ 1763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:19.506646 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:19.506648 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:19.506847 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:19.507170 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:19.507173 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:19.507175 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:19.507333 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:19.507784 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:19.507788 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:19.507881 (+ 93us) client_negotiation.cc:769] Sending connection context
0809 09:23:19.507986 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 09:23:19.508119 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":104,"threads_started":1}
WARNING: no policy specified for oryx/127.11.99.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.99.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.99.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.194.keytab.
Entry for principal oryx/127.11.99.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.194.keytab.
I20260809 09:23:19.527060 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:0
--local_ip_for_outbound_sockets=127.11.99.194
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:35617
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.194.keytab
--principal=oryx/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:43175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:19.632509 20351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:19.632745 20351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:19.632787 20351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:19.636663 20351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:19.636716 20351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:19.636751 20351 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 09:23:19.636782 20351 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:23:19.641657 20351 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:43175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.194.keytab
--principal=oryx/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.99.254:35617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20351
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:19.642526 20351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:19.643514 20351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:19.652284 20361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:19.652323 20358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:19.652355 20357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:19.652494 20351 server_base.cc:1034] running on GCE node
I20260809 09:23:19.652961 20351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:19.653585 20351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:19.654744 20351 hybrid_clock.cc:648] HybridClock initialized: now 1786267399654739 us; error 33 us; skew 500 ppm
Aug 09 09:23:19 dist-test-slave-pgkr krb5kdc[20073](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267399, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:19.657428 20351 init.cc:377] Logged in from keytab as oryx/127.11.99.194@KRBTEST.COM (short username oryx)
I20260809 09:23:19.658250 20351 webserver.cc:460] Webserver started at http://127.11.99.194:36757/ using document root <none> and password file <none>
I20260809 09:23:19.658857 20351 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:19.658948 20351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:19.659175 20351 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:19.661159 20351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-1/data/instance:
uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b"
format_stamp: "Formatted at 2026-08-09 09:23:19 on dist-test-slave-pgkr"
server_key: "42f1cee47de367a40d02e6e65639a35f"
server_key_iv: "887d518ab72a8817214ebaae75b3af5e"
server_key_version: "encryptionkey@0"
I20260809 09:23:19.661756 20351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance:
uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b"
format_stamp: "Formatted at 2026-08-09 09:23:19 on dist-test-slave-pgkr"
server_key: "42f1cee47de367a40d02e6e65639a35f"
server_key_iv: "887d518ab72a8817214ebaae75b3af5e"
server_key_version: "encryptionkey@0"
I20260809 09:23:19.665632 20351 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 09:23:19.667870 20370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:19.669036 20351 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 09:23:19.669188 20351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b"
format_stamp: "Formatted at 2026-08-09 09:23:19 on dist-test-slave-pgkr"
server_key: "42f1cee47de367a40d02e6e65639a35f"
server_key_iv: "887d518ab72a8817214ebaae75b3af5e"
server_key_version: "encryptionkey@0"
I20260809 09:23:19.669297 20351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:19.690934 20351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:19.694239 20351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:19.694453 20351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:19.695977 20351 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:19.696059 20351 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:19.696167 20351 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:19.696242 20351 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 09:23:19 dist-test-slave-pgkr krb5kdc[20073](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267399, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM
I20260809 09:23:19.707985 20351 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:38355
I20260809 09:23:19.708025 20496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:38355 every 8 connection(s)
I20260809 09:23:19.709036 20351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:23:19.710953 20175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:19.696735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:36827 (local address 127.11.99.254:35617)
0809 09:23:19.696860 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:19.696869 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:19.697861 (+ 992us) server_negotiation.cc:407] Connection header received
0809 09:23:19.698955 (+ 1094us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:19.698958 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:19.699016 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:19.699113 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:19.700634 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.701515 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.703330 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.703723 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.703836 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:19.707005 (+ 3169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:19.707009 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:19.707011 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:19.707053 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:19.708801 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:19.709358 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:19.709364 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:19.709368 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:19.709472 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:19.710017 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:19.710027 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:19.710028 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:19.710184 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:19.710256 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:19.710752 (+ 496us) server_negotiation.cc:299] Negotiation successful
0809 09:23:19.710842 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 09:23:19.711738 20381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:19.697231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:35617 (local address 127.11.99.194:36827)
0809 09:23:19.697710 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:19.697747 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:19.698722 (+ 975us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:19.699373 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:19.699383 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:19.699885 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:19.700495 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:19.700510 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.701670 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.701676 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:19.703193 (+ 1517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:19.703206 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.703903 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.703910 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:19.704143 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:19.704718 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:19.704741 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:19.706829 (+ 2088us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:19.708907 (+ 2078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:19.708910 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:19.708919 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:19.709242 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:19.709732 (+ 490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:19.709737 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:19.709741 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:19.709906 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:19.710283 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:19.710287 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:19.710497 (+ 210us) client_negotiation.cc:769] Sending connection context
0809 09:23:19.710709 (+ 212us) client_negotiation.cc:240] Negotiation successful
0809 09:23:19.710942 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":139,"threads_started":1}
I20260809 09:23:19.712721 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 20351
I20260809 09:23:19.712865 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance
I20260809 09:23:19.713114 20497 heartbeater.cc:347] Connected to a master server at 127.11.99.254:35617
I20260809 09:23:19.713201 11663 external_mini_cluster.cc:1428] Setting key 68dbe4ce57c94d8e2728cccc7c138975
I20260809 09:23:19.713271 20497 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:19.713990 20497 heartbeater.cc:511] Master 127.11.99.254:35617 requested a full tablet report, sending...
I20260809 09:23:19.715056 20122 ts_manager.cc:194] Registered new tserver with Master: fa9d0f26c8e34ae98ff036ee4a3f377b (127.11.99.194:38355)
I20260809 09:23:19.715838 20122 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.99.194@KRBTEST.COM'} at 127.11.99.194:36827
WARNING: no policy specified for oryx/127.11.99.195@KRBTEST.COM; defaulting to no policy
I20260809 09:23:19.723891 20504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:19.715214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:35617 (local address 127.11.99.194:35507)
0809 09:23:19.715473 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:19.715488 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:19.715576 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:19.716520 (+ 944us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:19.716523 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:19.716839 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:19.717030 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:19.717040 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.718111 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.718114 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:19.718752 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:19.718761 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.719224 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.719228 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:19.719328 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:19.719829 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:19.719844 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:19.720194 (+ 350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:19.722057 (+ 1863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:19.722064 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:19.722067 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:19.722372 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:19.722724 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:19.722730 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:19.722734 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:19.722831 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:19.723295 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:19.723301 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:19.723407 (+ 106us) client_negotiation.cc:769] Sending connection context
0809 09:23:19.723593 (+ 186us) client_negotiation.cc:240] Negotiation successful
0809 09:23:19.723749 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":6,"thread_start_us":95,"threads_started":1}
I20260809 09:23:19.723915 20175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:19.716159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:35507 (local address 127.11.99.254:35617)
0809 09:23:19.716293 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:19.716300 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:19.716315 (+ 15us) server_negotiation.cc:407] Connection header received
0809 09:23:19.716353 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:19.716358 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:19.716420 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:19.716503 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:19.717189 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.717909 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.718885 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.719108 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.719223 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:19.720341 (+ 1118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:19.720345 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:19.720348 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:19.720373 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:19.721935 (+ 1562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:19.722474 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:19.722479 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:19.722481 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:19.722588 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:19.722967 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:19.722969 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:19.722970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:19.723172 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:19.723284 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:19.723685 (+ 401us) server_negotiation.cc:299] Negotiation successful
0809 09:23:19.723799 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.99.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.99.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.195.keytab.
Entry for principal oryx/127.11.99.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.195.keytab.
I20260809 09:23:19.740998 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:0
--local_ip_for_outbound_sockets=127.11.99.195
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:35617
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.195.keytab
--principal=oryx/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:43175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:19.847450 20509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:19.847683 20509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:19.847754 20509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:19.851668 20509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:19.851716 20509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:19.851781 20509 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 09:23:19.851866 20509 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:23:19.856894 20509 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:43175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.195.keytab
--principal=oryx/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.99.254:35617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20509
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:19.857813 20509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:19.858826 20509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:19.867882 20515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:19.868099 20509 server_base.cc:1034] running on GCE node
W20260809 09:23:19.867852 20516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:19.867865 20518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:19.868603 20509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:19.869230 20509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:19.870416 20509 hybrid_clock.cc:648] HybridClock initialized: now 1786267399870377 us; error 50 us; skew 500 ppm
Aug 09 09:23:19 dist-test-slave-pgkr krb5kdc[20073](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267399, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:19.873176 20509 init.cc:377] Logged in from keytab as oryx/127.11.99.195@KRBTEST.COM (short username oryx)
I20260809 09:23:19.874006 20509 webserver.cc:460] Webserver started at http://127.11.99.195:35625/ using document root <none> and password file <none>
I20260809 09:23:19.874571 20509 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:19.874682 20509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:19.874909 20509 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:19.876921 20509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-2/data/instance:
uuid: "4d4fa3748e044961a6f00561784a5cae"
format_stamp: "Formatted at 2026-08-09 09:23:19 on dist-test-slave-pgkr"
server_key: "4ce382f8a40455938c361e17fe4ec14f"
server_key_iv: "0a2f333f53c2262c83177e9d99ff986b"
server_key_version: "encryptionkey@0"
I20260809 09:23:19.877494 20509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance:
uuid: "4d4fa3748e044961a6f00561784a5cae"
format_stamp: "Formatted at 2026-08-09 09:23:19 on dist-test-slave-pgkr"
server_key: "4ce382f8a40455938c361e17fe4ec14f"
server_key_iv: "0a2f333f53c2262c83177e9d99ff986b"
server_key_version: "encryptionkey@0"
I20260809 09:23:19.881076 20509 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 09:23:19.883247 20526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:19.884291 20509 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 09:23:19.884416 20509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "4d4fa3748e044961a6f00561784a5cae"
format_stamp: "Formatted at 2026-08-09 09:23:19 on dist-test-slave-pgkr"
server_key: "4ce382f8a40455938c361e17fe4ec14f"
server_key_iv: "0a2f333f53c2262c83177e9d99ff986b"
server_key_version: "encryptionkey@0"
I20260809 09:23:19.884517 20509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:19.894985 20509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:19.897562 20509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:19.897747 20509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:19.899233 20509 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:19.899303 20509 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:19.899408 20509 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:19.899456 20509 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 09:23:19 dist-test-slave-pgkr krb5kdc[20073](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267399, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM
I20260809 09:23:19.910141 20509 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:44877
I20260809 09:23:19.910386 20647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:44877 every 8 connection(s)
I20260809 09:23:19.911083 20509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:23:19.912649 20175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:19.899890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:41841 (local address 127.11.99.254:35617)
0809 09:23:19.900051 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:19.900058 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:19.900842 (+ 784us) server_negotiation.cc:407] Connection header received
0809 09:23:19.901712 (+ 870us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:19.901718 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:19.901779 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:19.901880 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:19.903158 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.903678 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.904769 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.905135 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.905261 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:19.908865 (+ 3604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:19.908869 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:19.908875 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:19.908902 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:19.910585 (+ 1683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:19.911097 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:19.911101 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:19.911103 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:19.911211 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:19.911577 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:19.911581 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:19.911583 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:19.911819 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:19.911906 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:19.912398 (+ 492us) server_negotiation.cc:299] Negotiation successful
0809 09:23:19.912534 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 09:23:19.913372 20536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:19.900239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:35617 (local address 127.11.99.195:41841)
0809 09:23:19.900644 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:19.900698 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:19.901512 (+ 814us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:19.902043 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:19.902052 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:19.902522 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:19.903002 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:19.903014 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.903811 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.903814 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:19.904640 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:19.904650 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.905296 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.905300 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:19.905473 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:19.906066 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:19.906083 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:19.908647 (+ 2564us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:19.910719 (+ 2072us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:19.910724 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:19.910742 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:19.910989 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:19.911291 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:19.911295 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:19.911297 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:19.911482 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:19.911925 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:19.911931 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:19.912170 (+ 239us) client_negotiation.cc:769] Sending connection context
0809 09:23:19.912332 (+ 162us) client_negotiation.cc:240] Negotiation successful
0809 09:23:19.912622 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":119,"threads_started":1}
I20260809 09:23:19.914425 20648 heartbeater.cc:347] Connected to a master server at 127.11.99.254:35617
I20260809 09:23:19.914556 20648 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:19.915122 20648 heartbeater.cc:511] Master 127.11.99.254:35617 requested a full tablet report, sending...
I20260809 09:23:19.916180 20123 ts_manager.cc:194] Registered new tserver with Master: 4d4fa3748e044961a6f00561784a5cae (127.11.99.195:44877)
I20260809 09:23:19.916947 20123 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.99.195@KRBTEST.COM'} at 127.11.99.195:41841
I20260809 09:23:19.916986 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 20509
I20260809 09:23:19.917132 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance
I20260809 09:23:19.917464 11663 external_mini_cluster.cc:1428] Setting key 66c9a8d28e2e7fb9a61c343dd464eb65
I20260809 09:23:19.920034 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 09:23:19.924589 20175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:19.916708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:60439 (local address 127.11.99.254:35617)
0809 09:23:19.917805 (+ 1097us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:19.917808 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:19.917819 (+ 11us) server_negotiation.cc:407] Connection header received
0809 09:23:19.917844 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:19.917846 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:19.917875 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:19.917962 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:19.918431 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.919072 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.919913 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.920190 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.920285 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:19.921554 (+ 1269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:19.921557 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:19.921558 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:19.921578 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:19.923041 (+ 1463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:19.923425 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:19.923430 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:19.923432 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:19.923506 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:19.923822 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:19.923826 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:19.923828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:19.923981 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:19.924081 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:19.924342 (+ 261us) server_negotiation.cc:299] Negotiation successful
0809 09:23:19.924443 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1035}
I20260809 09:23:19.924599 20655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:19.916652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:35617 (local address 127.11.99.195:60439)
0809 09:23:19.916927 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:19.916941 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:19.917023 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:19.917980 (+ 957us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:19.917983 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:19.918206 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:19.918317 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:19.918324 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.919180 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.919182 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:19.919795 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:19.919808 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.920312 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.920315 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:19.920417 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:19.920934 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:19.920952 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:19.921401 (+ 449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:19.923142 (+ 1741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:19.923146 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:19.923148 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:19.923331 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:19.923621 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:19.923625 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:19.923627 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:19.923714 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:19.924075 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:19.924077 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:19.924165 (+ 88us) client_negotiation.cc:769] Sending connection context
0809 09:23:19.924268 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 09:23:19.924416 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":123,"threads_started":1}
Aug 09 09:23:19 dist-test-slave-pgkr krb5kdc[20073](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267399, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 09:23:19 dist-test-slave-pgkr krb5kdc[20073](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:19 dist-test-slave-pgkr krb5kdc[20073](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 09:23:19.944005 20175 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:19.938500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37676 (local address 127.11.99.254:35617)
0809 09:23:19.938670 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:19.938674 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:19.938685 (+ 11us) server_negotiation.cc:407] Connection header received
0809 09:23:19.938715 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:19.938716 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:19.938749 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:19.938812 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:19.939441 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.939917 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.940621 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.940834 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.940909 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:19.943844 (+ 2935us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37676: BlockingRecv error: recv got EOF from 127.0.0.1:37676 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 09 09:23:19 dist-test-slave-pgkr krb5kdc[20073](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267399, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM
I20260809 09:23:19.952381 20175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:19.945255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37682 (local address 127.11.99.254:35617)
0809 09:23:19.945382 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:19.945385 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:19.945531 (+ 146us) server_negotiation.cc:407] Connection header received
0809 09:23:19.945631 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:19.945633 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:19.945666 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:19.945722 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:19.946248 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.946748 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.947452 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.947653 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.947723 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:19.949777 (+ 2054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:19.949780 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:19.949782 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:19.949801 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:19.951066 (+ 1265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:19.951428 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:19.951430 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:19.951431 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:19.951499 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:19.951723 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:19.951730 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:19.951731 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:19.951879 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:19.951974 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:19.952168 (+ 194us) server_negotiation.cc:299] Negotiation successful
0809 09:23:19.952260 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 09:23:19.955253 20123 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37682:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 09:23:19.958145 20123 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:23:19.971956 20673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:19.966373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:38355 (local address 127.0.0.1:37982)
0809 09:23:19.966948 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:19.967000 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:19.967117 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:19.968117 (+ 1000us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:19.968119 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:19.968143 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:19.968248 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:19.968252 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.969237 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.969243 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:19.970466 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:19.970476 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.971432 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.971436 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:19.971548 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:19.971584 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 09:23:19.971694 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 09:23:19.971797 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"mutex_wait_us":5,"spinlock_wait_cycles":1408,"thread_start_us":77,"threads_started":1}
I20260809 09:23:19.972194 20678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:19.967035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59092 (local address 127.11.99.195:44877)
0809 09:23:19.967612 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:19.967623 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:19.967641 (+ 18us) server_negotiation.cc:407] Connection header received
0809 09:23:19.967699 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:19.967703 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:19.967853 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:19.967989 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:19.968416 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.969514 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.970792 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.971591 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.971716 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:19.971884 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:19.971932 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 09:23:19.972049 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":488,"thread_start_us":112,"threads_started":1}
I20260809 09:23:19.972196 20672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:19.966244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:38573 (local address 127.0.0.1:38252)
0809 09:23:19.966912 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:19.967325 (+ 413us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:19.967397 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:19.967977 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:19.967983 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:19.968004 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:19.968125 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:19.968132 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.969642 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.969645 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:19.970831 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:19.970840 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.971842 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.971845 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:19.971940 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:19.971961 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 09:23:19.972011 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 09:23:19.972070 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"mutex_wait_us":57,"thread_start_us":91,"threads_started":1}
I20260809 09:23:19.972128 20676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:19.966652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:44877 (local address 127.0.0.1:59092)
0809 09:23:19.967138 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:19.967154 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:19.967253 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:19.968116 (+ 863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:19.968119 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:19.968151 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:19.968291 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:19.968297 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.969669 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.969672 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:19.970649 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:19.970661 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.971715 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.971719 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:19.971791 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:19.971811 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 09:23:19.971870 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 09:23:19.971929 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"mutex_wait_us":37,"spinlock_wait_cycles":7680,"thread_start_us":82,"threads_started":1}
I20260809 09:23:19.972765 20679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:19.967075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37982 (local address 127.11.99.194:38355)
0809 09:23:19.967603 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:19.967615 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:19.967637 (+ 22us) server_negotiation.cc:407] Connection header received
0809 09:23:19.967710 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:19.967715 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:19.967897 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:19.968343 (+ 446us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:19.968441 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.969121 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.970646 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.971306 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.971431 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:19.971613 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:19.972507 (+ 894us) server_negotiation.cc:299] Negotiation successful
0809 09:23:19.972620 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":109,"threads_started":1}
I20260809 09:23:19.972963 20675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:19.966386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38252 (local address 127.11.99.193:38573)
0809 09:23:19.967494 (+ 1108us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:19.967510 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:19.967531 (+ 21us) server_negotiation.cc:407] Connection header received
0809 09:23:19.967603 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:19.967609 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:19.967801 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:19.968293 (+ 492us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:19.968440 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.969528 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.970952 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:19.971701 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:19.972275 (+ 574us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:19.972472 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:19.972711 (+ 239us) server_negotiation.cc:299] Negotiation successful
0809 09:23:19.972824 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":995,"thread_start_us":88,"threads_started":1}
I20260809 09:23:19.975440 20273 tablet_service.cc:1467] Processing CreateTablet for tablet 80282e2b6ed946b088c6b4b39cf0671d (DEFAULT_TABLE table=test-table [id=fa1d811f632d4cc7a84ca87326c12a3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:19.975500 20579 tablet_service.cc:1467] Processing CreateTablet for tablet 80282e2b6ed946b088c6b4b39cf0671d (DEFAULT_TABLE table=test-table [id=fa1d811f632d4cc7a84ca87326c12a3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:19.975500 20423 tablet_service.cc:1467] Processing CreateTablet for tablet 80282e2b6ed946b088c6b4b39cf0671d (DEFAULT_TABLE table=test-table [id=fa1d811f632d4cc7a84ca87326c12a3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:19.976392 20273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80282e2b6ed946b088c6b4b39cf0671d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:19.976466 20423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80282e2b6ed946b088c6b4b39cf0671d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:19.976466 20579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80282e2b6ed946b088c6b4b39cf0671d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:19.983130 20680 tablet_bootstrap.cc:492] T 80282e2b6ed946b088c6b4b39cf0671d P 9474147985324fd396ecaa3df8f8bd49: Bootstrap starting.
I20260809 09:23:19.984189 20682 tablet_bootstrap.cc:492] T 80282e2b6ed946b088c6b4b39cf0671d P 4d4fa3748e044961a6f00561784a5cae: Bootstrap starting.
I20260809 09:23:19.984699 20681 tablet_bootstrap.cc:492] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b: Bootstrap starting.
I20260809 09:23:19.985303 20680 tablet_bootstrap.cc:654] T 80282e2b6ed946b088c6b4b39cf0671d P 9474147985324fd396ecaa3df8f8bd49: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:19.986003 20680 log.cc:824] T 80282e2b6ed946b088c6b4b39cf0671d P 9474147985324fd396ecaa3df8f8bd49: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:19.986114 20682 tablet_bootstrap.cc:654] T 80282e2b6ed946b088c6b4b39cf0671d P 4d4fa3748e044961a6f00561784a5cae: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:19.986512 20681 tablet_bootstrap.cc:654] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:19.986908 20682 log.cc:824] T 80282e2b6ed946b088c6b4b39cf0671d P 4d4fa3748e044961a6f00561784a5cae: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:19.987329 20681 log.cc:824] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:19.988121 20680 tablet_bootstrap.cc:492] T 80282e2b6ed946b088c6b4b39cf0671d P 9474147985324fd396ecaa3df8f8bd49: No bootstrap required, opened a new log
I20260809 09:23:19.988420 20680 ts_tablet_manager.cc:1397] T 80282e2b6ed946b088c6b4b39cf0671d P 9474147985324fd396ecaa3df8f8bd49: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260809 09:23:19.988871 20682 tablet_bootstrap.cc:492] T 80282e2b6ed946b088c6b4b39cf0671d P 4d4fa3748e044961a6f00561784a5cae: No bootstrap required, opened a new log
I20260809 09:23:19.989032 20682 ts_tablet_manager.cc:1397] T 80282e2b6ed946b088c6b4b39cf0671d P 4d4fa3748e044961a6f00561784a5cae: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 09:23:19.989147 20681 tablet_bootstrap.cc:492] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b: No bootstrap required, opened a new log
I20260809 09:23:19.989313 20681 ts_tablet_manager.cc:1397] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 09:23:19.991979 20681 raft_consensus.cc:348] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:19.992206 20681 raft_consensus.cc:374] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:19.992293 20681 raft_consensus.cc:729] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa9d0f26c8e34ae98ff036ee4a3f377b, State: Initialized, Role: FOLLOWER
I20260809 09:23:19.992158 20680 raft_consensus.cc:348] T 80282e2b6ed946b088c6b4b39cf0671d P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:19.992449 20680 raft_consensus.cc:374] T 80282e2b6ed946b088c6b4b39cf0671d P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:19.992530 20680 raft_consensus.cc:729] T 80282e2b6ed946b088c6b4b39cf0671d P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9474147985324fd396ecaa3df8f8bd49, State: Initialized, Role: FOLLOWER
I20260809 09:23:19.992653 20682 raft_consensus.cc:348] T 80282e2b6ed946b088c6b4b39cf0671d P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:19.992772 20681 consensus_queue.cc:260] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:19.992882 20682 raft_consensus.cc:374] T 80282e2b6ed946b088c6b4b39cf0671d P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:19.992928 20682 raft_consensus.cc:729] T 80282e2b6ed946b088c6b4b39cf0671d P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4fa3748e044961a6f00561784a5cae, State: Initialized, Role: FOLLOWER
I20260809 09:23:19.992923 20680 consensus_queue.cc:260] T 80282e2b6ed946b088c6b4b39cf0671d P 9474147985324fd396ecaa3df8f8bd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:19.993412 20497 heartbeater.cc:503] Master 127.11.99.254:35617 was elected leader, sending a full tablet report...
I20260809 09:23:19.993721 20681 ts_tablet_manager.cc:1428] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260809 09:23:19.993825 20680 ts_tablet_manager.cc:1428] T 80282e2b6ed946b088c6b4b39cf0671d P 9474147985324fd396ecaa3df8f8bd49: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 09:23:19.994148 20342 heartbeater.cc:503] Master 127.11.99.254:35617 was elected leader, sending a full tablet report...
I20260809 09:23:19.994369 20682 consensus_queue.cc:260] T 80282e2b6ed946b088c6b4b39cf0671d P 4d4fa3748e044961a6f00561784a5cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
W20260809 09:23:19.995384 20343 tablet.cc:2369] T 80282e2b6ed946b088c6b4b39cf0671d P 9474147985324fd396ecaa3df8f8bd49: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:23:19.995513 20682 ts_tablet_manager.cc:1428] T 80282e2b6ed946b088c6b4b39cf0671d P 4d4fa3748e044961a6f00561784a5cae: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 09:23:19.995797 20648 heartbeater.cc:503] Master 127.11.99.254:35617 was elected leader, sending a full tablet report...
I20260809 09:23:20.087184 20687 raft_consensus.cc:482] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:23:20.087423 20687 raft_consensus.cc:504] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.088675 20687 leader_election.cc:288] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9474147985324fd396ecaa3df8f8bd49 (127.11.99.193:38573), 4d4fa3748e044961a6f00561784a5cae (127.11.99.195:44877)
I20260809 09:23:20.092497 20675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:20.088926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:52695 (local address 127.11.99.193:38573)
0809 09:23:20.089053 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:20.089059 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:20.089075 (+ 16us) server_negotiation.cc:407] Connection header received
0809 09:23:20.089209 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:20.089212 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:20.089263 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:20.089360 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:20.089701 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.090250 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.091377 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.091914 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.092038 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:20.092085 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:20.092353 (+ 268us) server_negotiation.cc:299] Negotiation successful
0809 09:23:20.092405 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 09:23:20.092530 20381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:20.088863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:38573 (local address 127.11.99.194:52695)
0809 09:23:20.088975 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:20.089004 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:20.089099 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:20.089411 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:20.089416 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:20.089440 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:20.089589 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:20.089596 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.090362 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.090366 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:20.091245 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:20.091255 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.092062 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.092065 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:20.092187 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:20.092216 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 09:23:20.092323 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 09:23:20.092393 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":4}
I20260809 09:23:20.093125 20293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80282e2b6ed946b088c6b4b39cf0671d" candidate_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9474147985324fd396ecaa3df8f8bd49" is_pre_election: true
I20260809 09:23:20.093261 20678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:20.089167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:37653 (local address 127.11.99.195:44877)
0809 09:23:20.089288 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:20.089291 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:20.089355 (+ 64us) server_negotiation.cc:407] Connection header received
0809 09:23:20.089529 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:20.089533 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:20.089585 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:20.089673 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:20.089930 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.090440 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.092050 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.092639 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.092768 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:20.092828 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:20.093072 (+ 244us) server_negotiation.cc:299] Negotiation successful
0809 09:23:20.093137 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 09:23:20.093286 20691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:20.088911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:44877 (local address 127.11.99.194:37653)
0809 09:23:20.089266 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:20.089279 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:20.089372 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:20.089699 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:20.089701 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:20.089718 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:20.089824 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:20.089830 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.090568 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.090570 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:20.091907 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:20.091915 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.092832 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.092837 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:20.092936 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:20.092955 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 09:23:20.093056 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 09:23:20.093119 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"mutex_wait_us":41,"thread_start_us":109,"threads_started":1}
I20260809 09:23:20.093451 20293 raft_consensus.cc:2454] T 80282e2b6ed946b088c6b4b39cf0671d P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa9d0f26c8e34ae98ff036ee4a3f377b in term 0.
I20260809 09:23:20.093873 20599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80282e2b6ed946b088c6b4b39cf0671d" candidate_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4fa3748e044961a6f00561784a5cae" is_pre_election: true
I20260809 09:23:20.094000 20375 leader_election.cc:302] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9474147985324fd396ecaa3df8f8bd49, fa9d0f26c8e34ae98ff036ee4a3f377b; no voters:
I20260809 09:23:20.094142 20599 raft_consensus.cc:2454] T 80282e2b6ed946b088c6b4b39cf0671d P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa9d0f26c8e34ae98ff036ee4a3f377b in term 0.
I20260809 09:23:20.094314 20687 raft_consensus.cc:2781] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:23:20.094491 20687 raft_consensus.cc:482] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:23:20.094585 20687 raft_consensus.cc:3037] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:20.095923 20687 raft_consensus.cc:504] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.096316 20687 leader_election.cc:288] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b [CANDIDATE]: Term 1 election: Requested vote from peers 9474147985324fd396ecaa3df8f8bd49 (127.11.99.193:38573), 4d4fa3748e044961a6f00561784a5cae (127.11.99.195:44877)
I20260809 09:23:20.096736 20599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80282e2b6ed946b088c6b4b39cf0671d" candidate_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4fa3748e044961a6f00561784a5cae"
I20260809 09:23:20.096772 20293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80282e2b6ed946b088c6b4b39cf0671d" candidate_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9474147985324fd396ecaa3df8f8bd49"
I20260809 09:23:20.096837 20599 raft_consensus.cc:3037] T 80282e2b6ed946b088c6b4b39cf0671d P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:20.096923 20293 raft_consensus.cc:3037] T 80282e2b6ed946b088c6b4b39cf0671d P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:20.097944 20293 raft_consensus.cc:2454] T 80282e2b6ed946b088c6b4b39cf0671d P 9474147985324fd396ecaa3df8f8bd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa9d0f26c8e34ae98ff036ee4a3f377b in term 1.
I20260809 09:23:20.098083 20599 raft_consensus.cc:2454] T 80282e2b6ed946b088c6b4b39cf0671d P 4d4fa3748e044961a6f00561784a5cae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa9d0f26c8e34ae98ff036ee4a3f377b in term 1.
I20260809 09:23:20.098266 20375 leader_election.cc:302] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9474147985324fd396ecaa3df8f8bd49, fa9d0f26c8e34ae98ff036ee4a3f377b; no voters:
I20260809 09:23:20.098418 20687 raft_consensus.cc:2781] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:23:20.098673 20687 raft_consensus.cc:686] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b [term 1 LEADER]: Becoming Leader. State: Replica: fa9d0f26c8e34ae98ff036ee4a3f377b, State: Running, Role: LEADER
I20260809 09:23:20.099052 20687 consensus_queue.cc:237] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.102003 20120 catalog_manager.cc:5495] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b reported cstate change: term changed from 0 to 1, leader changed from <none> to fa9d0f26c8e34ae98ff036ee4a3f377b (127.11.99.194). New cstate: current_term: 1 leader_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } health_report { overall_health: UNKNOWN } } }
I20260809 09:23:20.121116 20679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:20.118109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37990 (local address 127.11.99.194:38355)
0809 09:23:20.118243 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:20.118246 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:20.118259 (+ 13us) server_negotiation.cc:407] Connection header received
0809 09:23:20.118318 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:20.118320 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:20.118366 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:20.118448 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:23:20.118717 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.119179 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.119926 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.120106 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.120173 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:20.120378 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:23:20.120754 (+ 376us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:23:20.120833 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:20.120932 (+ 99us) server_negotiation.cc:299] Negotiation successful
0809 09:23:20.120978 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 09:23:20.126402 20293 raft_consensus.cc:1261] T 80282e2b6ed946b088c6b4b39cf0671d P 9474147985324fd396ecaa3df8f8bd49 [term 1 FOLLOWER]: Refusing update from remote peer fa9d0f26c8e34ae98ff036ee4a3f377b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:23:20.126402 20599 raft_consensus.cc:1261] T 80282e2b6ed946b088c6b4b39cf0671d P 4d4fa3748e044961a6f00561784a5cae [term 1 FOLLOWER]: Refusing update from remote peer fa9d0f26c8e34ae98ff036ee4a3f377b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:23:20.127089 20687 consensus_queue.cc:1035] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:23:20.127290 20692 consensus_queue.cc:1035] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:23:20.133375 20695 mvcc.cc:205] Tried to move back new op lower bound from 7316551270911549440 to 7316551270808268800. Current Snapshot: MvccSnapshot[applied={T|T < 7316551270911549440}]
I20260809 09:23:20.135625 20696 mvcc.cc:205] Tried to move back new op lower bound from 7316551270911549440 to 7316551270808268800. Current Snapshot: MvccSnapshot[applied={T|T < 7316551270911549440}]
I20260809 09:23:20.141386 20123 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37682:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:23:20.141548 20123 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37682:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:23:20.143869 20123 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f: Sending DeleteTablet for 3 replicas of tablet 80282e2b6ed946b088c6b4b39cf0671d
I20260809 09:23:20.144613 20273 tablet_service.cc:1514] Processing DeleteTablet for tablet 80282e2b6ed946b088c6b4b39cf0671d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:20 UTC) from {username='oryx', principal='oryx/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:38252
I20260809 09:23:20.144726 20579 tablet_service.cc:1514] Processing DeleteTablet for tablet 80282e2b6ed946b088c6b4b39cf0671d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:20 UTC) from {username='oryx', principal='oryx/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:59092
I20260809 09:23:20.144728 20423 tablet_service.cc:1514] Processing DeleteTablet for tablet 80282e2b6ed946b088c6b4b39cf0671d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:20 UTC) from {username='oryx', principal='oryx/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:37982
I20260809 09:23:20.145197 20708 tablet_replica.cc:330] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b: stopping tablet replica
I20260809 09:23:20.145112 20707 tablet_replica.cc:330] T 80282e2b6ed946b088c6b4b39cf0671d P 4d4fa3748e044961a6f00561784a5cae: stopping tablet replica
I20260809 09:23:20.145541 20708 raft_consensus.cc:2229] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b [term 1 LEADER]: Raft consensus shutting down.
I20260809 09:23:20.145825 20123 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37682:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 09:23:20.145956 20708 raft_consensus.cc:2258] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:23:20.146236 20706 tablet_replica.cc:330] T 80282e2b6ed946b088c6b4b39cf0671d P 9474147985324fd396ecaa3df8f8bd49: stopping tablet replica
W20260809 09:23:20.146231 20123 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:23:20.146410 20707 raft_consensus.cc:2229] T 80282e2b6ed946b088c6b4b39cf0671d P 4d4fa3748e044961a6f00561784a5cae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:23:20.146736 20707 raft_consensus.cc:2258] T 80282e2b6ed946b088c6b4b39cf0671d P 4d4fa3748e044961a6f00561784a5cae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:23:20.147210 20706 raft_consensus.cc:2229] T 80282e2b6ed946b088c6b4b39cf0671d P 9474147985324fd396ecaa3df8f8bd49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:23:20.147500 20706 raft_consensus.cc:2258] T 80282e2b6ed946b088c6b4b39cf0671d P 9474147985324fd396ecaa3df8f8bd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:23:20.147710 20708 ts_tablet_manager.cc:1905] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:23:20.148821 20707 ts_tablet_manager.cc:1905] T 80282e2b6ed946b088c6b4b39cf0671d P 4d4fa3748e044961a6f00561784a5cae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:23:20.150673 20708 ts_tablet_manager.cc:1918] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:23:20.150832 20708 log.cc:1196] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/80282e2b6ed946b088c6b4b39cf0671d
I20260809 09:23:20.151223 20708 ts_tablet_manager.cc:1939] T 80282e2b6ed946b088c6b4b39cf0671d P fa9d0f26c8e34ae98ff036ee4a3f377b: Deleting consensus metadata
I20260809 09:23:20.151551 20707 ts_tablet_manager.cc:1918] T 80282e2b6ed946b088c6b4b39cf0671d P 4d4fa3748e044961a6f00561784a5cae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:23:20.151681 20707 log.cc:1196] T 80282e2b6ed946b088c6b4b39cf0671d P 4d4fa3748e044961a6f00561784a5cae: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/80282e2b6ed946b088c6b4b39cf0671d
I20260809 09:23:20.152024 20707 ts_tablet_manager.cc:1939] T 80282e2b6ed946b088c6b4b39cf0671d P 4d4fa3748e044961a6f00561784a5cae: Deleting consensus metadata
I20260809 09:23:20.152101 20273 tablet_service.cc:1467] Processing CreateTablet for tablet a8edc012a4af456588dcecc821fab7a9 (DEFAULT_TABLE table=test-table [id=63d475fead2a4ef1b42fbb30558b579e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:20.152191 20579 tablet_service.cc:1467] Processing CreateTablet for tablet a8edc012a4af456588dcecc821fab7a9 (DEFAULT_TABLE table=test-table [id=63d475fead2a4ef1b42fbb30558b579e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:20.152379 20273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8edc012a4af456588dcecc821fab7a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:20.152439 20579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8edc012a4af456588dcecc821fab7a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:20.152803 20423 tablet_service.cc:1467] Processing CreateTablet for tablet a8edc012a4af456588dcecc821fab7a9 (DEFAULT_TABLE table=test-table [id=63d475fead2a4ef1b42fbb30558b579e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:20.153028 20423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8edc012a4af456588dcecc821fab7a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:20.154646 20682 tablet_bootstrap.cc:492] T a8edc012a4af456588dcecc821fab7a9 P 4d4fa3748e044961a6f00561784a5cae: Bootstrap starting.
I20260809 09:23:20.154848 20680 tablet_bootstrap.cc:492] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49: Bootstrap starting.
I20260809 09:23:20.155619 20682 tablet_bootstrap.cc:654] T a8edc012a4af456588dcecc821fab7a9 P 4d4fa3748e044961a6f00561784a5cae: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:20.155730 20680 tablet_bootstrap.cc:654] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:20.156332 20681 tablet_bootstrap.cc:492] T a8edc012a4af456588dcecc821fab7a9 P fa9d0f26c8e34ae98ff036ee4a3f377b: Bootstrap starting.
I20260809 09:23:20.156459 20706 ts_tablet_manager.cc:1905] T 80282e2b6ed946b088c6b4b39cf0671d P 9474147985324fd396ecaa3df8f8bd49: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:23:20.157212 20681 tablet_bootstrap.cc:654] T a8edc012a4af456588dcecc821fab7a9 P fa9d0f26c8e34ae98ff036ee4a3f377b: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:20.157447 20105 catalog_manager.cc:4841] TS 4d4fa3748e044961a6f00561784a5cae (127.11.99.195:44877): tablet 80282e2b6ed946b088c6b4b39cf0671d (table test-table [id=fa1d811f632d4cc7a84ca87326c12a3a]) successfully deleted
I20260809 09:23:20.158877 20107 catalog_manager.cc:4841] TS fa9d0f26c8e34ae98ff036ee4a3f377b (127.11.99.194:38355): tablet 80282e2b6ed946b088c6b4b39cf0671d (table test-table [id=fa1d811f632d4cc7a84ca87326c12a3a]) successfully deleted
I20260809 09:23:20.159122 20682 tablet_bootstrap.cc:492] T a8edc012a4af456588dcecc821fab7a9 P 4d4fa3748e044961a6f00561784a5cae: No bootstrap required, opened a new log
I20260809 09:23:20.159214 20682 ts_tablet_manager.cc:1397] T a8edc012a4af456588dcecc821fab7a9 P 4d4fa3748e044961a6f00561784a5cae: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260809 09:23:20.159195 20706 ts_tablet_manager.cc:1918] T 80282e2b6ed946b088c6b4b39cf0671d P 9474147985324fd396ecaa3df8f8bd49: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:23:20.159291 20706 log.cc:1196] T 80282e2b6ed946b088c6b4b39cf0671d P 9474147985324fd396ecaa3df8f8bd49: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-0/wal/wals/80282e2b6ed946b088c6b4b39cf0671d
I20260809 09:23:20.159694 20706 ts_tablet_manager.cc:1939] T 80282e2b6ed946b088c6b4b39cf0671d P 9474147985324fd396ecaa3df8f8bd49: Deleting consensus metadata
I20260809 09:23:20.159723 20682 raft_consensus.cc:348] T a8edc012a4af456588dcecc821fab7a9 P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.159870 20682 raft_consensus.cc:374] T a8edc012a4af456588dcecc821fab7a9 P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:20.159943 20682 raft_consensus.cc:729] T a8edc012a4af456588dcecc821fab7a9 P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4fa3748e044961a6f00561784a5cae, State: Initialized, Role: FOLLOWER
I20260809 09:23:20.160084 20682 consensus_queue.cc:260] T a8edc012a4af456588dcecc821fab7a9 P 4d4fa3748e044961a6f00561784a5cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.160197 20680 tablet_bootstrap.cc:492] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49: No bootstrap required, opened a new log
I20260809 09:23:20.160264 20680 ts_tablet_manager.cc:1397] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260809 09:23:20.160373 20682 ts_tablet_manager.cc:1428] T a8edc012a4af456588dcecc821fab7a9 P 4d4fa3748e044961a6f00561784a5cae: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260809 09:23:20.160704 20680 raft_consensus.cc:348] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.160807 20680 raft_consensus.cc:374] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:20.160844 20680 raft_consensus.cc:729] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9474147985324fd396ecaa3df8f8bd49, State: Initialized, Role: FOLLOWER
I20260809 09:23:20.160948 20109 catalog_manager.cc:4841] TS 9474147985324fd396ecaa3df8f8bd49 (127.11.99.193:38573): tablet 80282e2b6ed946b088c6b4b39cf0671d (table test-table [id=fa1d811f632d4cc7a84ca87326c12a3a]) successfully deleted
I20260809 09:23:20.160960 20680 consensus_queue.cc:260] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
W20260809 09:23:20.161948 20650 tablet.cc:2369] T a8edc012a4af456588dcecc821fab7a9 P 4d4fa3748e044961a6f00561784a5cae: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:23:20.162596 20680 ts_tablet_manager.cc:1428] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260809 09:23:20.163491 20681 tablet_bootstrap.cc:492] T a8edc012a4af456588dcecc821fab7a9 P fa9d0f26c8e34ae98ff036ee4a3f377b: No bootstrap required, opened a new log
I20260809 09:23:20.163591 20681 ts_tablet_manager.cc:1397] T a8edc012a4af456588dcecc821fab7a9 P fa9d0f26c8e34ae98ff036ee4a3f377b: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260809 09:23:20.164134 20681 raft_consensus.cc:348] T a8edc012a4af456588dcecc821fab7a9 P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.164227 20681 raft_consensus.cc:374] T a8edc012a4af456588dcecc821fab7a9 P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:20.164248 20681 raft_consensus.cc:729] T a8edc012a4af456588dcecc821fab7a9 P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa9d0f26c8e34ae98ff036ee4a3f377b, State: Initialized, Role: FOLLOWER
I20260809 09:23:20.164340 20681 consensus_queue.cc:260] T a8edc012a4af456588dcecc821fab7a9 P fa9d0f26c8e34ae98ff036ee4a3f377b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.164544 20681 ts_tablet_manager.cc:1428] T a8edc012a4af456588dcecc821fab7a9 P fa9d0f26c8e34ae98ff036ee4a3f377b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20260809 09:23:20.210143 20498 tablet.cc:2369] T a8edc012a4af456588dcecc821fab7a9 P fa9d0f26c8e34ae98ff036ee4a3f377b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:23:20.241549 20688 raft_consensus.cc:482] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:23:20.241679 20688 raft_consensus.cc:504] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.242862 20688 leader_election.cc:288] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa9d0f26c8e34ae98ff036ee4a3f377b (127.11.99.194:38355), 4d4fa3748e044961a6f00561784a5cae (127.11.99.195:44877)
I20260809 09:23:20.247324 20679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:20.243451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:56265 (local address 127.11.99.194:38355)
0809 09:23:20.243560 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:20.243564 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:20.243578 (+ 14us) server_negotiation.cc:407] Connection header received
0809 09:23:20.243634 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:20.243636 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:20.243682 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:20.243762 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:20.244114 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.244945 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.246063 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.246548 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.246662 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:20.246713 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:20.247104 (+ 391us) server_negotiation.cc:299] Negotiation successful
0809 09:23:20.247185 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 09:23:20.247474 20678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:20.243238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:56925 (local address 127.11.99.195:44877)
0809 09:23:20.243360 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:20.243366 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:20.243549 (+ 183us) server_negotiation.cc:407] Connection header received
0809 09:23:20.243727 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:20.243730 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:20.243782 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:20.243846 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:20.244214 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.244934 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.246330 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.246905 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.247017 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:20.247094 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:20.247285 (+ 191us) server_negotiation.cc:299] Negotiation successful
0809 09:23:20.247364 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 09:23:20.247588 20715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:20.243102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:44877 (local address 127.11.99.193:56925)
0809 09:23:20.243477 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:20.243489 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:20.243607 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:20.243892 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:20.243895 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:20.243915 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:20.244090 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:20.244096 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.245056 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.245061 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:20.246185 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:20.246196 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.247040 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.247044 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:20.247143 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:20.247169 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 09:23:20.247266 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 09:23:20.247336 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"mutex_wait_us":48,"thread_start_us":91,"threads_started":1}
I20260809 09:23:20.247802 20714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:20.243092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:38355 (local address 127.11.99.193:56265)
0809 09:23:20.243415 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:20.243429 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:20.243554 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:20.243778 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:20.243780 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:20.243798 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:20.243964 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:20.243970 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.245071 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.245074 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:20.245929 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:20.245939 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.246840 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.246844 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:20.246949 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:20.246986 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 09:23:20.247464 (+ 478us) client_negotiation.cc:240] Negotiation successful
0809 09:23:20.247553 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"mutex_wait_us":3,"thread_start_us":69,"threads_started":1}
I20260809 09:23:20.248178 20599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8edc012a4af456588dcecc821fab7a9" candidate_uuid: "9474147985324fd396ecaa3df8f8bd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4fa3748e044961a6f00561784a5cae" is_pre_election: true
I20260809 09:23:20.248356 20599 raft_consensus.cc:2454] T a8edc012a4af456588dcecc821fab7a9 P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9474147985324fd396ecaa3df8f8bd49 in term 0.
I20260809 09:23:20.248397 20447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8edc012a4af456588dcecc821fab7a9" candidate_uuid: "9474147985324fd396ecaa3df8f8bd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" is_pre_election: true
I20260809 09:23:20.248644 20447 raft_consensus.cc:2454] T a8edc012a4af456588dcecc821fab7a9 P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9474147985324fd396ecaa3df8f8bd49 in term 0.
I20260809 09:23:20.248687 20218 leader_election.cc:302] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4fa3748e044961a6f00561784a5cae, 9474147985324fd396ecaa3df8f8bd49; no voters:
I20260809 09:23:20.248912 20688 raft_consensus.cc:2781] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:23:20.248974 20688 raft_consensus.cc:482] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:23:20.249018 20688 raft_consensus.cc:3037] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:20.250309 20688 raft_consensus.cc:504] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.250763 20688 leader_election.cc:288] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49 [CANDIDATE]: Term 1 election: Requested vote from peers fa9d0f26c8e34ae98ff036ee4a3f377b (127.11.99.194:38355), 4d4fa3748e044961a6f00561784a5cae (127.11.99.195:44877)
I20260809 09:23:20.251055 20599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8edc012a4af456588dcecc821fab7a9" candidate_uuid: "9474147985324fd396ecaa3df8f8bd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4fa3748e044961a6f00561784a5cae"
I20260809 09:23:20.251067 20447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8edc012a4af456588dcecc821fab7a9" candidate_uuid: "9474147985324fd396ecaa3df8f8bd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b"
I20260809 09:23:20.251178 20447 raft_consensus.cc:3037] T a8edc012a4af456588dcecc821fab7a9 P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:20.251181 20599 raft_consensus.cc:3037] T a8edc012a4af456588dcecc821fab7a9 P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:20.252152 20599 raft_consensus.cc:2454] T a8edc012a4af456588dcecc821fab7a9 P 4d4fa3748e044961a6f00561784a5cae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9474147985324fd396ecaa3df8f8bd49 in term 1.
I20260809 09:23:20.252439 20218 leader_election.cc:302] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4fa3748e044961a6f00561784a5cae, 9474147985324fd396ecaa3df8f8bd49; no voters:
I20260809 09:23:20.252529 20447 raft_consensus.cc:2454] T a8edc012a4af456588dcecc821fab7a9 P fa9d0f26c8e34ae98ff036ee4a3f377b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9474147985324fd396ecaa3df8f8bd49 in term 1.
I20260809 09:23:20.252636 20688 raft_consensus.cc:2781] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:23:20.252908 20688 raft_consensus.cc:686] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49 [term 1 LEADER]: Becoming Leader. State: Replica: 9474147985324fd396ecaa3df8f8bd49, State: Running, Role: LEADER
I20260809 09:23:20.253147 20688 consensus_queue.cc:237] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.255451 20123 catalog_manager.cc:5495] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9474147985324fd396ecaa3df8f8bd49 (127.11.99.193). New cstate: current_term: 1 leader_uuid: "9474147985324fd396ecaa3df8f8bd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } health_report { overall_health: UNKNOWN } } }
Aug 09 09:23:20 dist-test-slave-pgkr krb5kdc[20073](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267399, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.254@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM
I20260809 09:23:20.308144 20725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:20.300360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:35617 (local address 127.0.0.1:37698)
0809 09:23:20.300685 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:20.300701 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:20.300806 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:20.301066 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:20.301068 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:20.301414 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:20.301503 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:20.301508 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.302194 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.302196 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:20.302718 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:20.302726 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.303171 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.303174 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:20.303249 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:20.303780 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:20.303792 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:20.305214 (+ 1422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:20.306799 (+ 1585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:20.306807 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:20.306811 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:20.307032 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:20.307286 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:20.307288 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:20.307289 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:20.307366 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:20.307692 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:20.307697 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:20.307801 (+ 104us) client_negotiation.cc:769] Sending connection context
0809 09:23:20.307889 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 09:23:20.308001 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":162,"threads_started":1}
I20260809 09:23:20.308203 20175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:20.300400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37698 (local address 127.11.99.254:35617)
0809 09:23:20.300538 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:20.300541 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:20.300781 (+ 240us) server_negotiation.cc:407] Connection header received
0809 09:23:20.300893 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:20.300895 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:20.300934 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:20.301014 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:20.301602 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.302107 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.302815 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.303019 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.303123 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:20.305334 (+ 2211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:20.305336 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:20.305338 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:20.305357 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:20.306691 (+ 1334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:20.307123 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:20.307126 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:20.307127 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:20.307202 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:20.307443 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:20.307445 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:20.307446 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:20.307605 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:20.307679 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:20.307944 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 09:23:20.308063 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":67}
I20260809 09:23:20.311877 20123 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:37698:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 09:23:20.312608 20123 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:23:20.317519 20273 tablet_service.cc:1467] Processing CreateTablet for tablet a976f6e7c45c466b9027936ce4913081 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=88151a420b5a4b8c84bd04a6ceebb492]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 09:23:20.317523 20423 tablet_service.cc:1467] Processing CreateTablet for tablet a976f6e7c45c466b9027936ce4913081 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=88151a420b5a4b8c84bd04a6ceebb492]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 09:23:20.317658 20579 tablet_service.cc:1467] Processing CreateTablet for tablet a976f6e7c45c466b9027936ce4913081 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=88151a420b5a4b8c84bd04a6ceebb492]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 09:23:20.317924 20423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a976f6e7c45c466b9027936ce4913081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:20.317932 20273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a976f6e7c45c466b9027936ce4913081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:20.318010 20579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a976f6e7c45c466b9027936ce4913081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:20.320236 20680 tablet_bootstrap.cc:492] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49: Bootstrap starting.
I20260809 09:23:20.320595 20681 tablet_bootstrap.cc:492] T a976f6e7c45c466b9027936ce4913081 P fa9d0f26c8e34ae98ff036ee4a3f377b: Bootstrap starting.
I20260809 09:23:20.321223 20680 tablet_bootstrap.cc:654] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:20.321537 20681 tablet_bootstrap.cc:654] T a976f6e7c45c466b9027936ce4913081 P fa9d0f26c8e34ae98ff036ee4a3f377b: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:20.321957 20682 tablet_bootstrap.cc:492] T a976f6e7c45c466b9027936ce4913081 P 4d4fa3748e044961a6f00561784a5cae: Bootstrap starting.
I20260809 09:23:20.322577 20680 tablet_bootstrap.cc:492] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49: No bootstrap required, opened a new log
I20260809 09:23:20.322692 20680 ts_tablet_manager.cc:1397] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260809 09:23:20.322966 20682 tablet_bootstrap.cc:654] T a976f6e7c45c466b9027936ce4913081 P 4d4fa3748e044961a6f00561784a5cae: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:20.323166 20680 raft_consensus.cc:348] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.323272 20680 raft_consensus.cc:374] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:20.323320 20680 raft_consensus.cc:729] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9474147985324fd396ecaa3df8f8bd49, State: Initialized, Role: FOLLOWER
I20260809 09:23:20.323462 20680 consensus_queue.cc:260] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.323760 20688 tablet_replica.cc:439] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } } }
I20260809 09:23:20.323895 20688 tablet_replica.cc:442] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 09:23:20.324211 20682 tablet_bootstrap.cc:492] T a976f6e7c45c466b9027936ce4913081 P 4d4fa3748e044961a6f00561784a5cae: No bootstrap required, opened a new log
I20260809 09:23:20.324311 20682 ts_tablet_manager.cc:1397] T a976f6e7c45c466b9027936ce4913081 P 4d4fa3748e044961a6f00561784a5cae: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 09:23:20.324304 20680 ts_tablet_manager.cc:1428] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260809 09:23:20.324671 20682 raft_consensus.cc:348] T a976f6e7c45c466b9027936ce4913081 P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.324766 20682 raft_consensus.cc:374] T a976f6e7c45c466b9027936ce4913081 P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:20.324787 20682 raft_consensus.cc:729] T a976f6e7c45c466b9027936ce4913081 P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4fa3748e044961a6f00561784a5cae, State: Initialized, Role: FOLLOWER
I20260809 09:23:20.324934 20682 consensus_queue.cc:260] T a976f6e7c45c466b9027936ce4913081 P 4d4fa3748e044961a6f00561784a5cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.325217 20682 ts_tablet_manager.cc:1428] T a976f6e7c45c466b9027936ce4913081 P 4d4fa3748e044961a6f00561784a5cae: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 09:23:20.325167 20689 tablet_replica.cc:439] T a976f6e7c45c466b9027936ce4913081 P 4d4fa3748e044961a6f00561784a5cae: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } } }
I20260809 09:23:20.325295 20689 tablet_replica.cc:442] T a976f6e7c45c466b9027936ce4913081 P 4d4fa3748e044961a6f00561784a5cae: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 09:23:20.326220 20681 tablet_bootstrap.cc:492] T a976f6e7c45c466b9027936ce4913081 P fa9d0f26c8e34ae98ff036ee4a3f377b: No bootstrap required, opened a new log
I20260809 09:23:20.326328 20681 ts_tablet_manager.cc:1397] T a976f6e7c45c466b9027936ce4913081 P fa9d0f26c8e34ae98ff036ee4a3f377b: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260809 09:23:20.326807 20681 raft_consensus.cc:348] T a976f6e7c45c466b9027936ce4913081 P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.326932 20681 raft_consensus.cc:374] T a976f6e7c45c466b9027936ce4913081 P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:20.326977 20681 raft_consensus.cc:729] T a976f6e7c45c466b9027936ce4913081 P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa9d0f26c8e34ae98ff036ee4a3f377b, State: Initialized, Role: FOLLOWER
I20260809 09:23:20.327114 20681 consensus_queue.cc:260] T a976f6e7c45c466b9027936ce4913081 P fa9d0f26c8e34ae98ff036ee4a3f377b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.327407 20681 ts_tablet_manager.cc:1428] T a976f6e7c45c466b9027936ce4913081 P fa9d0f26c8e34ae98ff036ee4a3f377b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 09:23:20.327354 20702 tablet_replica.cc:439] T a976f6e7c45c466b9027936ce4913081 P fa9d0f26c8e34ae98ff036ee4a3f377b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } } }
I20260809 09:23:20.327478 20702 tablet_replica.cc:442] T a976f6e7c45c466b9027936ce4913081 P fa9d0f26c8e34ae98ff036ee4a3f377b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 09:23:20.364744 20688 raft_consensus.cc:482] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:23:20.364871 20688 raft_consensus.cc:504] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.365267 20688 leader_election.cc:288] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa9d0f26c8e34ae98ff036ee4a3f377b (127.11.99.194:38355), 4d4fa3748e044961a6f00561784a5cae (127.11.99.195:44877)
I20260809 09:23:20.365649 20599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a976f6e7c45c466b9027936ce4913081" candidate_uuid: "9474147985324fd396ecaa3df8f8bd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4fa3748e044961a6f00561784a5cae" is_pre_election: true
I20260809 09:23:20.365653 20447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a976f6e7c45c466b9027936ce4913081" candidate_uuid: "9474147985324fd396ecaa3df8f8bd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" is_pre_election: true
I20260809 09:23:20.365800 20447 raft_consensus.cc:2454] T a976f6e7c45c466b9027936ce4913081 P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9474147985324fd396ecaa3df8f8bd49 in term 0.
I20260809 09:23:20.365805 20599 raft_consensus.cc:2454] T a976f6e7c45c466b9027936ce4913081 P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9474147985324fd396ecaa3df8f8bd49 in term 0.
I20260809 09:23:20.366084 20218 leader_election.cc:302] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4fa3748e044961a6f00561784a5cae, 9474147985324fd396ecaa3df8f8bd49; no voters:
I20260809 09:23:20.366261 20688 raft_consensus.cc:2781] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:23:20.366321 20688 raft_consensus.cc:482] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:23:20.366358 20688 raft_consensus.cc:3037] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:20.367408 20688 raft_consensus.cc:504] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.367710 20688 leader_election.cc:288] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49 [CANDIDATE]: Term 1 election: Requested vote from peers fa9d0f26c8e34ae98ff036ee4a3f377b (127.11.99.194:38355), 4d4fa3748e044961a6f00561784a5cae (127.11.99.195:44877)
I20260809 09:23:20.368052 20447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a976f6e7c45c466b9027936ce4913081" candidate_uuid: "9474147985324fd396ecaa3df8f8bd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b"
I20260809 09:23:20.368144 20447 raft_consensus.cc:3037] T a976f6e7c45c466b9027936ce4913081 P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:20.368095 20599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a976f6e7c45c466b9027936ce4913081" candidate_uuid: "9474147985324fd396ecaa3df8f8bd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4fa3748e044961a6f00561784a5cae"
I20260809 09:23:20.368237 20599 raft_consensus.cc:3037] T a976f6e7c45c466b9027936ce4913081 P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:20.369062 20447 raft_consensus.cc:2454] T a976f6e7c45c466b9027936ce4913081 P fa9d0f26c8e34ae98ff036ee4a3f377b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9474147985324fd396ecaa3df8f8bd49 in term 1.
I20260809 09:23:20.369257 20599 raft_consensus.cc:2454] T a976f6e7c45c466b9027936ce4913081 P 4d4fa3748e044961a6f00561784a5cae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9474147985324fd396ecaa3df8f8bd49 in term 1.
I20260809 09:23:20.369568 20218 leader_election.cc:302] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4fa3748e044961a6f00561784a5cae, 9474147985324fd396ecaa3df8f8bd49; no voters:
I20260809 09:23:20.369803 20688 raft_consensus.cc:2781] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:23:20.369903 20688 raft_consensus.cc:686] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49 [term 1 LEADER]: Becoming Leader. State: Replica: 9474147985324fd396ecaa3df8f8bd49, State: Running, Role: LEADER
I20260809 09:23:20.370034 20688 consensus_queue.cc:237] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.370683 20716 tablet_replica.cc:439] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49: TxnStatusTablet state changed. Reason: New leader 9474147985324fd396ecaa3df8f8bd49. Latest consensus state: current_term: 1 leader_uuid: "9474147985324fd396ecaa3df8f8bd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } } }
I20260809 09:23:20.370813 20716 tablet_replica.cc:442] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49: This TxnStatusTablet replica's current role is: LEADER
I20260809 09:23:20.371134 20730 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 09:23:20.371315 20730 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 09:23:20.371692 20122 catalog_manager.cc:5495] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9474147985324fd396ecaa3df8f8bd49 (127.11.99.193). New cstate: current_term: 1 leader_uuid: "9474147985324fd396ecaa3df8f8bd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } health_report { overall_health: UNKNOWN } } }
I20260809 09:23:20.383975 20725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:20.379776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:38573 (local address 127.0.0.1:38256)
0809 09:23:20.380038 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:20.380050 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:20.380129 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:20.380467 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:20.380469 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:20.380475 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 09:23:20.380557 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:20.380561 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.381536 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.381538 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:20.382221 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:20.382231 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.382846 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.382850 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:20.382956 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:20.383021 (+ 65us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 09:23:20.383757 (+ 736us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 09:23:20.383769 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 09:23:20.383817 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 09:23:20.383878 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176}
I20260809 09:23:20.384016 20675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:20.379879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38256 (local address 127.11.99.193:38573)
0809 09:23:20.380030 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:20.380035 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:20.380090 (+ 55us) server_negotiation.cc:407] Connection header received
0809 09:23:20.380281 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:20.380285 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:20.380349 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:20.380443 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:23:20.380667 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.381417 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.382339 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.382721 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.382853 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:20.383196 (+ 343us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:23:20.383661 (+ 465us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:23:20.383776 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:20.383833 (+ 57us) server_negotiation.cc:299] Negotiation successful
0809 09:23:20.383887 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 09:23:20.386547 20599 raft_consensus.cc:1261] T a976f6e7c45c466b9027936ce4913081 P 4d4fa3748e044961a6f00561784a5cae [term 1 FOLLOWER]: Refusing update from remote peer 9474147985324fd396ecaa3df8f8bd49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:23:20.386771 20447 raft_consensus.cc:1261] T a976f6e7c45c466b9027936ce4913081 P fa9d0f26c8e34ae98ff036ee4a3f377b [term 1 FOLLOWER]: Refusing update from remote peer 9474147985324fd396ecaa3df8f8bd49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:23:20.387051 20716 consensus_queue.cc:1035] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:23:20.387295 20688 consensus_queue.cc:1035] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:23:20.389539 20702 tablet_replica.cc:439] T a976f6e7c45c466b9027936ce4913081 P fa9d0f26c8e34ae98ff036ee4a3f377b: TxnStatusTablet state changed. Reason: New leader 9474147985324fd396ecaa3df8f8bd49. Latest consensus state: current_term: 1 leader_uuid: "9474147985324fd396ecaa3df8f8bd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } } }
I20260809 09:23:20.389639 20702 tablet_replica.cc:442] T a976f6e7c45c466b9027936ce4913081 P fa9d0f26c8e34ae98ff036ee4a3f377b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 09:23:20.391711 20688 tablet_replica.cc:439] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9474147985324fd396ecaa3df8f8bd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } } }
I20260809 09:23:20.391829 20688 tablet_replica.cc:442] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49: This TxnStatusTablet replica's current role is: LEADER
I20260809 09:23:20.393141 20702 tablet_replica.cc:439] T a976f6e7c45c466b9027936ce4913081 P fa9d0f26c8e34ae98ff036ee4a3f377b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9474147985324fd396ecaa3df8f8bd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } } }
I20260809 09:23:20.393246 20702 tablet_replica.cc:442] T a976f6e7c45c466b9027936ce4913081 P fa9d0f26c8e34ae98ff036ee4a3f377b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 09:23:20.397256 20689 tablet_replica.cc:439] T a976f6e7c45c466b9027936ce4913081 P 4d4fa3748e044961a6f00561784a5cae: TxnStatusTablet state changed. Reason: New leader 9474147985324fd396ecaa3df8f8bd49. Latest consensus state: current_term: 1 leader_uuid: "9474147985324fd396ecaa3df8f8bd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } } }
I20260809 09:23:20.397379 20689 tablet_replica.cc:442] T a976f6e7c45c466b9027936ce4913081 P 4d4fa3748e044961a6f00561784a5cae: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 09:23:20.398914 20688 tablet_replica.cc:439] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9474147985324fd396ecaa3df8f8bd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } } }
I20260809 09:23:20.399050 20688 tablet_replica.cc:442] T a976f6e7c45c466b9027936ce4913081 P 9474147985324fd396ecaa3df8f8bd49: This TxnStatusTablet replica's current role is: LEADER
I20260809 09:23:20.400586 20689 tablet_replica.cc:439] T a976f6e7c45c466b9027936ce4913081 P 4d4fa3748e044961a6f00561784a5cae: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9474147985324fd396ecaa3df8f8bd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } } }
I20260809 09:23:20.400697 20689 tablet_replica.cc:442] T a976f6e7c45c466b9027936ce4913081 P 4d4fa3748e044961a6f00561784a5cae: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 09:23:20.400775 20697 mvcc.cc:205] Tried to move back new op lower bound from 7316551271978528768 to 7316551271916802048. Current Snapshot: MvccSnapshot[applied={T|T < 7316551271978528768 or (T in {7316551271978528768})}]
I20260809 09:23:20.404013 20675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:20.400297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38268 (local address 127.11.99.193:38573)
0809 09:23:20.400388 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:20.400392 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:20.400404 (+ 12us) server_negotiation.cc:407] Connection header received
0809 09:23:20.400441 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:20.400443 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:20.400495 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:20.400565 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:23:20.401034 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.401651 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.402875 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.403138 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.403264 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:20.403558 (+ 294us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:23:20.403639 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:23:20.403715 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:20.403835 (+ 120us) server_negotiation.cc:299] Negotiation successful
0809 09:23:20.403887 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 09:23:20.414183 20675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:20.410589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:33415 (local address 127.11.99.193:38573)
0809 09:23:20.410710 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:20.410714 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:20.410885 (+ 171us) server_negotiation.cc:407] Connection header received
0809 09:23:20.410951 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:20.410954 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:20.410999 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:20.411080 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:23:20.411301 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.412033 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.413027 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.413346 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.413450 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:20.413740 (+ 290us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:23:20.413811 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:23:20.413881 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:20.414001 (+ 120us) server_negotiation.cc:299] Negotiation successful
0809 09:23:20.414050 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 09:23:20.414242 20740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:20.410479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:38573 (local address 127.11.99.193:33415)
0809 09:23:20.410780 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:20.410792 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:20.410888 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:20.411093 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:20.411095 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:20.411100 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 09:23:20.411193 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:20.411196 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.412128 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.412130 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:20.412905 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:20.412924 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.413450 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.413453 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:20.413581 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:20.413622 (+ 41us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 09:23:20.413901 (+ 279us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 09:23:20.413915 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 09:23:20.413970 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 09:23:20.414031 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":104,"threads_started":1}
I20260809 09:23:20.420743 20599 raft_consensus.cc:1261] T a8edc012a4af456588dcecc821fab7a9 P 4d4fa3748e044961a6f00561784a5cae [term 1 FOLLOWER]: Refusing update from remote peer 9474147985324fd396ecaa3df8f8bd49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:23:20.420843 20447 raft_consensus.cc:1261] T a8edc012a4af456588dcecc821fab7a9 P fa9d0f26c8e34ae98ff036ee4a3f377b [term 1 FOLLOWER]: Refusing update from remote peer 9474147985324fd396ecaa3df8f8bd49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:23:20.421331 20688 consensus_queue.cc:1035] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:23:20.421516 20736 consensus_queue.cc:1035] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:23:20.459514 20123 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37682:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:23:20.459678 20123 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37682:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:23:20.461530 20123 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f: Sending DeleteTablet for 3 replicas of tablet a8edc012a4af456588dcecc821fab7a9
I20260809 09:23:20.462013 20273 tablet_service.cc:1514] Processing DeleteTablet for tablet a8edc012a4af456588dcecc821fab7a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:20 UTC) from {username='oryx', principal='oryx/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:38252
I20260809 09:23:20.462184 20706 tablet_replica.cc:330] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49: stopping tablet replica
I20260809 09:23:20.462177 20579 tablet_service.cc:1514] Processing DeleteTablet for tablet a8edc012a4af456588dcecc821fab7a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:20 UTC) from {username='oryx', principal='oryx/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:59092
I20260809 09:23:20.462302 20706 raft_consensus.cc:2229] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49 [term 1 LEADER]: Raft consensus shutting down.
I20260809 09:23:20.462347 20707 tablet_replica.cc:330] T a8edc012a4af456588dcecc821fab7a9 P 4d4fa3748e044961a6f00561784a5cae: stopping tablet replica
I20260809 09:23:20.462441 20707 raft_consensus.cc:2229] T a8edc012a4af456588dcecc821fab7a9 P 4d4fa3748e044961a6f00561784a5cae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:23:20.462546 20707 raft_consensus.cc:2258] T a8edc012a4af456588dcecc821fab7a9 P 4d4fa3748e044961a6f00561784a5cae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:23:20.462555 20706 raft_consensus.cc:2258] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:23:20.463001 20423 tablet_service.cc:1514] Processing DeleteTablet for tablet a8edc012a4af456588dcecc821fab7a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:20 UTC) from {username='oryx', principal='oryx/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:37982
I20260809 09:23:20.464613 20708 tablet_replica.cc:330] T a8edc012a4af456588dcecc821fab7a9 P fa9d0f26c8e34ae98ff036ee4a3f377b: stopping tablet replica
I20260809 09:23:20.464751 20708 raft_consensus.cc:2229] T a8edc012a4af456588dcecc821fab7a9 P fa9d0f26c8e34ae98ff036ee4a3f377b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:23:20.464852 20708 raft_consensus.cc:2258] T a8edc012a4af456588dcecc821fab7a9 P fa9d0f26c8e34ae98ff036ee4a3f377b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:23:20.465745 20707 ts_tablet_manager.cc:1905] T a8edc012a4af456588dcecc821fab7a9 P 4d4fa3748e044961a6f00561784a5cae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:23:20.466174 20706 ts_tablet_manager.cc:1905] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:23:20.468654 20707 ts_tablet_manager.cc:1918] T a8edc012a4af456588dcecc821fab7a9 P 4d4fa3748e044961a6f00561784a5cae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 09:23:20.468740 20707 log.cc:1196] T a8edc012a4af456588dcecc821fab7a9 P 4d4fa3748e044961a6f00561784a5cae: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/a8edc012a4af456588dcecc821fab7a9
I20260809 09:23:20.469004 20707 ts_tablet_manager.cc:1939] T a8edc012a4af456588dcecc821fab7a9 P 4d4fa3748e044961a6f00561784a5cae: Deleting consensus metadata
I20260809 09:23:20.469300 20706 ts_tablet_manager.cc:1918] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 09:23:20.469393 20706 log.cc:1196] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-0/wal/wals/a8edc012a4af456588dcecc821fab7a9
I20260809 09:23:20.469688 20706 ts_tablet_manager.cc:1939] T a8edc012a4af456588dcecc821fab7a9 P 9474147985324fd396ecaa3df8f8bd49: Deleting consensus metadata
I20260809 09:23:20.469746 20105 catalog_manager.cc:4841] TS 4d4fa3748e044961a6f00561784a5cae (127.11.99.195:44877): tablet a8edc012a4af456588dcecc821fab7a9 (table test-table [id=63d475fead2a4ef1b42fbb30558b579e]) successfully deleted
I20260809 09:23:20.469985 20708 ts_tablet_manager.cc:1905] T a8edc012a4af456588dcecc821fab7a9 P fa9d0f26c8e34ae98ff036ee4a3f377b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:23:20.470378 20109 catalog_manager.cc:4841] TS 9474147985324fd396ecaa3df8f8bd49 (127.11.99.193:38573): tablet a8edc012a4af456588dcecc821fab7a9 (table test-table [id=63d475fead2a4ef1b42fbb30558b579e]) successfully deleted
I20260809 09:23:20.472736 20708 ts_tablet_manager.cc:1918] T a8edc012a4af456588dcecc821fab7a9 P fa9d0f26c8e34ae98ff036ee4a3f377b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 09:23:20.472821 20708 log.cc:1196] T a8edc012a4af456588dcecc821fab7a9 P fa9d0f26c8e34ae98ff036ee4a3f377b: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/a8edc012a4af456588dcecc821fab7a9
I20260809 09:23:20.473278 20708 ts_tablet_manager.cc:1939] T a8edc012a4af456588dcecc821fab7a9 P fa9d0f26c8e34ae98ff036ee4a3f377b: Deleting consensus metadata
I20260809 09:23:20.474802 20107 catalog_manager.cc:4841] TS fa9d0f26c8e34ae98ff036ee4a3f377b (127.11.99.194:38355): tablet a8edc012a4af456588dcecc821fab7a9 (table test-table [id=63d475fead2a4ef1b42fbb30558b579e]) successfully deleted
Aug 09 09:23:20 dist-test-slave-pgkr krb5kdc[20073](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267400, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 09:23:20 dist-test-slave-pgkr krb5kdc[20073](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:20 dist-test-slave-pgkr krb5kdc[20073](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 09:23:20.496789 20175 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:20.490241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37712 (local address 127.11.99.254:35617)
0809 09:23:20.490388 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:20.490393 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:20.490544 (+ 151us) server_negotiation.cc:407] Connection header received
0809 09:23:20.490731 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:20.490734 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:20.490821 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:20.490917 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:20.491602 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.492376 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.493316 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.493535 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.493648 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:20.496671 (+ 3023us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37712: BlockingRecv error: recv got EOF from 127.0.0.1:37712 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 09 09:23:20 dist-test-slave-pgkr krb5kdc[20073](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267400, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM
I20260809 09:23:20.507390 20175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:20.498894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37728 (local address 127.11.99.254:35617)
0809 09:23:20.499012 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:20.499016 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:20.499027 (+ 11us) server_negotiation.cc:407] Connection header received
0809 09:23:20.499064 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:20.499066 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:20.499097 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:20.499181 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:20.499759 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.500310 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.501179 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.501557 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.501652 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:20.504213 (+ 2561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:20.504216 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:20.504218 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:20.504241 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:20.505639 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:20.506102 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:20.506105 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:20.506107 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:20.506190 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:20.506480 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:20.506484 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:20.506485 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:20.506737 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:20.506872 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:20.507099 (+ 227us) server_negotiation.cc:299] Negotiation successful
0809 09:23:20.507210 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 09:23:20.509850 20123 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37728:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 09:23:20.510314 20123 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:23:20.515617 20273 tablet_service.cc:1467] Processing CreateTablet for tablet e544c917e0544f39b998b534683970d0 (DEFAULT_TABLE table=test-table [id=0019e075da6b4238846625b131cb578b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:20.515614 20423 tablet_service.cc:1467] Processing CreateTablet for tablet e544c917e0544f39b998b534683970d0 (DEFAULT_TABLE table=test-table [id=0019e075da6b4238846625b131cb578b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:20.515928 20273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e544c917e0544f39b998b534683970d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:20.515967 20423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e544c917e0544f39b998b534683970d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:20.518141 20680 tablet_bootstrap.cc:492] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49: Bootstrap starting.
I20260809 09:23:20.518458 20681 tablet_bootstrap.cc:492] T e544c917e0544f39b998b534683970d0 P fa9d0f26c8e34ae98ff036ee4a3f377b: Bootstrap starting.
I20260809 09:23:20.518982 20579 tablet_service.cc:1467] Processing CreateTablet for tablet e544c917e0544f39b998b534683970d0 (DEFAULT_TABLE table=test-table [id=0019e075da6b4238846625b131cb578b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:20.519277 20579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e544c917e0544f39b998b534683970d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:20.519304 20681 tablet_bootstrap.cc:654] T e544c917e0544f39b998b534683970d0 P fa9d0f26c8e34ae98ff036ee4a3f377b: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:20.519304 20680 tablet_bootstrap.cc:654] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:20.521163 20680 tablet_bootstrap.cc:492] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49: No bootstrap required, opened a new log
I20260809 09:23:20.521296 20680 ts_tablet_manager.cc:1397] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260809 09:23:20.521752 20682 tablet_bootstrap.cc:492] T e544c917e0544f39b998b534683970d0 P 4d4fa3748e044961a6f00561784a5cae: Bootstrap starting.
I20260809 09:23:20.521770 20680 raft_consensus.cc:348] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.521871 20680 raft_consensus.cc:374] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:20.521901 20680 raft_consensus.cc:729] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9474147985324fd396ecaa3df8f8bd49, State: Initialized, Role: FOLLOWER
I20260809 09:23:20.522032 20680 consensus_queue.cc:260] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.522336 20680 ts_tablet_manager.cc:1428] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 09:23:20.522774 20682 tablet_bootstrap.cc:654] T e544c917e0544f39b998b534683970d0 P 4d4fa3748e044961a6f00561784a5cae: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:20.524605 20682 tablet_bootstrap.cc:492] T e544c917e0544f39b998b534683970d0 P 4d4fa3748e044961a6f00561784a5cae: No bootstrap required, opened a new log
I20260809 09:23:20.524739 20682 ts_tablet_manager.cc:1397] T e544c917e0544f39b998b534683970d0 P 4d4fa3748e044961a6f00561784a5cae: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 09:23:20.525348 20682 raft_consensus.cc:348] T e544c917e0544f39b998b534683970d0 P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.525462 20682 raft_consensus.cc:374] T e544c917e0544f39b998b534683970d0 P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:20.525502 20682 raft_consensus.cc:729] T e544c917e0544f39b998b534683970d0 P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4fa3748e044961a6f00561784a5cae, State: Initialized, Role: FOLLOWER
I20260809 09:23:20.525636 20682 consensus_queue.cc:260] T e544c917e0544f39b998b534683970d0 P 4d4fa3748e044961a6f00561784a5cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.525920 20682 ts_tablet_manager.cc:1428] T e544c917e0544f39b998b534683970d0 P 4d4fa3748e044961a6f00561784a5cae: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 09:23:20.528285 20681 tablet_bootstrap.cc:492] T e544c917e0544f39b998b534683970d0 P fa9d0f26c8e34ae98ff036ee4a3f377b: No bootstrap required, opened a new log
I20260809 09:23:20.528385 20681 ts_tablet_manager.cc:1397] T e544c917e0544f39b998b534683970d0 P fa9d0f26c8e34ae98ff036ee4a3f377b: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20260809 09:23:20.528760 20681 raft_consensus.cc:348] T e544c917e0544f39b998b534683970d0 P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.528847 20681 raft_consensus.cc:374] T e544c917e0544f39b998b534683970d0 P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:20.528868 20681 raft_consensus.cc:729] T e544c917e0544f39b998b534683970d0 P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa9d0f26c8e34ae98ff036ee4a3f377b, State: Initialized, Role: FOLLOWER
I20260809 09:23:20.528990 20681 consensus_queue.cc:260] T e544c917e0544f39b998b534683970d0 P fa9d0f26c8e34ae98ff036ee4a3f377b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.529258 20681 ts_tablet_manager.cc:1428] T e544c917e0544f39b998b534683970d0 P fa9d0f26c8e34ae98ff036ee4a3f377b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 09:23:20.638895 20736 raft_consensus.cc:482] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:23:20.639056 20736 raft_consensus.cc:504] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.639534 20736 leader_election.cc:288] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa9d0f26c8e34ae98ff036ee4a3f377b (127.11.99.194:38355), 4d4fa3748e044961a6f00561784a5cae (127.11.99.195:44877)
I20260809 09:23:20.639925 20447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e544c917e0544f39b998b534683970d0" candidate_uuid: "9474147985324fd396ecaa3df8f8bd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" is_pre_election: true
I20260809 09:23:20.639950 20599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e544c917e0544f39b998b534683970d0" candidate_uuid: "9474147985324fd396ecaa3df8f8bd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4fa3748e044961a6f00561784a5cae" is_pre_election: true
I20260809 09:23:20.640089 20447 raft_consensus.cc:2454] T e544c917e0544f39b998b534683970d0 P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9474147985324fd396ecaa3df8f8bd49 in term 0.
I20260809 09:23:20.640112 20599 raft_consensus.cc:2454] T e544c917e0544f39b998b534683970d0 P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9474147985324fd396ecaa3df8f8bd49 in term 0.
I20260809 09:23:20.640448 20220 leader_election.cc:302] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9474147985324fd396ecaa3df8f8bd49, fa9d0f26c8e34ae98ff036ee4a3f377b; no voters:
I20260809 09:23:20.640643 20736 raft_consensus.cc:2781] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:23:20.640733 20736 raft_consensus.cc:482] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:23:20.640787 20736 raft_consensus.cc:3037] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:20.641804 20736 raft_consensus.cc:504] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.642164 20736 leader_election.cc:288] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49 [CANDIDATE]: Term 1 election: Requested vote from peers fa9d0f26c8e34ae98ff036ee4a3f377b (127.11.99.194:38355), 4d4fa3748e044961a6f00561784a5cae (127.11.99.195:44877)
I20260809 09:23:20.642493 20447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e544c917e0544f39b998b534683970d0" candidate_uuid: "9474147985324fd396ecaa3df8f8bd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b"
I20260809 09:23:20.642547 20599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e544c917e0544f39b998b534683970d0" candidate_uuid: "9474147985324fd396ecaa3df8f8bd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4fa3748e044961a6f00561784a5cae"
I20260809 09:23:20.642661 20447 raft_consensus.cc:3037] T e544c917e0544f39b998b534683970d0 P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:20.642704 20599 raft_consensus.cc:3037] T e544c917e0544f39b998b534683970d0 P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:20.643659 20447 raft_consensus.cc:2454] T e544c917e0544f39b998b534683970d0 P fa9d0f26c8e34ae98ff036ee4a3f377b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9474147985324fd396ecaa3df8f8bd49 in term 1.
I20260809 09:23:20.643855 20599 raft_consensus.cc:2454] T e544c917e0544f39b998b534683970d0 P 4d4fa3748e044961a6f00561784a5cae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9474147985324fd396ecaa3df8f8bd49 in term 1.
I20260809 09:23:20.643956 20220 leader_election.cc:302] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9474147985324fd396ecaa3df8f8bd49, fa9d0f26c8e34ae98ff036ee4a3f377b; no voters:
I20260809 09:23:20.644135 20736 raft_consensus.cc:2781] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:23:20.644224 20736 raft_consensus.cc:686] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49 [term 1 LEADER]: Becoming Leader. State: Replica: 9474147985324fd396ecaa3df8f8bd49, State: Running, Role: LEADER
I20260809 09:23:20.644351 20736 consensus_queue.cc:237] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.646075 20123 catalog_manager.cc:5495] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9474147985324fd396ecaa3df8f8bd49 (127.11.99.193). New cstate: current_term: 1 leader_uuid: "9474147985324fd396ecaa3df8f8bd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } health_report { overall_health: UNKNOWN } } }
I20260809 09:23:20.674707 20675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:20.671149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38280 (local address 127.11.99.193:38573)
0809 09:23:20.671297 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:20.671302 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:20.671321 (+ 19us) server_negotiation.cc:407] Connection header received
0809 09:23:20.671408 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:20.671411 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:20.671490 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:20.671592 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:23:20.671826 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.672619 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.673546 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:20.673855 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:20.673972 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:20.674217 (+ 245us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:23:20.674298 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:23:20.674375 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:20.674453 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 09:23:20.674501 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 09:23:20.676689 20447 raft_consensus.cc:1261] T e544c917e0544f39b998b534683970d0 P fa9d0f26c8e34ae98ff036ee4a3f377b [term 1 FOLLOWER]: Refusing update from remote peer 9474147985324fd396ecaa3df8f8bd49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:23:20.677186 20599 raft_consensus.cc:1261] T e544c917e0544f39b998b534683970d0 P 4d4fa3748e044961a6f00561784a5cae [term 1 FOLLOWER]: Refusing update from remote peer 9474147985324fd396ecaa3df8f8bd49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:23:20.677214 20688 consensus_queue.cc:1035] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:23:20.677624 20688 consensus_queue.cc:1035] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:23:20.687907 20122 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:23:20.688048 20122 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:23:20.690016 20122 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f: Sending DeleteTablet for 3 replicas of tablet e544c917e0544f39b998b534683970d0
I20260809 09:23:20.690596 20579 tablet_service.cc:1514] Processing DeleteTablet for tablet e544c917e0544f39b998b534683970d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:20 UTC) from {username='oryx', principal='oryx/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:59092
I20260809 09:23:20.690676 20273 tablet_service.cc:1514] Processing DeleteTablet for tablet e544c917e0544f39b998b534683970d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:20 UTC) from {username='oryx', principal='oryx/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:38252
I20260809 09:23:20.690703 20423 tablet_service.cc:1514] Processing DeleteTablet for tablet e544c917e0544f39b998b534683970d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:20 UTC) from {username='oryx', principal='oryx/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:37982
I20260809 09:23:20.690833 20706 tablet_replica.cc:330] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49: stopping tablet replica
I20260809 09:23:20.690908 20708 tablet_replica.cc:330] T e544c917e0544f39b998b534683970d0 P fa9d0f26c8e34ae98ff036ee4a3f377b: stopping tablet replica
I20260809 09:23:20.690940 20707 tablet_replica.cc:330] T e544c917e0544f39b998b534683970d0 P 4d4fa3748e044961a6f00561784a5cae: stopping tablet replica
I20260809 09:23:20.690964 20706 raft_consensus.cc:2229] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49 [term 1 LEADER]: Raft consensus shutting down.
I20260809 09:23:20.691020 20708 raft_consensus.cc:2229] T e544c917e0544f39b998b534683970d0 P fa9d0f26c8e34ae98ff036ee4a3f377b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:23:20.691083 20707 raft_consensus.cc:2229] T e544c917e0544f39b998b534683970d0 P 4d4fa3748e044961a6f00561784a5cae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:23:20.691128 20708 raft_consensus.cc:2258] T e544c917e0544f39b998b534683970d0 P fa9d0f26c8e34ae98ff036ee4a3f377b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:23:20.691129 20706 raft_consensus.cc:2258] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:23:20.691238 20707 raft_consensus.cc:2258] T e544c917e0544f39b998b534683970d0 P 4d4fa3748e044961a6f00561784a5cae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:23:20.692056 20706 ts_tablet_manager.cc:1905] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:23:20.692214 20707 ts_tablet_manager.cc:1905] T e544c917e0544f39b998b534683970d0 P 4d4fa3748e044961a6f00561784a5cae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:23:20.692282 20122 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37728:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 09:23:20.692654 20122 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:23:20.694644 20707 ts_tablet_manager.cc:1918] T e544c917e0544f39b998b534683970d0 P 4d4fa3748e044961a6f00561784a5cae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:23:20.694662 20708 ts_tablet_manager.cc:1905] T e544c917e0544f39b998b534683970d0 P fa9d0f26c8e34ae98ff036ee4a3f377b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:23:20.694718 20707 log.cc:1196] T e544c917e0544f39b998b534683970d0 P 4d4fa3748e044961a6f00561784a5cae: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/e544c917e0544f39b998b534683970d0
I20260809 09:23:20.694995 20707 ts_tablet_manager.cc:1939] T e544c917e0544f39b998b534683970d0 P 4d4fa3748e044961a6f00561784a5cae: Deleting consensus metadata
I20260809 09:23:20.695603 20706 ts_tablet_manager.cc:1918] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:23:20.695644 20105 catalog_manager.cc:4841] TS 4d4fa3748e044961a6f00561784a5cae (127.11.99.195:44877): tablet e544c917e0544f39b998b534683970d0 (table test-table [id=0019e075da6b4238846625b131cb578b]) successfully deleted
I20260809 09:23:20.696732 20706 log.cc:1196] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-0/wal/wals/e544c917e0544f39b998b534683970d0
I20260809 09:23:20.697085 20706 ts_tablet_manager.cc:1939] T e544c917e0544f39b998b534683970d0 P 9474147985324fd396ecaa3df8f8bd49: Deleting consensus metadata
I20260809 09:23:20.697114 20708 ts_tablet_manager.cc:1918] T e544c917e0544f39b998b534683970d0 P fa9d0f26c8e34ae98ff036ee4a3f377b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:23:20.697199 20708 log.cc:1196] T e544c917e0544f39b998b534683970d0 P fa9d0f26c8e34ae98ff036ee4a3f377b: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/e544c917e0544f39b998b534683970d0
I20260809 09:23:20.698009 20708 ts_tablet_manager.cc:1939] T e544c917e0544f39b998b534683970d0 P fa9d0f26c8e34ae98ff036ee4a3f377b: Deleting consensus metadata
I20260809 09:23:20.698915 20107 catalog_manager.cc:4841] TS fa9d0f26c8e34ae98ff036ee4a3f377b (127.11.99.194:38355): tablet e544c917e0544f39b998b534683970d0 (table test-table [id=0019e075da6b4238846625b131cb578b]) successfully deleted
I20260809 09:23:20.699056 20579 tablet_service.cc:1467] Processing CreateTablet for tablet 978b5fef732a456f84578832f783f8be (DEFAULT_TABLE table=test-table [id=c1831c2122dd42bea4b26dfc348830a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:20.699047 20423 tablet_service.cc:1467] Processing CreateTablet for tablet 978b5fef732a456f84578832f783f8be (DEFAULT_TABLE table=test-table [id=c1831c2122dd42bea4b26dfc348830a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:20.699294 20579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 978b5fef732a456f84578832f783f8be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:20.699294 20423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 978b5fef732a456f84578832f783f8be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:20.701491 20681 tablet_bootstrap.cc:492] T 978b5fef732a456f84578832f783f8be P fa9d0f26c8e34ae98ff036ee4a3f377b: Bootstrap starting.
I20260809 09:23:20.701579 20682 tablet_bootstrap.cc:492] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae: Bootstrap starting.
I20260809 09:23:20.702309 20682 tablet_bootstrap.cc:654] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:20.702308 20681 tablet_bootstrap.cc:654] T 978b5fef732a456f84578832f783f8be P fa9d0f26c8e34ae98ff036ee4a3f377b: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:20.703557 20109 catalog_manager.cc:4841] TS 9474147985324fd396ecaa3df8f8bd49 (127.11.99.193:38573): tablet e544c917e0544f39b998b534683970d0 (table test-table [id=0019e075da6b4238846625b131cb578b]) successfully deleted
I20260809 09:23:20.703599 20682 tablet_bootstrap.cc:492] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae: No bootstrap required, opened a new log
I20260809 09:23:20.703680 20682 ts_tablet_manager.cc:1397] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 09:23:20.703840 20273 tablet_service.cc:1467] Processing CreateTablet for tablet 978b5fef732a456f84578832f783f8be (DEFAULT_TABLE table=test-table [id=c1831c2122dd42bea4b26dfc348830a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:20.704088 20273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 978b5fef732a456f84578832f783f8be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:20.704066 20682 raft_consensus.cc:348] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.704145 20682 raft_consensus.cc:374] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:20.704169 20682 raft_consensus.cc:729] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4fa3748e044961a6f00561784a5cae, State: Initialized, Role: FOLLOWER
I20260809 09:23:20.704326 20682 consensus_queue.cc:260] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.704561 20682 ts_tablet_manager.cc:1428] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 09:23:20.705163 20681 tablet_bootstrap.cc:492] T 978b5fef732a456f84578832f783f8be P fa9d0f26c8e34ae98ff036ee4a3f377b: No bootstrap required, opened a new log
I20260809 09:23:20.705273 20681 ts_tablet_manager.cc:1397] T 978b5fef732a456f84578832f783f8be P fa9d0f26c8e34ae98ff036ee4a3f377b: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260809 09:23:20.705638 20681 raft_consensus.cc:348] T 978b5fef732a456f84578832f783f8be P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.705751 20681 raft_consensus.cc:374] T 978b5fef732a456f84578832f783f8be P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:20.705811 20681 raft_consensus.cc:729] T 978b5fef732a456f84578832f783f8be P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa9d0f26c8e34ae98ff036ee4a3f377b, State: Initialized, Role: FOLLOWER
I20260809 09:23:20.705961 20681 consensus_queue.cc:260] T 978b5fef732a456f84578832f783f8be P fa9d0f26c8e34ae98ff036ee4a3f377b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.706231 20681 ts_tablet_manager.cc:1428] T 978b5fef732a456f84578832f783f8be P fa9d0f26c8e34ae98ff036ee4a3f377b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 09:23:20.706655 20680 tablet_bootstrap.cc:492] T 978b5fef732a456f84578832f783f8be P 9474147985324fd396ecaa3df8f8bd49: Bootstrap starting.
I20260809 09:23:20.707536 20680 tablet_bootstrap.cc:654] T 978b5fef732a456f84578832f783f8be P 9474147985324fd396ecaa3df8f8bd49: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:20.708606 20680 tablet_bootstrap.cc:492] T 978b5fef732a456f84578832f783f8be P 9474147985324fd396ecaa3df8f8bd49: No bootstrap required, opened a new log
I20260809 09:23:20.708666 20680 ts_tablet_manager.cc:1397] T 978b5fef732a456f84578832f783f8be P 9474147985324fd396ecaa3df8f8bd49: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 09:23:20.708912 20680 raft_consensus.cc:348] T 978b5fef732a456f84578832f783f8be P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.708989 20680 raft_consensus.cc:374] T 978b5fef732a456f84578832f783f8be P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:20.709007 20680 raft_consensus.cc:729] T 978b5fef732a456f84578832f783f8be P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9474147985324fd396ecaa3df8f8bd49, State: Initialized, Role: FOLLOWER
I20260809 09:23:20.709134 20680 consensus_queue.cc:260] T 978b5fef732a456f84578832f783f8be P 9474147985324fd396ecaa3df8f8bd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:20.709385 20680 ts_tablet_manager.cc:1428] T 978b5fef732a456f84578832f783f8be P 9474147985324fd396ecaa3df8f8bd49: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 09:23:21.058640 20689 raft_consensus.cc:482] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:23:21.058792 20689 raft_consensus.cc:504] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:21.059881 20689 leader_election.cc:288] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9474147985324fd396ecaa3df8f8bd49 (127.11.99.193:38573), fa9d0f26c8e34ae98ff036ee4a3f377b (127.11.99.194:38355)
I20260809 09:23:21.064092 20675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:21.060286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:46539 (local address 127.11.99.193:38573)
0809 09:23:21.060473 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:21.060477 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:21.060780 (+ 303us) server_negotiation.cc:407] Connection header received
0809 09:23:21.060931 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:21.060934 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:21.060982 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:21.061067 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:21.061352 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:21.061842 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:21.063106 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:21.063568 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:21.063685 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:21.063744 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:21.063901 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 09:23:21.063972 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 09:23:21.064106 20772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:21.060217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:38573 (local address 127.11.99.195:46539)
0809 09:23:21.060677 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:21.060688 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:21.060810 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:21.061086 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:21.061089 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:21.061118 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:21.061241 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:21.061246 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:21.061954 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:21.061958 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:21.062974 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:21.062989 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:21.063686 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:21.063689 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:21.063773 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:21.063797 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 09:23:21.063884 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 09:23:21.063949 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":406,"mutex_wait_us":145,"thread_start_us":94,"threads_started":1}
I20260809 09:23:21.064158 20774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:21.060281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:52343 (local address 127.11.99.194:38355)
0809 09:23:21.060607 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:21.060613 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:21.060705 (+ 92us) server_negotiation.cc:407] Connection header received
0809 09:23:21.060909 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:21.060911 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:21.060955 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:21.061050 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:21.061349 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:21.061842 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:21.063133 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:21.063588 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:21.063718 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:21.063770 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:21.063975 (+ 205us) server_negotiation.cc:299] Negotiation successful
0809 09:23:21.064047 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":96,"threads_started":1}
I20260809 09:23:21.064179 20773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:21.060213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:38355 (local address 127.11.99.195:52343)
0809 09:23:21.060605 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:21.060621 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:21.060778 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:21.061059 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:21.061062 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:21.061077 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:21.061239 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:21.061245 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:21.061951 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:21.061955 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:21.063001 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:21.063011 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:21.063717 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:21.063720 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:21.063843 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:21.063866 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 09:23:21.063957 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 09:23:21.064023 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"mutex_wait_us":42,"spinlock_wait_cycles":13184,"thread_start_us":85,"threads_started":1}
I20260809 09:23:21.064749 20293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "978b5fef732a456f84578832f783f8be" candidate_uuid: "4d4fa3748e044961a6f00561784a5cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9474147985324fd396ecaa3df8f8bd49" is_pre_election: true
I20260809 09:23:21.064934 20293 raft_consensus.cc:2454] T 978b5fef732a456f84578832f783f8be P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d4fa3748e044961a6f00561784a5cae in term 0.
I20260809 09:23:21.064910 20447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "978b5fef732a456f84578832f783f8be" candidate_uuid: "4d4fa3748e044961a6f00561784a5cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" is_pre_election: true
I20260809 09:23:21.065069 20447 raft_consensus.cc:2454] T 978b5fef732a456f84578832f783f8be P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d4fa3748e044961a6f00561784a5cae in term 0.
I20260809 09:23:21.065301 20530 leader_election.cc:302] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4fa3748e044961a6f00561784a5cae, 9474147985324fd396ecaa3df8f8bd49; no voters:
I20260809 09:23:21.065577 20689 raft_consensus.cc:2781] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:23:21.065640 20689 raft_consensus.cc:482] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:23:21.065688 20689 raft_consensus.cc:3037] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:21.066754 20689 raft_consensus.cc:504] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:21.067209 20689 leader_election.cc:288] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae [CANDIDATE]: Term 1 election: Requested vote from peers 9474147985324fd396ecaa3df8f8bd49 (127.11.99.193:38573), fa9d0f26c8e34ae98ff036ee4a3f377b (127.11.99.194:38355)
I20260809 09:23:21.067548 20293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "978b5fef732a456f84578832f783f8be" candidate_uuid: "4d4fa3748e044961a6f00561784a5cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9474147985324fd396ecaa3df8f8bd49"
I20260809 09:23:21.067627 20447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "978b5fef732a456f84578832f783f8be" candidate_uuid: "4d4fa3748e044961a6f00561784a5cae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b"
I20260809 09:23:21.067673 20293 raft_consensus.cc:3037] T 978b5fef732a456f84578832f783f8be P 9474147985324fd396ecaa3df8f8bd49 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:21.067745 20447 raft_consensus.cc:3037] T 978b5fef732a456f84578832f783f8be P fa9d0f26c8e34ae98ff036ee4a3f377b [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:21.068574 20293 raft_consensus.cc:2454] T 978b5fef732a456f84578832f783f8be P 9474147985324fd396ecaa3df8f8bd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4fa3748e044961a6f00561784a5cae in term 1.
I20260809 09:23:21.068710 20447 raft_consensus.cc:2454] T 978b5fef732a456f84578832f783f8be P fa9d0f26c8e34ae98ff036ee4a3f377b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4fa3748e044961a6f00561784a5cae in term 1.
I20260809 09:23:21.068856 20530 leader_election.cc:302] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4fa3748e044961a6f00561784a5cae, 9474147985324fd396ecaa3df8f8bd49; no voters:
I20260809 09:23:21.069046 20689 raft_consensus.cc:2781] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:23:21.069206 20689 raft_consensus.cc:686] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae [term 1 LEADER]: Becoming Leader. State: Replica: 4d4fa3748e044961a6f00561784a5cae, State: Running, Role: LEADER
I20260809 09:23:21.069455 20689 consensus_queue.cc:237] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } }
I20260809 09:23:21.071591 20123 catalog_manager.cc:5495] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d4fa3748e044961a6f00561784a5cae (127.11.99.195). New cstate: current_term: 1 leader_uuid: "4d4fa3748e044961a6f00561784a5cae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d4fa3748e044961a6f00561784a5cae" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44877 } health_report { overall_health: HEALTHY } } }
I20260809 09:23:21.171036 20777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:21.167335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59098 (local address 127.11.99.195:44877)
0809 09:23:21.167639 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:21.167648 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:21.167675 (+ 27us) server_negotiation.cc:407] Connection header received
0809 09:23:21.167747 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:21.167749 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:21.167799 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:21.167933 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:23:21.168176 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:21.168715 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:21.169567 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:21.169801 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:21.169905 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:21.170185 (+ 280us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:23:21.170649 (+ 464us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:23:21.170783 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:21.170823 (+ 40us) server_negotiation.cc:299] Negotiation successful
0809 09:23:21.170874 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":99,"threads_started":1}
I20260809 09:23:21.180478 20781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:21.177434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:38573 (local address 127.11.99.195:52967)
0809 09:23:21.177759 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:21.177771 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:21.177844 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:21.178062 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:21.178064 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:21.178069 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 09:23:21.178207 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:21.178211 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:21.178930 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:21.178933 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:21.179557 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:21.179565 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:21.179947 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:21.179949 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:21.180013 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:21.180049 (+ 36us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 09:23:21.180268 (+ 219us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 09:23:21.180273 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 09:23:21.180318 (+ 45us) client_negotiation.cc:240] Negotiation successful
0809 09:23:21.180372 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":98,"threads_started":1}
I20260809 09:23:21.180459 20675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:21.177667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:52967 (local address 127.11.99.193:38573)
0809 09:23:21.177790 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:21.177793 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:21.177808 (+ 15us) server_negotiation.cc:407] Connection header received
0809 09:23:21.177930 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:21.177933 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:21.177982 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:21.178054 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:23:21.178304 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:21.178828 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:21.179654 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:21.179849 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:21.179919 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:21.180147 (+ 228us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:23:21.180203 (+ 56us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:23:21.180252 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:21.180331 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 09:23:21.180365 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 09:23:21.186530 20447 raft_consensus.cc:1261] T 978b5fef732a456f84578832f783f8be P fa9d0f26c8e34ae98ff036ee4a3f377b [term 1 FOLLOWER]: Refusing update from remote peer 4d4fa3748e044961a6f00561784a5cae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:23:21.186592 20293 raft_consensus.cc:1261] T 978b5fef732a456f84578832f783f8be P 9474147985324fd396ecaa3df8f8bd49 [term 1 FOLLOWER]: Refusing update from remote peer 4d4fa3748e044961a6f00561784a5cae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:23:21.187134 20775 consensus_queue.cc:1035] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae [LEADER]: Connected to new peer: Peer: permanent_uuid: "9474147985324fd396ecaa3df8f8bd49" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:23:21.187300 20689 consensus_queue.cc:1035] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa9d0f26c8e34ae98ff036ee4a3f377b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 38355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:23:21.206127 20777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:21.201069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:41267 (local address 127.11.99.195:44877)
0809 09:23:21.201175 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:21.201179 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:21.202861 (+ 1682us) server_negotiation.cc:407] Connection header received
0809 09:23:21.202993 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:21.202996 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:21.203045 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:21.203126 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:23:21.203478 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:21.204141 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:21.205306 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:21.205489 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:21.205566 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:21.205791 (+ 225us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:23:21.205849 (+ 58us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:23:21.205899 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:21.205999 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 09:23:21.206039 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 09:23:21.206207 20786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:21.200988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:44877 (local address 127.11.99.193:41267)
0809 09:23:21.202777 (+ 1789us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:21.202789 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:21.202897 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:21.203136 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:21.203139 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:21.203146 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 09:23:21.203357 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:21.203367 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:21.204264 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:21.204267 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:21.205199 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:21.205209 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:21.205589 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:21.205592 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:21.205667 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:21.205696 (+ 29us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 09:23:21.205919 (+ 223us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 09:23:21.205924 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 09:23:21.205996 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 09:23:21.206075 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1715,"thread_start_us":67,"threads_started":1}
I20260809 09:23:21.231252 20123 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:23:21.231388 20123 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:23:21.233376 20123 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f765f921e6bf454d911e73c148b49c2f: Sending DeleteTablet for 3 replicas of tablet 978b5fef732a456f84578832f783f8be
I20260809 09:23:21.233937 20423 tablet_service.cc:1514] Processing DeleteTablet for tablet 978b5fef732a456f84578832f783f8be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:21 UTC) from {username='oryx', principal='oryx/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:37982
I20260809 09:23:21.234078 20273 tablet_service.cc:1514] Processing DeleteTablet for tablet 978b5fef732a456f84578832f783f8be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:21 UTC) from {username='oryx', principal='oryx/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:38252
I20260809 09:23:21.234107 20579 tablet_service.cc:1514] Processing DeleteTablet for tablet 978b5fef732a456f84578832f783f8be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:21 UTC) from {username='oryx', principal='oryx/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:59092
I20260809 09:23:21.234310 20789 tablet_replica.cc:330] T 978b5fef732a456f84578832f783f8be P fa9d0f26c8e34ae98ff036ee4a3f377b: stopping tablet replica
I20260809 09:23:21.234460 20790 tablet_replica.cc:330] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae: stopping tablet replica
I20260809 09:23:21.234457 20789 raft_consensus.cc:2229] T 978b5fef732a456f84578832f783f8be P fa9d0f26c8e34ae98ff036ee4a3f377b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:23:21.234635 20790 raft_consensus.cc:2229] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae [term 1 LEADER]: Raft consensus shutting down.
I20260809 09:23:21.234802 20789 raft_consensus.cc:2258] T 978b5fef732a456f84578832f783f8be P fa9d0f26c8e34ae98ff036ee4a3f377b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:23:21.234966 20790 raft_consensus.cc:2258] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:23:21.235160 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 20200
I20260809 09:23:21.236071 20790 ts_tablet_manager.cc:1905] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:23:21.236974 20789 ts_tablet_manager.cc:1905] T 978b5fef732a456f84578832f783f8be P fa9d0f26c8e34ae98ff036ee4a3f377b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:23:21.238868 20790 ts_tablet_manager.cc:1918] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 09:23:21.238958 20790 log.cc:1196] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/978b5fef732a456f84578832f783f8be
I20260809 09:23:21.239244 20790 ts_tablet_manager.cc:1939] T 978b5fef732a456f84578832f783f8be P 4d4fa3748e044961a6f00561784a5cae: Deleting consensus metadata
I20260809 09:23:21.240239 20789 ts_tablet_manager.cc:1918] T 978b5fef732a456f84578832f783f8be P fa9d0f26c8e34ae98ff036ee4a3f377b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 09:23:21.240263 20105 catalog_manager.cc:4841] TS 4d4fa3748e044961a6f00561784a5cae (127.11.99.195:44877): tablet 978b5fef732a456f84578832f783f8be (table test-table [id=c1831c2122dd42bea4b26dfc348830a3]) successfully deleted
I20260809 09:23:21.240348 20789 log.cc:1196] T 978b5fef732a456f84578832f783f8be P fa9d0f26c8e34ae98ff036ee4a3f377b: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/978b5fef732a456f84578832f783f8be
I20260809 09:23:21.240613 20789 ts_tablet_manager.cc:1939] T 978b5fef732a456f84578832f783f8be P fa9d0f26c8e34ae98ff036ee4a3f377b: Deleting consensus metadata
I20260809 09:23:21.241250 20107 catalog_manager.cc:4841] TS fa9d0f26c8e34ae98ff036ee4a3f377b (127.11.99.194:38355): tablet 978b5fef732a456f84578832f783f8be (table test-table [id=c1831c2122dd42bea4b26dfc348830a3]) successfully deleted
W20260809 09:23:21.249768 20109 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.99.193:38573 (error 108)
I20260809 09:23:21.251143 20793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:21.250476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:38573 (local address 127.0.0.1:38288)
0809 09:23:21.250977 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:21.251045 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.193:38573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":71,"threads_started":1}
W20260809 09:23:21.251250 20109 catalog_manager.cc:4584] TS 9474147985324fd396ecaa3df8f8bd49 (127.11.99.193:38573): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 978b5fef732a456f84578832f783f8be: Network error: Client connection negotiation failed: client connection to 127.11.99.193:38573: connect: Connection refused (error 111)
I20260809 09:23:21.251539 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 20351
I20260809 09:23:21.260705 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 20509
I20260809 09:23:21.267424 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 20088
2026-08-09T09:23:21Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3412 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:23:21 dist-test-slave-pgkr krb5kdc[20796](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:23:21 dist-test-slave-pgkr krb5kdc[20796](info): set up 2 sockets
Aug 09 09:23:21 dist-test-slave-pgkr krb5kdc[20796](info): commencing operation
krb5kdc: starting...
W20260809 09:23:22.307252 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.016s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:23:22 dist-test-slave-pgkr krb5kdc[20796](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267402, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:23:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:23:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:23:22.419529 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:37337
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:45267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:37337
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:22.525210 20810 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:22.525442 20810 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:22.525480 20810 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:22.529126 20810 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:23:22.529174 20810 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:22.529196 20810 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:22.529213 20810 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:23:22.529230 20810 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:23:22.534117 20810 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:45267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:37337
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:37337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20810
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:22.534969 20810 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:22.535838 20810 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:22.544042 20815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:22.544117 20818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:22.544057 20816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:22.544356 20810 server_base.cc:1034] running on GCE node
I20260809 09:23:22.544903 20810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:22.545895 20810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:22.547101 20810 hybrid_clock.cc:648] HybridClock initialized: now 1786267402547080 us; error 42 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-09T09:23:22Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1286 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:23:22 dist-test-slave-pgkr krb5kdc[20826](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:23:22 dist-test-slave-pgkr krb5kdc[20826](info): set up 2 sockets
Aug 09 09:23:22 dist-test-slave-pgkr krb5kdc[20826](info): commencing operation
krb5kdc: starting...
W20260809 09:23:23.595237 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.017s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:23:23 dist-test-slave-pgkr krb5kdc[20826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:23:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:23:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:23:23.713260 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:46645
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:42659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:46645
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:23.821141 20840 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:23.821404 20840 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:23.821475 20840 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:23.825213 20840 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:23:23.825294 20840 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:23.825328 20840 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:23.825384 20840 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:23:23.825420 20840 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:23:23.830273 20840 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:42659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:46645
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:46645
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20840
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:23.831281 20840 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:23.832227 20840 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:23.840310 20846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:23.840312 20847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:23.840306 20849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:23.840587 20840 server_base.cc:1034] running on GCE node
I20260809 09:23:23.841221 20840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:23.842172 20840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:23.843369 20840 hybrid_clock.cc:648] HybridClock initialized: now 1786267403843352 us; error 37 us; skew 500 ppm
Aug 09 09:23:23 dist-test-slave-pgkr krb5kdc[20826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267403, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:23.846113 20840 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:23:23.847076 20840 webserver.cc:460] Webserver started at http://127.11.99.254:40199/ using document root <none> and password file <none>
I20260809 09:23:23.847625 20840 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:23.847687 20840 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:23.847918 20840 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:23.849864 20840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "e1b440a6f2b2443792d57dda898fa9cd"
format_stamp: "Formatted at 2026-08-09 09:23:23 on dist-test-slave-pgkr"
server_key: "86b2eb5d40d9ef85de1677501bebf4d2"
server_key_iv: "af1b267592b73a3a2559e115ab53e55c"
server_key_version: "encryptionkey@0"
I20260809 09:23:23.850437 20840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "e1b440a6f2b2443792d57dda898fa9cd"
format_stamp: "Formatted at 2026-08-09 09:23:23 on dist-test-slave-pgkr"
server_key: "86b2eb5d40d9ef85de1677501bebf4d2"
server_key_iv: "af1b267592b73a3a2559e115ab53e55c"
server_key_version: "encryptionkey@0"
I20260809 09:23:23.854067 20840 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 09:23:23.856455 20856 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:23.857506 20840 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:23:23.857652 20840 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "e1b440a6f2b2443792d57dda898fa9cd"
format_stamp: "Formatted at 2026-08-09 09:23:23 on dist-test-slave-pgkr"
server_key: "86b2eb5d40d9ef85de1677501bebf4d2"
server_key_iv: "af1b267592b73a3a2559e115ab53e55c"
server_key_version: "encryptionkey@0"
I20260809 09:23:23.857755 20840 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:23.868342 20840 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:23.871392 20840 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:23.871611 20840 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:23.879021 20840 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:46645
I20260809 09:23:23.879029 20912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:46645 every 8 connection(s)
I20260809 09:23:23.879920 20840 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:23:23.882562 20913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:23.887528 20913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd: Bootstrap starting.
I20260809 09:23:23.888775 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 20840
I20260809 09:23:23.888921 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:23:23.889185 11663 external_mini_cluster.cc:1428] Setting key ac98c1776af3c5aff43c5d7a31c1def8
I20260809 09:23:23.889932 20913 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:23.890677 20913 log.cc:824] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:23.892740 20913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd: No bootstrap required, opened a new log
I20260809 09:23:23.896718 20913 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1b440a6f2b2443792d57dda898fa9cd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46645 } }
I20260809 09:23:23.896986 20913 raft_consensus.cc:374] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:23.897040 20913 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1b440a6f2b2443792d57dda898fa9cd, State: Initialized, Role: FOLLOWER
I20260809 09:23:23.897490 20913 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1b440a6f2b2443792d57dda898fa9cd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46645 } }
I20260809 09:23:23.897629 20913 raft_consensus.cc:388] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:23:23.897704 20913 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:23:23.897792 20913 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [term 0 FOLLOWER]: Advancing to term 1
Aug 09 09:23:23 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:23:23.898639 20913 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1b440a6f2b2443792d57dda898fa9cd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46645 } }
I20260809 09:23:23.898936 20913 leader_election.cc:302] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e1b440a6f2b2443792d57dda898fa9cd; no voters:
I20260809 09:23:23.899191 20913 leader_election.cc:288] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:23:23.899315 20919 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:23:23.899550 20919 raft_consensus.cc:686] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [term 1 LEADER]: Becoming Leader. State: Replica: e1b440a6f2b2443792d57dda898fa9cd, State: Running, Role: LEADER
I20260809 09:23:23.899830 20919 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1b440a6f2b2443792d57dda898fa9cd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46645 } }
I20260809 09:23:23.900451 20913 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:23:23.901304 20920 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e1b440a6f2b2443792d57dda898fa9cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1b440a6f2b2443792d57dda898fa9cd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46645 } } }
I20260809 09:23:23.901454 20920 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:23.901849 20921 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1b440a6f2b2443792d57dda898fa9cd. Latest consensus state: current_term: 1 leader_uuid: "e1b440a6f2b2443792d57dda898fa9cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1b440a6f2b2443792d57dda898fa9cd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46645 } } }
I20260809 09:23:23.902009 20921 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:23.902285 20928 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:23:23.904036 20916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:23.890233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56312 (local address 127.11.99.254:46645)
0809 09:23:23.890702 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:23.890722 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:23.890776 (+ 54us) server_negotiation.cc:407] Connection header received
0809 09:23:23.891596 (+ 820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:23.891613 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:23.891900 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:23.892159 (+ 259us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:23.893076 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:23.894053 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:23.895237 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:23.895666 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:23.895804 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:23.898679 (+ 2875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:23.898684 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:23.898694 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:23.898737 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:23.900766 (+ 2029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:23.901324 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:23.901332 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:23.901340 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:23.901492 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:23.901832 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:23.901835 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:23.901836 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:23.902410 (+ 574us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:23.902649 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:23.902872 (+ 223us) server_negotiation.cc:299] Negotiation successful
0809 09:23:23.903167 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":131,"threads_started":1}
I20260809 09:23:23.906782 20928 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:23:23.912338 20928 catalog_manager.cc:1347] Generated new cluster ID: e70ce20ea49b4c66bc29adbe2c3e58ac
I20260809 09:23:23.912437 20928 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:23:23.939482 20928 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:23:23.940376 20928 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:23:23.948087 20928 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd: Generated new TSK 0
I20260809 09:23:23.948668 20928 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.99.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
I20260809 09:23:23.981643 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:0
--local_ip_for_outbound_sockets=127.11.99.193
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:46645
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:42659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:24.088477 20941 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:24.088723 20941 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:24.088765 20941 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:24.092597 20941 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:24.092649 20941 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:24.092764 20941 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:23:24.097529 20941 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:42659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:46645
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20941
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:24.098472 20941 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:24.099475 20941 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:24.108805 20947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:24.108814 20949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:24.109030 20941 server_base.cc:1034] running on GCE node
W20260809 09:23:24.108992 20946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:24.109462 20941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:24.110100 20941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:24.111289 20941 hybrid_clock.cc:648] HybridClock initialized: now 1786267404111260 us; error 36 us; skew 500 ppm
Aug 09 09:23:24 dist-test-slave-pgkr krb5kdc[20826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267404, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:24.114085 20941 init.cc:377] Logged in from keytab as kudu/127.11.99.193@KRBTEST.COM (short username kudu)
I20260809 09:23:24.115042 20941 webserver.cc:460] Webserver started at http://127.11.99.193:37999/ using document root <none> and password file <none>
I20260809 09:23:24.115552 20941 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:24.115662 20941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:24.115895 20941 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:24.117882 20941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/data/instance:
uuid: "3da25a44da3743e4b2f4d4d38561d886"
format_stamp: "Formatted at 2026-08-09 09:23:24 on dist-test-slave-pgkr"
server_key: "f0bad1e8531d45e7e8371d7c6d1fd6de"
server_key_iv: "18977de4c6ed4fb8d98af15f40614c81"
server_key_version: "encryptionkey@0"
I20260809 09:23:24.118446 20941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance:
uuid: "3da25a44da3743e4b2f4d4d38561d886"
format_stamp: "Formatted at 2026-08-09 09:23:24 on dist-test-slave-pgkr"
server_key: "f0bad1e8531d45e7e8371d7c6d1fd6de"
server_key_iv: "18977de4c6ed4fb8d98af15f40614c81"
server_key_version: "encryptionkey@0"
I20260809 09:23:24.122069 20941 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 09:23:24.124523 20956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:24.125689 20941 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:23:24.125833 20941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "3da25a44da3743e4b2f4d4d38561d886"
format_stamp: "Formatted at 2026-08-09 09:23:24 on dist-test-slave-pgkr"
server_key: "f0bad1e8531d45e7e8371d7c6d1fd6de"
server_key_iv: "18977de4c6ed4fb8d98af15f40614c81"
server_key_version: "encryptionkey@0"
I20260809 09:23:24.125937 20941 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:24.139768 20941 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:24.142791 20941 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:24.142979 20941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:24.143509 20941 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:24.144306 20941 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:24.144376 20941 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:24.144448 20941 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:24.144492 20941 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:24.152858 20941 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:42315
I20260809 09:23:24.152891 21078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:42315 every 8 connection(s)
I20260809 09:23:24.153681 20941 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:23:24.157653 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 20941
I20260809 09:23:24.157747 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance
I20260809 09:23:24.158038 11663 external_mini_cluster.cc:1428] Setting key da90fbc279376fcdc21d37564735fcf4
Aug 09 09:23:24 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267404, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.99.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.194@KRBTEST.COM" created.
I20260809 09:23:24.171274 20916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:24.155353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:59693 (local address 127.11.99.254:46645)
0809 09:23:24.155493 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:24.155498 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:24.156449 (+ 951us) server_negotiation.cc:407] Connection header received
0809 09:23:24.157213 (+ 764us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:24.157215 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:24.157258 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:24.157329 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:24.158521 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:24.159302 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:24.160353 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:24.160694 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:24.160808 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:24.163653 (+ 2845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:24.163656 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:24.163658 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:24.163681 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:24.169130 (+ 5449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:24.169616 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:24.169621 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:24.169622 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:24.169705 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:24.170108 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:24.170110 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:24.170111 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:24.170323 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:24.170439 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:24.170973 (+ 534us) server_negotiation.cc:299] Negotiation successful
0809 09:23:24.171100 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 09:23:24.172031 21081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:24.155729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.193:59693)
0809 09:23:24.156319 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:24.156356 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:24.157049 (+ 693us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:24.157473 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:24.157479 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:24.157905 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:24.158379 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:24.158393 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:24.159411 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:24.159413 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:24.160225 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:24.160234 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:24.160841 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:24.160846 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:24.161053 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:24.161644 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:24.161685 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:24.163482 (+ 1797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:24.169246 (+ 5764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:24.169252 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:24.169264 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:24.169512 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:24.169819 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:24.169822 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:24.169823 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:24.170020 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:24.170436 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:24.170443 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:24.170744 (+ 301us) client_negotiation.cc:769] Sending connection context
0809 09:23:24.170919 (+ 175us) client_negotiation.cc:240] Negotiation successful
0809 09:23:24.171227 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":107,"threads_started":1}
I20260809 09:23:24.173332 21079 heartbeater.cc:347] Connected to a master server at 127.11.99.254:46645
I20260809 09:23:24.173573 21079 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:24.174127 21079 heartbeater.cc:511] Master 127.11.99.254:46645 requested a full tablet report, sending...
I20260809 09:23:24.175966 20875 ts_manager.cc:194] Registered new tserver with Master: 3da25a44da3743e4b2f4d4d38561d886 (127.11.99.193:42315)
I20260809 09:23:24.177685 20875 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.193@KRBTEST.COM'} at 127.11.99.193:59693
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
I20260809 09:23:24.186967 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:0
--local_ip_for_outbound_sockets=127.11.99.194
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:46645
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:42659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:24.290346 21085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:24.290560 21085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:24.290601 21085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:24.294327 21085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:24.294373 21085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:24.294421 21085 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:23:24.299234 21085 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:42659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:46645
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21085
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:24.300087 21085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:24.301045 21085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:24.310010 21090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:24.310010 21091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:24.310029 21093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:24.310344 21085 server_base.cc:1034] running on GCE node
I20260809 09:23:24.310717 21085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:24.311311 21085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:24.312466 21085 hybrid_clock.cc:648] HybridClock initialized: now 1786267404312448 us; error 30 us; skew 500 ppm
Aug 09 09:23:24 dist-test-slave-pgkr krb5kdc[20826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267404, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:24.315148 21085 init.cc:377] Logged in from keytab as kudu/127.11.99.194@KRBTEST.COM (short username kudu)
I20260809 09:23:24.315904 21085 webserver.cc:460] Webserver started at http://127.11.99.194:40885/ using document root <none> and password file <none>
I20260809 09:23:24.316409 21085 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:24.316466 21085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:24.316684 21085 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:24.318406 21085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/data/instance:
uuid: "8c31c5ad8bc3467a9ab4e1e70a579ecf"
format_stamp: "Formatted at 2026-08-09 09:23:24 on dist-test-slave-pgkr"
server_key: "38b5b7e98b22bf7c0f80a598e2bc24d4"
server_key_iv: "1713ebaeb0acda694404eb00493aa190"
server_key_version: "encryptionkey@0"
I20260809 09:23:24.319003 21085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance:
uuid: "8c31c5ad8bc3467a9ab4e1e70a579ecf"
format_stamp: "Formatted at 2026-08-09 09:23:24 on dist-test-slave-pgkr"
server_key: "38b5b7e98b22bf7c0f80a598e2bc24d4"
server_key_iv: "1713ebaeb0acda694404eb00493aa190"
server_key_version: "encryptionkey@0"
I20260809 09:23:24.322377 21085 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 09:23:24.324618 21100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:24.325670 21085 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 09:23:24.325763 21085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "8c31c5ad8bc3467a9ab4e1e70a579ecf"
format_stamp: "Formatted at 2026-08-09 09:23:24 on dist-test-slave-pgkr"
server_key: "38b5b7e98b22bf7c0f80a598e2bc24d4"
server_key_iv: "1713ebaeb0acda694404eb00493aa190"
server_key_version: "encryptionkey@0"
I20260809 09:23:24.325879 21085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:24.336927 21085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:24.339536 21085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:24.339718 21085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:24.340235 21085 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:24.340965 21085 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:24.341008 21085 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:24.341099 21085 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:24.341131 21085 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:24.349150 21085 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:35515
I20260809 09:23:24.349213 21221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:35515 every 8 connection(s)
I20260809 09:23:24.349947 21085 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:23:24.352753 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 21085
I20260809 09:23:24.352880 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance
I20260809 09:23:24.353152 11663 external_mini_cluster.cc:1428] Setting key 129f9dc3a108955625aa8fb2c8960efe
Aug 09 09:23:24 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267404, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.99.195@KRBTEST.COM; defaulting to no policy
I20260809 09:23:24.363705 20916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:24.351645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:53259 (local address 127.11.99.254:46645)
0809 09:23:24.351788 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:24.351792 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:24.352682 (+ 890us) server_negotiation.cc:407] Connection header received
0809 09:23:24.353655 (+ 973us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:24.353658 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:24.353717 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:24.353823 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:24.354932 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:24.355447 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:24.356664 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:24.356887 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:24.356994 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:24.359879 (+ 2885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:24.359882 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:24.359884 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:24.359955 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:24.361537 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:24.362107 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:24.362112 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:24.362114 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:24.362201 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:24.362540 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:24.362543 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:24.362545 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:24.362821 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:24.362922 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:24.363493 (+ 571us) server_negotiation.cc:299] Negotiation successful
0809 09:23:24.363594 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 09:23:24.364488 21224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:24.351933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.194:53259)
0809 09:23:24.352541 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:24.352577 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:24.353463 (+ 886us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:24.353982 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:24.353989 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:24.354305 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:24.354792 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:24.354805 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:24.355574 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:24.355583 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:24.356541 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:24.356551 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:24.357039 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:24.357042 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:24.357202 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:24.357848 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:24.357870 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:24.359706 (+ 1836us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:24.361664 (+ 1958us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:24.361669 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:24.361681 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:24.362008 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:24.362299 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:24.362303 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:24.362305 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:24.362442 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:24.362946 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:24.362952 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:24.363236 (+ 284us) client_negotiation.cc:769] Sending connection context
0809 09:23:24.363461 (+ 225us) client_negotiation.cc:240] Negotiation successful
0809 09:23:24.363723 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":109,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.195@KRBTEST.COM" created.
I20260809 09:23:24.365563 21222 heartbeater.cc:347] Connected to a master server at 127.11.99.254:46645
I20260809 09:23:24.365770 21222 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:24.366328 21222 heartbeater.cc:511] Master 127.11.99.254:46645 requested a full tablet report, sending...
I20260809 09:23:24.367413 20875 ts_manager.cc:194] Registered new tserver with Master: 8c31c5ad8bc3467a9ab4e1e70a579ecf (127.11.99.194:35515)
I20260809 09:23:24.367990 20875 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.194@KRBTEST.COM'} at 127.11.99.194:53259
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
I20260809 09:23:24.380959 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:0
--local_ip_for_outbound_sockets=127.11.99.195
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:46645
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:42659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:24.486451 21228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:24.486701 21228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:24.486778 21228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:24.490659 21228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:24.490707 21228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:24.490797 21228 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:23:24.495710 21228 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:42659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:46645
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21228
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:24.496618 21228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:24.497577 21228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:24.506631 21237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:24.506660 21235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:24.506721 21234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:24.506872 21228 server_base.cc:1034] running on GCE node
I20260809 09:23:24.507396 21228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:24.507999 21228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:24.509182 21228 hybrid_clock.cc:648] HybridClock initialized: now 1786267404509173 us; error 26 us; skew 500 ppm
Aug 09 09:23:24 dist-test-slave-pgkr krb5kdc[20826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267404, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:24.511910 21228 init.cc:377] Logged in from keytab as kudu/127.11.99.195@KRBTEST.COM (short username kudu)
I20260809 09:23:24.512694 21228 webserver.cc:460] Webserver started at http://127.11.99.195:44455/ using document root <none> and password file <none>
I20260809 09:23:24.513221 21228 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:24.513290 21228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:24.513521 21228 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:24.515498 21228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/data/instance:
uuid: "7eace5510f6a4f7bb05f1e63f979c338"
format_stamp: "Formatted at 2026-08-09 09:23:24 on dist-test-slave-pgkr"
server_key: "15ee791b1affa2b95b8cb5dc7dc401ab"
server_key_iv: "e69696cad0c59c12606cb636f11ddaf6"
server_key_version: "encryptionkey@0"
I20260809 09:23:24.516058 21228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance:
uuid: "7eace5510f6a4f7bb05f1e63f979c338"
format_stamp: "Formatted at 2026-08-09 09:23:24 on dist-test-slave-pgkr"
server_key: "15ee791b1affa2b95b8cb5dc7dc401ab"
server_key_iv: "e69696cad0c59c12606cb636f11ddaf6"
server_key_version: "encryptionkey@0"
I20260809 09:23:24.519353 21228 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 09:23:24.521539 21244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:24.522769 21228 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:23:24.522882 21228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "7eace5510f6a4f7bb05f1e63f979c338"
format_stamp: "Formatted at 2026-08-09 09:23:24 on dist-test-slave-pgkr"
server_key: "15ee791b1affa2b95b8cb5dc7dc401ab"
server_key_iv: "e69696cad0c59c12606cb636f11ddaf6"
server_key_version: "encryptionkey@0"
I20260809 09:23:24.522979 21228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:24.540474 21228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:24.543587 21228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:24.543787 21228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:24.544349 21228 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:24.545154 21228 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:24.545199 21228 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:24.545293 21228 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:24.545328 21228 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:24.553942 21228 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:41671
I20260809 09:23:24.553987 21368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:41671 every 8 connection(s)
I20260809 09:23:24.554777 21228 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:23:24.556967 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 21228
I20260809 09:23:24.557124 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance
I20260809 09:23:24.557458 11663 external_mini_cluster.cc:1428] Setting key 3fc4533130d5889371a69ff657ee2b81
Aug 09 09:23:24 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267404, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:23:24.567840 20916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:24.556449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:33369 (local address 127.11.99.254:46645)
0809 09:23:24.556613 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:24.556618 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:24.557722 (+ 1104us) server_negotiation.cc:407] Connection header received
0809 09:23:24.558786 (+ 1064us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:24.558789 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:24.558848 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:24.558915 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:24.560165 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:24.560704 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:24.561961 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:24.562187 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:24.562266 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:24.564684 (+ 2418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:24.564687 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:24.564689 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:24.564713 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:24.566154 (+ 1441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:24.566577 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:24.566579 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:24.566580 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:24.566709 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:24.566995 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:24.566997 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:24.566998 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:24.567171 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:24.567243 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:24.567652 (+ 409us) server_negotiation.cc:299] Negotiation successful
0809 09:23:24.567735 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 09:23:24.568513 21372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:24.556814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.195:33369)
0809 09:23:24.557568 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:24.557620 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:24.558559 (+ 939us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:24.559105 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:24.559111 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:24.559496 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:24.559994 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:24.560013 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:24.560817 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:24.560837 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:24.561841 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:24.561851 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:24.562310 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:24.562313 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:24.562433 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:24.562948 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:24.562963 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:24.564519 (+ 1556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:24.566253 (+ 1734us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:24.566257 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:24.566266 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:24.566484 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:24.566784 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:24.566790 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:24.566792 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:24.566919 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:24.567262 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:24.567267 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:24.567455 (+ 188us) client_negotiation.cc:769] Sending connection context
0809 09:23:24.567610 (+ 155us) client_negotiation.cc:240] Negotiation successful
0809 09:23:24.567815 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":100,"threads_started":1}
I20260809 09:23:24.569478 21369 heartbeater.cc:347] Connected to a master server at 127.11.99.254:46645
I20260809 09:23:24.569671 21369 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:24.570222 21369 heartbeater.cc:511] Master 127.11.99.254:46645 requested a full tablet report, sending...
I20260809 09:23:24.571285 20875 ts_manager.cc:194] Registered new tserver with Master: 7eace5510f6a4f7bb05f1e63f979c338 (127.11.99.195:41671)
I20260809 09:23:24.571813 20875 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.195@KRBTEST.COM'} at 127.11.99.195:33369
I20260809 09:23:24.582818 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.99.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.99.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.99.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.193.keytab.
Entry for principal oryx/127.11.99.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.193.keytab.
WARNING: no policy specified for oryx/127.11.99.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.99.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.99.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.194.keytab.
Entry for principal oryx/127.11.99.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.194.keytab.
WARNING: no policy specified for oryx/127.11.99.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.99.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.99.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.195.keytab.
Entry for principal oryx/127.11.99.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.195.keytab.
I20260809 09:23:24.649513 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 20941
I20260809 09:23:24.656816 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 21085
I20260809 09:23:24.663954 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 21228
I20260809 09:23:24.669746 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 20840
I20260809 09:23:24.676524 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:46645
--webserver_interface=127.11.99.254
--webserver_port=40199
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:42659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:46645
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:24.784188 21379 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:24.784426 21379 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:24.784466 21379 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:24.788589 21379 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:23:24.788647 21379 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:24.788666 21379 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:24.788682 21379 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:23:24.788719 21379 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:23:24.793716 21379 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:42659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:46645
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:46645
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=40199
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21379
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:24.794795 21379 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:24.795805 21379 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:24.803956 21385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:24.803964 21387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:24.804080 21379 server_base.cc:1034] running on GCE node
W20260809 09:23:24.803967 21384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:24.804787 21379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:24.805801 21379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:24.806954 21379 hybrid_clock.cc:648] HybridClock initialized: now 1786267404806919 us; error 48 us; skew 500 ppm
Aug 09 09:23:24 dist-test-slave-pgkr krb5kdc[20826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267404, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:24.809649 21379 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:23:24.810491 21379 webserver.cc:460] Webserver started at http://127.11.99.254:40199/ using document root <none> and password file <none>
I20260809 09:23:24.811074 21379 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:24.811154 21379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:24.814883 21379 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260809 09:23:24.816956 21394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:24.818105 21379 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:23:24.818257 21379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "e1b440a6f2b2443792d57dda898fa9cd"
format_stamp: "Formatted at 2026-08-09 09:23:23 on dist-test-slave-pgkr"
server_key: "86b2eb5d40d9ef85de1677501bebf4d2"
server_key_iv: "af1b267592b73a3a2559e115ab53e55c"
server_key_version: "encryptionkey@0"
I20260809 09:23:24.818820 21379 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:24.836889 21379 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:24.840081 21379 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:24.840289 21379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:24.847250 21379 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:46645
I20260809 09:23:24.847258 21449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:46645 every 8 connection(s)
I20260809 09:23:24.848251 21379 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:23:24.852329 21450 sys_catalog.cc:263] Verifying existing consensus state
I20260809 09:23:24.852562 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 21379
I20260809 09:23:24.853039 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:42315
--local_ip_for_outbound_sockets=127.11.99.193
--tserver_master_addrs=127.11.99.254:46645
--webserver_port=37999
--webserver_interface=127.11.99.193
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:42659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.99.193
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 09:23:24.854413 21450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd: Bootstrap starting.
I20260809 09:23:24.870486 21450 log.cc:824] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:24.877166 21450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 09:23:24.877566 21450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd: Bootstrap complete.
I20260809 09:23:24.881745 21450 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1b440a6f2b2443792d57dda898fa9cd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46645 } }
I20260809 09:23:24.882125 21450 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1b440a6f2b2443792d57dda898fa9cd, State: Initialized, Role: FOLLOWER
I20260809 09:23:24.882661 21450 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1b440a6f2b2443792d57dda898fa9cd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46645 } }
I20260809 09:23:24.882781 21450 raft_consensus.cc:388] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:23:24.882856 21450 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:23:24.882944 21450 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [term 1 FOLLOWER]: Advancing to term 2
I20260809 09:23:24.884789 21450 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1b440a6f2b2443792d57dda898fa9cd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46645 } }
I20260809 09:23:24.885143 21450 leader_election.cc:302] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e1b440a6f2b2443792d57dda898fa9cd; no voters:
I20260809 09:23:24.885494 21450 leader_election.cc:288] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 09:23:24.885695 21455 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [term 2 FOLLOWER]: Leader election won for term 2
I20260809 09:23:24.886019 21455 raft_consensus.cc:686] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [term 2 LEADER]: Becoming Leader. State: Replica: e1b440a6f2b2443792d57dda898fa9cd, State: Running, Role: LEADER
I20260809 09:23:24.886379 21455 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1b440a6f2b2443792d57dda898fa9cd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46645 } }
I20260809 09:23:24.886660 21450 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:23:24.887749 21456 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e1b440a6f2b2443792d57dda898fa9cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1b440a6f2b2443792d57dda898fa9cd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46645 } } }
I20260809 09:23:24.887915 21456 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:24.888605 21457 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1b440a6f2b2443792d57dda898fa9cd. Latest consensus state: current_term: 2 leader_uuid: "e1b440a6f2b2443792d57dda898fa9cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1b440a6f2b2443792d57dda898fa9cd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46645 } } }
I20260809 09:23:24.888721 21457 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:24.891057 21471 catalog_manager.cc:1259] Loaded cluster ID: e70ce20ea49b4c66bc29adbe2c3e58ac
I20260809 09:23:24.891119 21471 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd: loading cluster ID for follower catalog manager: success
I20260809 09:23:24.892726 21471 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd: acquiring CA information for follower catalog manager: success
I20260809 09:23:24.893713 21471 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 09:23:24.893848 21464 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:23:24.894863 21464 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:23:24.895330 21464 catalog_manager.cc:1259] Loaded cluster ID: e70ce20ea49b4c66bc29adbe2c3e58ac
I20260809 09:23:24.895396 21464 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:23:24.896046 21464 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:23:24.896504 21464 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e1b440a6f2b2443792d57dda898fa9cd: Loaded TSK: 0
I20260809 09:23:24.897248 21464 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 09:23:24.962477 21452 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:24.962745 21452 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:24.962838 21452 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:24.967226 21452 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:24.967285 21452 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:24.967396 21452 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:23:24.972537 21452 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:42659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.193.keytab
--principal=oryx/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:42315
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=37999
--tserver_master_addrs=127.11.99.254:46645
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21452
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:24.973451 21452 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:24.974462 21452 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:24.983853 21480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:24.983867 21481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:24.983938 21483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:24.984404 21452 server_base.cc:1034] running on GCE node
I20260809 09:23:24.984826 21452 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:24.985622 21452 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:24.986809 21452 hybrid_clock.cc:648] HybridClock initialized: now 1786267404986781 us; error 36 us; skew 500 ppm
Aug 09 09:23:24 dist-test-slave-pgkr krb5kdc[20826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267404, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:24.990056 21452 init.cc:377] Logged in from keytab as oryx/127.11.99.193@KRBTEST.COM (short username oryx)
I20260809 09:23:24.990952 21452 webserver.cc:460] Webserver started at http://127.11.99.193:37999/ using document root <none> and password file <none>
I20260809 09:23:24.991474 21452 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:24.991550 21452 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:24.995357 21452 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:23:24.997380 21490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:24.998534 21452 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 09:23:24.998672 21452 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "3da25a44da3743e4b2f4d4d38561d886"
format_stamp: "Formatted at 2026-08-09 09:23:24 on dist-test-slave-pgkr"
server_key: "f0bad1e8531d45e7e8371d7c6d1fd6de"
server_key_iv: "18977de4c6ed4fb8d98af15f40614c81"
server_key_version: "encryptionkey@0"
I20260809 09:23:24.999279 21452 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:25.020850 21452 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:25.024034 21452 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:25.024242 21452 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:25.024868 21452 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:25.025740 21452 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:25.025812 21452 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:25.025887 21452 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:25.025929 21452 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:25.035405 21452 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:42315
I20260809 09:23:25.035430 21615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:42315 every 8 connection(s)
I20260809 09:23:25.036445 21452 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:23:25.039780 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 21452
I20260809 09:23:25.040210 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:35515
--local_ip_for_outbound_sockets=127.11.99.194
--tserver_master_addrs=127.11.99.254:46645
--webserver_port=40885
--webserver_interface=127.11.99.194
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:42659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.99.194
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 09:23:25 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:25 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:25.049921 21619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:25.038717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.193:39045)
0809 09:23:25.039402 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:25.039451 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:25.040251 (+ 800us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:25.041437 (+ 1186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:25.041448 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:25.041996 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:25.042460 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:25.042473 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.044320 (+ 1847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.044323 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:25.045217 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:25.045228 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.046265 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.046268 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:25.046384 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:25.046985 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:25.047001 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:25.049244 (+ 2243us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":135,"threads_started":1}
W20260809 09:23:25.050436 21616 heartbeater.cc:644] Failed to heartbeat to 127.11.99.254:46645 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.99.254:46645: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
W20260809 09:23:25.050889 21618 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:25.038565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:39045 (local address 127.11.99.254:46645)
0809 09:23:25.039047 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:25.039072 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:25.040536 (+ 1464us) server_negotiation.cc:407] Connection header received
0809 09:23:25.040725 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:25.040733 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:25.041018 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:25.041277 (+ 259us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:25.042672 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.044190 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.045349 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.046122 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.046303 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:25.049537 (+ 3234us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.193:39045: BlockingRecv error: recv got EOF from 127.11.99.193:39045 (error 108)
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":122,"threads_started":1}
Aug 09 09:23:25 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:25 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:25.055804 21619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:25.050897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.193:40457)
0809 09:23:25.051224 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:25.051257 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:25.051339 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:25.051572 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:25.051575 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:25.051723 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:25.051811 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:25.051816 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.052517 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.052522 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:25.053022 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:25.053030 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.053470 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.053473 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:25.053566 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:25.054043 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:25.054053 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:25.055668 (+ 1615us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":262}
W20260809 09:23:25.056077 21618 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:25.050962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:40457 (local address 127.11.99.254:46645)
0809 09:23:25.051213 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:25.051218 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:25.051349 (+ 131us) server_negotiation.cc:407] Connection header received
0809 09:23:25.051426 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:25.051429 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:25.051471 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:25.051561 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:25.051922 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.052409 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.053139 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.053363 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.053468 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:25.055780 (+ 2312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.193:40457: BlockingRecv error: recv got EOF from 127.11.99.193:40457 (error 108)
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":103,"threads_started":1}
Aug 09 09:23:25 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:25 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:25.061089 21619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:25.056260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.193:34747)
0809 09:23:25.056401 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:25.056417 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:25.056497 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:25.056770 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:25.056773 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:25.056944 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:25.057040 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:25.057046 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.057662 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.057665 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:25.058420 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:25.058428 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.058874 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.058877 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:25.058952 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:25.059346 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:25.059358 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:25.060962 (+ 1604us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":54}
W20260809 09:23:25.061163 21618 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:25.056466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:34747 (local address 127.11.99.254:46645)
0809 09:23:25.056567 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:25.056570 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:25.056580 (+ 10us) server_negotiation.cc:407] Connection header received
0809 09:23:25.056608 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:25.056609 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:25.056638 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:25.056698 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:25.057160 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.057572 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.058519 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.058774 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.058845 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:25.061067 (+ 2222us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.193:34747: BlockingRecv error: recv got EOF from 127.11.99.193:34747 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260809 09:23:25.061337 21616 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 09:23:25.148602 21620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:25.148825 21620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:25.148864 21620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:25.152762 21620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:25.152812 21620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:25.152864 21620 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:23:25.157744 21620 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:42659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.194.keytab
--principal=oryx/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:35515
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=40885
--tserver_master_addrs=127.11.99.254:46645
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:25.158594 21620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:25.159649 21620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:25.168303 21627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:25.168329 21626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:25.168309 21629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:25.168560 21620 server_base.cc:1034] running on GCE node
I20260809 09:23:25.168927 21620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:25.169493 21620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:25.170686 21620 hybrid_clock.cc:648] HybridClock initialized: now 1786267405170637 us; error 36 us; skew 500 ppm
Aug 09 09:23:25 dist-test-slave-pgkr krb5kdc[20826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267405, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:25.173316 21620 init.cc:377] Logged in from keytab as oryx/127.11.99.194@KRBTEST.COM (short username oryx)
I20260809 09:23:25.174037 21620 webserver.cc:460] Webserver started at http://127.11.99.194:40885/ using document root <none> and password file <none>
I20260809 09:23:25.174527 21620 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:25.174597 21620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:25.178261 21620 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:23:25.180209 21636 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:25.181347 21620 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 09:23:25.181475 21620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "8c31c5ad8bc3467a9ab4e1e70a579ecf"
format_stamp: "Formatted at 2026-08-09 09:23:24 on dist-test-slave-pgkr"
server_key: "38b5b7e98b22bf7c0f80a598e2bc24d4"
server_key_iv: "1713ebaeb0acda694404eb00493aa190"
server_key_version: "encryptionkey@0"
I20260809 09:23:25.181993 21620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:25.195036 21620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:25.197976 21620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:25.198160 21620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:25.198745 21620 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:25.199507 21620 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:25.199560 21620 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:25.199638 21620 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:25.199673 21620 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:25.208771 21620 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:35515
I20260809 09:23:25.208801 21760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:35515 every 8 connection(s)
I20260809 09:23:25.209631 21620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:23:25.217367 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 21620
Aug 09 09:23:25 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:25.217787 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:41671
--local_ip_for_outbound_sockets=127.11.99.195
--tserver_master_addrs=127.11.99.254:46645
--webserver_port=44455
--webserver_interface=127.11.99.195
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:42659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.99.195
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 09:23:25 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 09:23:25.219835 21618 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:25.211225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:41919 (local address 127.11.99.254:46645)
0809 09:23:25.211375 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:25.211379 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:25.212392 (+ 1013us) server_negotiation.cc:407] Connection header received
0809 09:23:25.213169 (+ 777us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:25.213171 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:25.213220 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:25.213297 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:25.214300 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.214855 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.215907 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.216189 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.216340 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:25.219688 (+ 3348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.194:41919: BlockingRecv error: recv got EOF from 127.11.99.194:41919 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 09:23:25.220280 21763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:25.211613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.194:41919)
0809 09:23:25.212254 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:25.212294 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:25.213002 (+ 708us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:25.213458 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:25.213463 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:25.213768 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:25.214180 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:25.214193 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.214981 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.214984 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:25.215804 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:25.215813 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.216383 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.216387 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:25.216542 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:25.216970 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:25.216984 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:25.219533 (+ 2549us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":106,"threads_started":1}
W20260809 09:23:25.220795 21761 heartbeater.cc:644] Failed to heartbeat to 127.11.99.254:46645 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.99.254:46645: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Aug 09 09:23:25 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:25 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:25.226460 21763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:25.221182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.194:41951)
0809 09:23:25.221290 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:25.221303 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:25.221386 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:25.221630 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:25.221633 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:25.221785 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:25.221861 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:25.221866 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.222740 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.222744 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:25.223366 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:25.223375 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.223805 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.223809 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:25.223897 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:25.224421 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:25.224431 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:25.226323 (+ 1892us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 09:23:25.226770 21618 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:25.221309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:41951 (local address 127.11.99.254:46645)
0809 09:23:25.221447 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:25.221453 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:25.221471 (+ 18us) server_negotiation.cc:407] Connection header received
0809 09:23:25.221502 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:25.221504 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:25.221534 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:25.221616 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:25.222030 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.222573 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.223481 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.223699 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.223806 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:25.226436 (+ 2630us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.194:41951: BlockingRecv error: recv got EOF from 127.11.99.194:41951 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 09 09:23:25 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:25 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:25.232400 21763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:25.227039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.194:58735)
0809 09:23:25.227178 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:25.227197 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:25.227293 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:25.227613 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:25.227618 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:25.227800 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:25.227930 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:25.227939 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.228609 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.228616 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:25.229551 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:25.229565 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.229984 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.229990 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:25.230100 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:25.230506 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:25.230519 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:25.232288 (+ 1769us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":34}
W20260809 09:23:25.232517 21621 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:25.227133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:58735 (local address 127.11.99.254:46645)
0809 09:23:25.227230 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:25.227242 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:25.227263 (+ 21us) server_negotiation.cc:407] Connection header received
0809 09:23:25.227449 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:25.227451 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:25.227487 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:25.227561 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:25.228047 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.228502 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.229674 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.229871 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.229944 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:25.232394 (+ 2450us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.194:58735: BlockingRecv error: recv got EOF from 127.11.99.194:58735 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260809 09:23:25.232750 21761 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 09:23:25.328390 21764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:25.328646 21764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:25.328743 21764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:25.332532 21764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:25.332603 21764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:25.332682 21764 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:23:25.337473 21764 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:42659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/krb5kdc/oryx_127.11.99.195.keytab
--principal=oryx/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:41671
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=44455
--tserver_master_addrs=127.11.99.254:46645
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21764
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:25.338378 21764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:25.339309 21764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:25.348095 21769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:25.348109 21770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:25.348198 21764 server_base.cc:1034] running on GCE node
W20260809 09:23:25.348096 21772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:25.348753 21764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:25.349372 21764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:25.350545 21764 hybrid_clock.cc:648] HybridClock initialized: now 1786267405350519 us; error 38 us; skew 500 ppm
Aug 09 09:23:25 dist-test-slave-pgkr krb5kdc[20826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267405, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:25.353127 21764 init.cc:377] Logged in from keytab as oryx/127.11.99.195@KRBTEST.COM (short username oryx)
I20260809 09:23:25.353961 21764 webserver.cc:460] Webserver started at http://127.11.99.195:44455/ using document root <none> and password file <none>
I20260809 09:23:25.354466 21764 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:25.354583 21764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:25.357949 21764 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.002s
I20260809 09:23:25.359724 21779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:25.360698 21764 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 09:23:25.360895 21764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "7eace5510f6a4f7bb05f1e63f979c338"
format_stamp: "Formatted at 2026-08-09 09:23:24 on dist-test-slave-pgkr"
server_key: "15ee791b1affa2b95b8cb5dc7dc401ab"
server_key_iv: "e69696cad0c59c12606cb636f11ddaf6"
server_key_version: "encryptionkey@0"
I20260809 09:23:25.361573 21764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:25.381738 21764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:25.384357 21764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:25.384559 21764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:25.385126 21764 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:25.385942 21764 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:25.385998 21764 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:25.386034 21764 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:25.386047 21764 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:25.395160 21764 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:41671
I20260809 09:23:25.395216 21898 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:41671 every 8 connection(s)
I20260809 09:23:25.396062 21764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:23:25.405009 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 21764
Aug 09 09:23:25 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:25 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 09:23:25.408473 21621 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:25.397691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:45391 (local address 127.11.99.254:46645)
0809 09:23:25.397835 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:25.397838 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:25.399109 (+ 1271us) server_negotiation.cc:407] Connection header received
0809 09:23:25.400058 (+ 949us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:25.400062 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:25.400128 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:25.400243 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:25.401372 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.401890 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.403162 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.403385 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.403516 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:25.408355 (+ 4839us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.195:45391: BlockingRecv error: recv got EOF from 127.11.99.195:45391 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 09:23:25.408484 21902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:25.398088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.195:45391)
0809 09:23:25.398956 (+ 868us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:25.399000 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:25.399841 (+ 841us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:25.400408 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:25.400414 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:25.400781 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:25.401220 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:25.401233 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.402066 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.402069 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:25.403028 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:25.403038 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.403558 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.403563 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:25.403784 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:25.404457 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:25.404478 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:25.407564 (+ 3086us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":699,"thread_start_us":555,"threads_started":1}
W20260809 09:23:25.409011 21900 heartbeater.cc:644] Failed to heartbeat to 127.11.99.254:46645 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.99.254:46645: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Aug 09 09:23:25 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:25 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:25.417080 21902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:25.409451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.195:46541)
0809 09:23:25.409606 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:25.409620 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:25.409689 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:25.411176 (+ 1487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:25.411180 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:25.411366 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:25.411504 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:25.411513 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.412730 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.412738 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:25.413728 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:25.413743 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.414342 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.414346 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:25.414433 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:25.415104 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:25.415116 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:25.416981 (+ 1865us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":83}
W20260809 09:23:25.417759 21621 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:25.409499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:46541 (local address 127.11.99.254:46645)
0809 09:23:25.410857 (+ 1358us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:25.410864 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:25.410879 (+ 15us) server_negotiation.cc:407] Connection header received
0809 09:23:25.410918 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:25.410922 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:25.410964 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:25.411046 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:25.411668 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.412572 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.413848 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.414217 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.414341 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:25.417121 (+ 2780us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.195:46541: BlockingRecv error: recv got EOF from 127.11.99.195:46541 (error 108)
Metrics: {"server-negotiator.queue_time_us":1243}
I20260809 09:23:25.418112 21618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:25.407151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51246 (local address 127.11.99.254:46645)
0809 09:23:25.407307 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:25.407313 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:25.407330 (+ 17us) server_negotiation.cc:407] Connection header received
0809 09:23:25.407371 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:25.407375 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:25.407426 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:25.407519 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:25.408370 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.409833 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.411216 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.411459 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.411562 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:25.413366 (+ 1804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:25.413373 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:25.413390 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:25.413426 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:25.415792 (+ 2366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:25.416321 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:25.416330 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:25.416339 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:25.416492 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:25.416798 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:25.416800 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:25.416801 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:25.417205 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:25.417405 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:25.417671 (+ 266us) server_negotiation.cc:299] Negotiation successful
0809 09:23:25.417971 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Aug 09 09:23:25 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:25 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:25.422577 21902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:25.417586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.195:50687)
0809 09:23:25.418011 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:25.418024 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:25.418103 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:25.418376 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:25.418378 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:25.418528 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:25.418640 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:25.418647 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.419288 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.419291 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:25.420040 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:25.420049 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.420477 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.420481 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:25.420567 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:25.420986 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:25.420997 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:25.422503 (+ 1506us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":369}
W20260809 09:23:25.422796 21621 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:25.417678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:50687 (local address 127.11.99.254:46645)
0809 09:23:25.417933 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:25.417938 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:25.418090 (+ 152us) server_negotiation.cc:407] Connection header received
0809 09:23:25.418190 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:25.418194 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:25.418244 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:25.418336 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:25.418745 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.419186 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.420129 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:25.420371 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:25.420475 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:25.422653 (+ 2178us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.195:50687: BlockingRecv error: recv got EOF from 127.11.99.195:50687 (error 108)
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":59,"threads_started":1}
W20260809 09:23:25.422808 21900 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 09 09:23:26 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:26 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:26.067476 21908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:26.061965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.193:53271)
0809 09:23:26.062251 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:26.062265 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:26.062373 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:26.062677 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:26.062684 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:26.062868 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:26.062965 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:26.062970 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:26.063703 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:26.063705 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:26.064256 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:26.064263 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:26.064653 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:26.064656 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:26.064715 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:26.065339 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:26.065351 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:26.067296 (+ 1945us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":87,"threads_started":1}
W20260809 09:23:26.067535 21909 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:26.062044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:53271 (local address 127.11.99.254:46645)
0809 09:23:26.062308 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:26.062312 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:26.062326 (+ 14us) server_negotiation.cc:407] Connection header received
0809 09:23:26.062468 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:26.062470 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:26.062516 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:26.062646 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:26.063067 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:26.063598 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:26.064354 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:26.064560 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:26.064631 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:26.067414 (+ 2783us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.193:53271: BlockingRecv error: recv got EOF from 127.11.99.193:53271 (error 108)
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":79,"threads_started":1}
Aug 09 09:23:26 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:26 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:26.238490 21910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:26.233389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.194:59291)
0809 09:23:26.233652 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:26.233666 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:26.233765 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:26.234004 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:26.234006 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:26.234179 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:26.234275 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:26.234280 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:26.235044 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:26.235046 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:26.235599 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:26.235607 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:26.235999 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:26.236002 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:26.236060 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:26.236490 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:26.236500 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:26.238345 (+ 1845us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":75,"threads_started":1}
W20260809 09:23:26.238740 21909 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:26.233451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:59291 (local address 127.11.99.254:46645)
0809 09:23:26.233599 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:26.233602 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:26.233730 (+ 128us) server_negotiation.cc:407] Connection header received
0809 09:23:26.233844 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:26.233846 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:26.233888 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:26.233958 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:26.234368 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:26.234952 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:26.235698 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:26.235916 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:26.235984 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:26.238583 (+ 2599us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.194:59291: BlockingRecv error: recv got EOF from 127.11.99.194:59291 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 09 09:23:26 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:26 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:26.428411 21912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:26.423364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.195:60677)
0809 09:23:26.423628 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:26.423640 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:26.423737 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:26.423960 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:26.423962 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:26.424126 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:26.424245 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:26.424251 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:26.425003 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:26.425005 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:26.425579 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:26.425587 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:26.426011 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:26.426014 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:26.426081 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:26.426556 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:26.426567 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:26.428306 (+ 1739us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":107,"threads_started":1}
W20260809 09:23:26.428568 21909 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:26.423398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:60677 (local address 127.11.99.254:46645)
0809 09:23:26.423562 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:26.423567 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:26.423713 (+ 146us) server_negotiation.cc:407] Connection header received
0809 09:23:26.423817 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:26.423819 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:26.423865 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:26.423935 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:26.424346 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:26.424896 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:26.425685 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:26.425913 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:26.426003 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:26.428435 (+ 2432us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.195:60677: BlockingRecv error: recv got EOF from 127.11.99.195:60677 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 09 09:23:27 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:27 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:27.073550 21913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:27.068334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.193:52287)
0809 09:23:27.068617 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:27.068629 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:27.068720 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:27.068943 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:27.068944 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:27.069118 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:27.069205 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:27.069209 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:27.069892 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:27.069895 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:27.070558 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:27.070570 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:27.071078 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:27.071081 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:27.071154 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:27.071625 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:27.071636 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:27.073415 (+ 1779us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":99,"threads_started":1}
W20260809 09:23:27.073707 21914 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:27.068377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:52287 (local address 127.11.99.254:46645)
0809 09:23:27.068626 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:27.068629 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:27.068678 (+ 49us) server_negotiation.cc:407] Connection header received
0809 09:23:27.068797 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:27.068799 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:27.068838 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:27.068910 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:27.069290 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:27.069796 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:27.070736 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:27.070939 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:27.071068 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:27.073549 (+ 2481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.193:52287: BlockingRecv error: recv got EOF from 127.11.99.193:52287 (error 108)
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":66,"threads_started":1}
Aug 09 09:23:27 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:27 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:27.245115 21915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:27.239339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.194:51555)
0809 09:23:27.239675 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:27.239695 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:27.239825 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:27.240110 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:27.240113 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:27.240316 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:27.240408 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:27.240413 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:27.241180 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:27.241195 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:27.241747 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:27.241755 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:27.242208 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:27.242212 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:27.242297 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:27.242813 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:27.242823 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:27.244860 (+ 2037us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":79,"threads_started":1}
W20260809 09:23:27.245409 21914 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:27.239461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:51555 (local address 127.11.99.254:46645)
0809 09:23:27.239620 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:27.239624 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:27.239777 (+ 153us) server_negotiation.cc:407] Connection header received
0809 09:23:27.239929 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:27.239933 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:27.239984 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:27.240081 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:27.240525 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:27.241070 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:27.241866 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:27.242096 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:27.242206 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:27.245073 (+ 2867us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.194:51555: BlockingRecv error: recv got EOF from 127.11.99.194:51555 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 09 09:23:27 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:27 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:27.434495 21916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:27.429261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.195:49659)
0809 09:23:27.429528 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:27.429540 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:27.429629 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:27.429846 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:27.429848 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:27.430012 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:27.430104 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:27.430108 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:27.430831 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:27.430833 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:27.431385 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:27.431393 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:27.431830 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:27.431834 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:27.431896 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:27.432404 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:27.432415 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:27.434364 (+ 1949us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":98,"threads_started":1}
W20260809 09:23:27.434835 21914 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:27.429428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:49659 (local address 127.11.99.254:46645)
0809 09:23:27.429551 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:27.429554 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:27.429586 (+ 32us) server_negotiation.cc:407] Connection header received
0809 09:23:27.429703 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:27.429704 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:27.429753 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:27.429816 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:27.430190 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:27.430735 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:27.431486 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:27.431704 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:27.431800 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:27.434553 (+ 2753us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.195:49659: BlockingRecv error: recv got EOF from 127.11.99.195:49659 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 09 09:23:28 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:28 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:28.079346 21917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:28.074245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.193:34317)
0809 09:23:28.074508 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:28.074521 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:28.074633 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:28.074850 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:28.074852 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:28.075021 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:28.075112 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:28.075117 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:28.075774 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:28.075776 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:28.076275 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:28.076282 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:28.076681 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:28.076683 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:28.076747 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:28.077199 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:28.077209 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:28.079241 (+ 2032us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":89,"threads_started":1}
W20260809 09:23:28.079566 21918 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:28.074299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:34317 (local address 127.11.99.254:46645)
0809 09:23:28.074525 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:28.074528 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:28.074588 (+ 60us) server_negotiation.cc:407] Connection header received
0809 09:23:28.074706 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:28.074708 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:28.074747 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:28.074815 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:28.075199 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:28.075685 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:28.076368 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:28.076590 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:28.076663 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:28.079375 (+ 2712us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.193:34317: BlockingRecv error: recv got EOF from 127.11.99.193:34317 (error 108)
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":59,"threads_started":1}
Aug 09 09:23:28 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:28 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:28.251696 21919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:28.245847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.194:41677)
0809 09:23:28.246212 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:28.246230 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:28.246401 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:28.246746 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:28.246749 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:28.246962 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:28.247057 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:28.247063 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:28.247808 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:28.247813 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:28.248358 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:28.248366 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:28.248814 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:28.248817 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:28.248900 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:28.249430 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:28.249442 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:28.251529 (+ 2087us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":102,"threads_started":1}
W20260809 09:23:28.251732 21918 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:28.245975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:41677 (local address 127.11.99.254:46645)
0809 09:23:28.246188 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:28.246211 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:28.246335 (+ 124us) server_negotiation.cc:407] Connection header received
0809 09:23:28.246510 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:28.246513 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:28.246573 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:28.246725 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:28.247171 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:28.247699 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:28.248483 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:28.248699 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:28.248800 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:28.251639 (+ 2839us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.194:41677: BlockingRecv error: recv got EOF from 127.11.99.194:41677 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Aug 09 09:23:28 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:28 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:28.440392 21920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:28.435273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.195:41205)
0809 09:23:28.435657 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:28.435670 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:28.435769 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:28.435984 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:28.435986 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:28.436184 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:28.436287 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:28.436292 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:28.436969 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:28.436971 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:28.437533 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:28.437541 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:28.437928 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:28.437930 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:28.437989 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:28.438541 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:28.438553 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:28.440268 (+ 1715us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":210,"threads_started":1}
W20260809 09:23:28.440542 21918 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:28.435363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:41205 (local address 127.11.99.254:46645)
0809 09:23:28.435502 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:28.435513 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:28.435740 (+ 227us) server_negotiation.cc:407] Connection header received
0809 09:23:28.435835 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:28.435837 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:28.435881 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:28.435949 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:28.436385 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:28.436880 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:28.437628 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:28.437832 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:28.437904 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:28.440398 (+ 2494us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.195:41205: BlockingRecv error: recv got EOF from 127.11.99.195:41205 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 09 09:23:29 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:29 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:29.085150 21921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:29.080053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.193:33451)
0809 09:23:29.080336 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:29.080350 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:29.080449 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:29.080674 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:29.080676 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:29.080880 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:29.080971 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:29.080977 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:29.081691 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:29.081694 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:29.082243 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:29.082250 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:29.082690 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:29.082693 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:29.082757 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:29.083303 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:29.083315 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:29.085041 (+ 1726us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":85,"threads_started":1}
W20260809 09:23:29.085297 21922 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:29.080111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:33451 (local address 127.11.99.254:46645)
0809 09:23:29.080368 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:29.080371 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:29.080405 (+ 34us) server_negotiation.cc:407] Connection header received
0809 09:23:29.080508 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:29.080510 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:29.080547 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:29.080664 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:29.081069 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:29.081599 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:29.082337 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:29.082539 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:29.082673 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:29.085170 (+ 2497us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.193:33451: BlockingRecv error: recv got EOF from 127.11.99.193:33451 (error 108)
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":103,"threads_started":1}
Aug 09 09:23:29 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:29 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:29.262333 21923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:29.252442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.194:50995)
0809 09:23:29.252703 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:29.252718 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:29.252850 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:29.253134 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:29.253137 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:29.253330 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:29.253432 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:29.253438 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:29.254112 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:29.254117 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:29.254691 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:29.254702 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:29.255167 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:29.255169 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:29.255226 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:29.259936 (+ 4710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:29.259950 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:29.262163 (+ 2213us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":83,"threads_started":1}
W20260809 09:23:29.262394 21922 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:29.252497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:50995 (local address 127.11.99.254:46645)
0809 09:23:29.252657 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:29.252661 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:29.252796 (+ 135us) server_negotiation.cc:407] Connection header received
0809 09:23:29.252953 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:29.252956 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:29.253002 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:29.253102 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:29.253534 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:29.254008 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:29.254816 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:29.255076 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:29.255154 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:29.262291 (+ 7137us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.194:50995: BlockingRecv error: recv got EOF from 127.11.99.194:50995 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 09 09:23:29 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:29 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:29.447114 21924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:29.441374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.195:37775)
0809 09:23:29.441641 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:29.441660 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:29.441798 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:29.442122 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:29.442127 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:29.442404 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:29.442572 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:29.442580 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:29.443346 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:29.443348 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:29.443929 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:29.443937 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:29.444376 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:29.444379 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:29.444443 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:29.444950 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:29.444962 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:29.446998 (+ 2036us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":96,"threads_started":1}
W20260809 09:23:29.447204 21922 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:29.441415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:37775 (local address 127.11.99.254:46645)
0809 09:23:29.441600 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:29.441605 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:29.441748 (+ 143us) server_negotiation.cc:407] Connection header received
0809 09:23:29.441915 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:29.441921 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:29.441991 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:29.442065 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:29.442714 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:29.443251 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:29.444057 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:29.444267 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:29.444351 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:29.447115 (+ 2764us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.195:37775: BlockingRecv error: recv got EOF from 127.11.99.195:37775 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 09 09:23:30 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:30 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:30.091356 21925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:30.085886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.193:38481)
0809 09:23:30.086222 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:30.086236 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:30.086318 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:30.086562 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:30.086564 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:30.086800 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:30.086890 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:30.086896 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:30.087685 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:30.087687 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:30.088275 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:30.088283 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:30.088789 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:30.088792 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:30.088868 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:30.089385 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:30.089396 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:30.091249 (+ 1853us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":85,"threads_started":1}
W20260809 09:23:30.091526 21926 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:30.085956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:38481 (local address 127.11.99.254:46645)
0809 09:23:30.086246 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:30.086252 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:30.086293 (+ 41us) server_negotiation.cc:407] Connection header received
0809 09:23:30.086430 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:30.086433 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:30.086483 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:30.086553 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:30.087020 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:30.087598 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:30.088404 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:30.088678 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:30.088787 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:30.091357 (+ 2570us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.193:38481: BlockingRecv error: recv got EOF from 127.11.99.193:38481 (error 108)
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":73,"threads_started":1}
Aug 09 09:23:30 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:30 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:30.268543 21927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:30.263103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.194:58717)
0809 09:23:30.263439 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:30.263458 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:30.263573 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:30.263861 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:30.263864 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:30.264101 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:30.264194 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:30.264201 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:30.264943 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:30.264949 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:30.265572 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:30.265581 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:30.266046 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:30.266049 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:30.266127 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:30.266685 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:30.266698 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:30.268371 (+ 1673us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":119,"threads_started":1}
W20260809 09:23:30.268632 21926 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:30.263287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:58717 (local address 127.11.99.254:46645)
0809 09:23:30.263438 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:30.263444 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:30.263520 (+ 76us) server_negotiation.cc:407] Connection header received
0809 09:23:30.263685 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:30.263688 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:30.263736 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:30.263832 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:30.264315 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:30.264826 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:30.265694 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:30.265922 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:30.266050 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:30.268496 (+ 2446us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.194:58717: BlockingRecv error: recv got EOF from 127.11.99.194:58717 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 09 09:23:30 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:30 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:30.453104 21928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:30.448002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.195:59751)
0809 09:23:30.448285 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:30.448296 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:30.448411 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:30.448676 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:30.448678 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:30.448882 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:30.448967 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:30.448972 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:30.449670 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:30.449675 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:30.450211 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:30.450218 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:30.450657 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:30.450661 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:30.450741 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:30.451169 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:30.451179 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:30.452931 (+ 1752us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":91,"threads_started":1}
W20260809 09:23:30.453146 21926 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:30.448082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:59751 (local address 127.11.99.254:46645)
0809 09:23:30.448208 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:30.448212 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:30.448364 (+ 152us) server_negotiation.cc:407] Connection header received
0809 09:23:30.448509 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:30.448512 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:30.448576 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:30.448656 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:30.449078 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:30.449569 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:30.450320 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:30.450532 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:30.450645 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:30.453047 (+ 2402us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.195:59751: BlockingRecv error: recv got EOF from 127.11.99.195:59751 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 09 09:23:31 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:31 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:31.097786 21929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:31.092146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.193:57669)
0809 09:23:31.092450 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:31.092465 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:31.092551 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:31.092803 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:31.092805 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:31.092988 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:31.093079 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:31.093085 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:31.093861 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:31.093863 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:31.094575 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:31.094584 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:31.095196 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:31.095201 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:31.095306 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:31.095874 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:31.095885 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:31.097672 (+ 1787us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":92,"threads_started":1}
W20260809 09:23:31.097995 21930 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:31.092187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:57669 (local address 127.11.99.254:46645)
0809 09:23:31.092489 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:31.092493 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:31.092509 (+ 16us) server_negotiation.cc:407] Connection header received
0809 09:23:31.092641 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:31.092643 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:31.092688 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:31.092772 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:31.093179 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:31.093763 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:31.094701 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:31.095064 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:31.095173 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:31.097813 (+ 2640us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.193:57669: BlockingRecv error: recv got EOF from 127.11.99.193:57669 (error 108)
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":110,"threads_started":1}
Aug 09 09:23:31 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:31 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:31.274953 21931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:31.269314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.194:40729)
0809 09:23:31.269588 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:31.269602 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:31.269737 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:31.270012 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:31.270015 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:31.270236 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:31.270328 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:31.270334 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:31.271149 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:31.271155 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:31.271706 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:31.271713 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:31.272145 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:31.272148 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:31.272296 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:31.272850 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:31.272872 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:31.274788 (+ 1916us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":83,"threads_started":1}
W20260809 09:23:31.275012 21930 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:31.269375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:40729 (local address 127.11.99.254:46645)
0809 09:23:31.269542 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:31.269546 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:31.269686 (+ 140us) server_negotiation.cc:407] Connection header received
0809 09:23:31.269846 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:31.269850 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:31.269902 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:31.269986 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:31.270448 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:31.271039 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:31.271824 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:31.272039 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:31.272143 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:31.274907 (+ 2764us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.194:40729: BlockingRecv error: recv got EOF from 127.11.99.194:40729 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 09 09:23:31 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:31 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:31.463488 21932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:31.454010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.195:35133)
0809 09:23:31.454316 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:31.454329 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:31.454428 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:31.454657 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:31.454659 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:31.454836 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:31.454926 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:31.454930 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:31.455598 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:31.455600 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:31.456099 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:31.456105 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:31.456464 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:31.456466 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:31.456525 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:31.461458 (+ 4933us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:31.461470 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:31.463325 (+ 1855us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":136,"threads_started":1}
W20260809 09:23:31.463536 21930 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:31.454073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:35133 (local address 127.11.99.254:46645)
0809 09:23:31.454234 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:31.454239 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:31.454403 (+ 164us) server_negotiation.cc:407] Connection header received
0809 09:23:31.454506 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:31.454508 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:31.454565 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:31.454637 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:31.455015 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:31.455512 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:31.456187 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:31.456371 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:31.456439 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:31.463439 (+ 7000us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.195:35133: BlockingRecv error: recv got EOF from 127.11.99.195:35133 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 09 09:23:32 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:32 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:32.103915 21933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:32.098495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.193:51621)
0809 09:23:32.098836 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:32.098848 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:32.098941 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:32.099157 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:32.099159 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:32.099352 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:32.099443 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:32.099448 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:32.100190 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:32.100193 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:32.100699 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:32.100706 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:32.101066 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:32.101069 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:32.101141 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:32.101676 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:32.101687 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:32.103747 (+ 2060us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":110,"threads_started":1}
W20260809 09:23:32.103977 21934 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:32.098584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:51621 (local address 127.11.99.254:46645)
0809 09:23:32.098844 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:32.098847 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:32.098911 (+ 64us) server_negotiation.cc:407] Connection header received
0809 09:23:32.099011 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:32.099012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:32.099053 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:32.099126 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:32.099559 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:32.100095 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:32.100787 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:32.100978 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:32.101044 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:32.103861 (+ 2817us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.193:51621: BlockingRecv error: recv got EOF from 127.11.99.193:51621 (error 108)
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":105,"threads_started":1}
Aug 09 09:23:32 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:32 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:32.281275 21935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:32.275731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.194:57587)
0809 09:23:32.276044 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:32.276057 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:32.276156 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:32.276390 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:32.276392 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:32.276593 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:32.276687 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:32.276693 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:32.277387 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:32.277389 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:32.277958 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:32.277966 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:32.278479 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:32.278482 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:32.278566 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:32.279152 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:32.279164 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:32.281100 (+ 1936us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":102,"threads_started":1}
W20260809 09:23:32.281333 21934 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:32.275820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:57587 (local address 127.11.99.254:46645)
0809 09:23:32.275960 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:32.275963 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:32.276123 (+ 160us) server_negotiation.cc:407] Connection header received
0809 09:23:32.276238 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:32.276240 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:32.276283 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:32.276352 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:32.276780 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:32.277297 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:32.278083 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:32.278364 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:32.278444 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:32.281216 (+ 2772us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.194:57587: BlockingRecv error: recv got EOF from 127.11.99.194:57587 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 09 09:23:32 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:32 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:32.469556 21936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:32.464248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.195:33873)
0809 09:23:32.464575 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:32.464590 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:32.464693 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:32.464990 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:32.464993 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:32.465193 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:32.465291 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:32.465297 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:32.466113 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:32.466115 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:32.466727 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:32.466736 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:32.467108 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:32.467111 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:32.467166 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:32.467680 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:32.467691 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:32.469404 (+ 1713us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":106,"threads_started":1}
W20260809 09:23:32.469597 21934 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:32.464327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:33873 (local address 127.11.99.254:46645)
0809 09:23:32.464446 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:32.464449 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:32.464656 (+ 207us) server_negotiation.cc:407] Connection header received
0809 09:23:32.464772 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:32.464774 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:32.464847 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:32.464926 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:32.465394 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:32.466018 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:32.466824 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:32.467020 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:32.467091 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:32.469508 (+ 2417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.195:33873: BlockingRecv error: recv got EOF from 127.11.99.195:33873 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 09 09:23:33 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:33 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:33.109802 21937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:33.104685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.193:35067)
0809 09:23:33.104994 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:33.105009 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:33.105116 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:33.105364 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:33.105366 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:33.105568 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:33.105670 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:33.105677 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:33.106364 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:33.106367 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:33.106963 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:33.106973 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:33.107336 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:33.107338 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:33.107393 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:33.107843 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:33.107853 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:33.109595 (+ 1742us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":124,"threads_started":1}
W20260809 09:23:33.109872 21938 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:33.104805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:35067 (local address 127.11.99.254:46645)
0809 09:23:33.105019 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:33.105022 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:33.105080 (+ 58us) server_negotiation.cc:407] Connection header received
0809 09:23:33.105196 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:33.105198 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:33.105242 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:33.105317 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:33.105776 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:33.106249 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:33.107069 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:33.107253 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:33.107318 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:33.109748 (+ 2430us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.193:35067: BlockingRecv error: recv got EOF from 127.11.99.193:35067 (error 108)
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":77,"threads_started":1}
Aug 09 09:23:33 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:33 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:33.287422 21939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:33.282060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.194:54503)
0809 09:23:33.282307 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:33.282325 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:33.282417 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:33.282683 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:33.282685 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:33.282860 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:33.282956 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:33.282962 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:33.283802 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:33.283804 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:33.284335 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:33.284342 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:33.284720 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:33.284722 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:33.284779 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:33.285276 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:33.285287 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:33.287276 (+ 1989us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":90,"threads_started":1}
W20260809 09:23:33.287554 21938 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:33.282128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:54503 (local address 127.11.99.254:46645)
0809 09:23:33.282267 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:33.282270 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:33.282386 (+ 116us) server_negotiation.cc:407] Connection header received
0809 09:23:33.282482 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:33.282484 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:33.282526 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:33.282598 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:33.283067 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:33.283701 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:33.284427 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:33.284630 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:33.284704 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:33.287403 (+ 2699us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.194:54503: BlockingRecv error: recv got EOF from 127.11.99.194:54503 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 09 09:23:33 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:33 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:33.475653 21940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:33.470362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.195:42101)
0809 09:23:33.470683 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:33.470696 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:33.470821 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:33.471112 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:33.471114 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:33.471332 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:33.471422 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:33.471428 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:33.472164 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:33.472169 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:33.472733 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:33.472741 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:33.473183 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:33.473187 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:33.473271 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:33.473757 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:33.473767 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:33.475478 (+ 1711us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":80,"threads_started":1}
W20260809 09:23:33.475687 21938 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:33.470432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:42101 (local address 127.11.99.254:46645)
0809 09:23:33.470565 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:33.470570 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:33.470770 (+ 200us) server_negotiation.cc:407] Connection header received
0809 09:23:33.470941 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:33.470944 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:33.470987 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:33.471082 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:33.471539 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:33.472057 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:33.472852 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:33.473073 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:33.473181 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:33.475595 (+ 2414us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.195:42101: BlockingRecv error: recv got EOF from 127.11.99.195:42101 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 09 09:23:34 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:34 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:34.115833 21942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:34.110637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.193:37101)
0809 09:23:34.110946 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:34.110959 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:34.111050 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:34.111310 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:34.111312 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:34.111495 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:34.111605 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:34.111610 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:34.112318 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:34.112321 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:34.112879 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:34.112887 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:34.113283 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:34.113285 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:34.113347 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:34.113854 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:34.113865 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:34.115700 (+ 1835us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":82,"threads_started":1}
W20260809 09:23:34.115999 21943 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:34.110714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:37101 (local address 127.11.99.254:46645)
0809 09:23:34.110982 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:34.110986 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:34.111001 (+ 15us) server_negotiation.cc:407] Connection header received
0809 09:23:34.111142 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:34.111144 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:34.111187 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:34.111273 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:34.111700 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:34.112211 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:34.112976 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:34.113188 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:34.113271 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:34.115829 (+ 2558us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.193:37101: BlockingRecv error: recv got EOF from 127.11.99.193:37101 (error 108)
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":90,"threads_started":1}
Aug 09 09:23:34 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:34 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:34.298033 21944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:34.288228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.194:58687)
0809 09:23:34.288526 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:34.288541 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:34.288649 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:34.288964 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:34.288967 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:34.289219 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:34.289355 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:34.289363 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:34.290392 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:34.290395 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:34.290952 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:34.290961 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:34.291349 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:34.291351 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:34.291411 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:34.296006 (+ 4595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:34.296019 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:34.297900 (+ 1881us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":92,"threads_started":1}
W20260809 09:23:34.298100 21943 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:34.288273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:58687 (local address 127.11.99.254:46645)
0809 09:23:34.288403 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:34.288406 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:34.288606 (+ 200us) server_negotiation.cc:407] Connection header received
0809 09:23:34.288776 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:34.288791 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:34.288833 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:34.288900 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:34.289521 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:34.290273 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:34.291054 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:34.291252 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:34.291325 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:34.298015 (+ 6690us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.194:58687: BlockingRecv error: recv got EOF from 127.11.99.194:58687 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 09 09:23:34 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:34 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:34.481747 21945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:34.476414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.195:42647)
0809 09:23:34.476683 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:34.476695 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:34.476820 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:34.477066 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:34.477068 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:34.477269 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:34.477356 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:34.477361 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:34.478142 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:34.478148 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:34.478767 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:34.478776 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:34.479214 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:34.479218 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:34.479312 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:34.479813 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:34.479824 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:34.481573 (+ 1749us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":90,"threads_started":1}
W20260809 09:23:34.481820 21943 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:34.476462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:42647 (local address 127.11.99.254:46645)
0809 09:23:34.476613 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:34.476617 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:34.476764 (+ 147us) server_negotiation.cc:407] Connection header received
0809 09:23:34.476919 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:34.476922 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:34.476969 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:34.477043 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:34.477464 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:34.478029 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:34.478883 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:34.479102 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:34.479214 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:34.481685 (+ 2471us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.195:42647: BlockingRecv error: recv got EOF from 127.11.99.195:42647 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 09 09:23:35 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:35 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:35.121811 21946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:35.116707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.193:60667)
0809 09:23:35.116963 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:35.116976 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:35.117063 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:35.117331 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:35.117333 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:35.117508 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:35.117599 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:35.117604 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:35.118247 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:35.118249 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:35.118782 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:35.118790 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:35.119150 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:35.119152 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:35.119207 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:35.119703 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:35.119714 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:35.121650 (+ 1936us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":83,"threads_started":1}
W20260809 09:23:35.121897 21947 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:35.116754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:60667 (local address 127.11.99.254:46645)
0809 09:23:35.116971 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:35.116974 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:35.117040 (+ 66us) server_negotiation.cc:407] Connection header received
0809 09:23:35.117150 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:35.117151 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:35.117210 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:35.117285 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:35.117688 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:35.118161 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:35.118868 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:35.119062 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:35.119131 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:35.121777 (+ 2646us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.193:60667: BlockingRecv error: recv got EOF from 127.11.99.193:60667 (error 108)
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":80,"threads_started":1}
Aug 09 09:23:35 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:35 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:35.304069 21948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:35.298878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.194:55963)
0809 09:23:35.299131 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:35.299145 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:35.299236 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:35.299476 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:35.299478 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:35.299689 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:35.299798 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:35.299803 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:35.300495 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:35.300497 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:35.301028 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:35.301035 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:35.301421 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:35.301423 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:35.301484 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:35.301949 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:35.301960 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:35.303942 (+ 1982us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":68,"threads_started":1}
W20260809 09:23:35.304195 21947 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:35.299010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:55963 (local address 127.11.99.254:46645)
0809 09:23:35.299178 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:35.299181 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:35.299194 (+ 13us) server_negotiation.cc:407] Connection header received
0809 09:23:35.299324 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:35.299326 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:35.299367 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:35.299434 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:35.299904 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:35.300410 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:35.301128 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:35.301331 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:35.301402 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:35.304044 (+ 2642us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.194:55963: BlockingRecv error: recv got EOF from 127.11.99.194:55963 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 09 09:23:35 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:35 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:35.488224 21949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:35.482689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.195:57999)
0809 09:23:35.482958 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:35.482973 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:35.483076 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:35.483314 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:35.483316 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:35.483541 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:35.483640 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:35.483645 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:35.484326 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:35.484328 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:35.484937 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:35.484948 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:35.485380 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:35.485383 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:35.485449 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:35.486113 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:35.486127 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:35.488122 (+ 1995us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":96,"threads_started":1}
W20260809 09:23:35.488395 21947 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:35.482826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:57999 (local address 127.11.99.254:46645)
0809 09:23:35.482959 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:35.482963 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:35.483042 (+ 79us) server_negotiation.cc:407] Connection header received
0809 09:23:35.483156 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:35.483158 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:35.483201 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:35.483271 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:35.483738 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:35.484228 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:35.485035 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:35.485230 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:35.485305 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:35.488257 (+ 2952us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.195:57999: BlockingRecv error: recv got EOF from 127.11.99.195:57999 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 09 09:23:36 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:36 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:36.128008 21950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:36.122582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.193:49629)
0809 09:23:36.122903 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:36.122916 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:36.123019 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:36.123267 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:36.123269 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:36.123439 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:36.123533 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:36.123538 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:36.124410 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:36.124413 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:36.125116 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:36.125125 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:36.125561 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:36.125563 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:36.125618 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:36.126085 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:36.126095 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:36.127884 (+ 1789us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":121,"threads_started":1}
W20260809 09:23:36.128259 21951 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:36.122667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:49629 (local address 127.11.99.254:46645)
0809 09:23:36.122906 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:36.122909 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:36.122961 (+ 52us) server_negotiation.cc:407] Connection header received
0809 09:23:36.123095 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:36.123097 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:36.123137 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:36.123213 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:36.123642 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:36.124280 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:36.125218 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:36.125469 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:36.125547 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:36.128023 (+ 2476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.193:49629: BlockingRecv error: recv got EOF from 127.11.99.193:49629 (error 108)
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":79,"threads_started":1}
Aug 09 09:23:36 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:36 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:36.310925 21952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:36.305133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.194:34103)
0809 09:23:36.305421 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:36.305434 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:36.305576 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:36.305979 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:36.305990 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:36.306247 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:36.306348 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:36.306355 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:36.307201 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:36.307206 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:36.307769 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:36.307777 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:36.308230 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:36.308233 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:36.308317 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:36.308812 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:36.308824 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:36.310758 (+ 1934us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":85,"threads_started":1}
W20260809 09:23:36.310985 21951 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:36.305191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:34103 (local address 127.11.99.254:46645)
0809 09:23:36.305367 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:36.305371 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:36.305504 (+ 133us) server_negotiation.cc:407] Connection header received
0809 09:23:36.305673 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:36.305676 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:36.305728 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:36.305813 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:36.306467 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:36.307082 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:36.307890 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:36.308114 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:36.308216 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:36.310882 (+ 2666us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.194:34103: BlockingRecv error: recv got EOF from 127.11.99.194:34103 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 09 09:23:36 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:36 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:36.494531 21953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:36.488947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.195:50503)
0809 09:23:36.489222 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:36.489240 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:36.489337 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:36.489653 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:36.489656 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:36.489829 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:36.489951 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:36.489958 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:36.490943 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:36.490945 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:36.491453 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:36.491462 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:36.491876 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:36.491878 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:36.491951 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:36.492515 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:36.492527 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:36.494408 (+ 1881us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":107,"threads_started":1}
W20260809 09:23:36.494681 21951 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:36.489125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:50503 (local address 127.11.99.254:46645)
0809 09:23:36.489252 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:36.489255 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:36.489289 (+ 34us) server_negotiation.cc:407] Connection header received
0809 09:23:36.489427 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:36.489430 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:36.489505 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:36.489584 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:36.490087 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:36.490850 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:36.491579 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:36.491777 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:36.491859 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:36.494545 (+ 2686us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.195:50503: BlockingRecv error: recv got EOF from 127.11.99.195:50503 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 09 09:23:37 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:37 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:37.134189 21954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:37.128787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.193:37753)
0809 09:23:37.129081 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:37.129096 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:37.129186 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:37.129405 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:37.129407 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:37.129591 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:37.129686 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:37.129691 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:37.130400 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:37.130402 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:37.131024 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:37.131033 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:37.131428 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:37.131430 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:37.131487 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:37.131989 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:37.132000 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:37.134076 (+ 2076us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":87,"threads_started":1}
W20260809 09:23:37.134362 21955 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:37.128930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:37753 (local address 127.11.99.254:46645)
0809 09:23:37.129187 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:37.129190 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:37.129203 (+ 13us) server_negotiation.cc:407] Connection header received
0809 09:23:37.129256 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:37.129258 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:37.129298 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:37.129369 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:37.129804 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:37.130313 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:37.131131 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:37.131336 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:37.131410 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:37.134197 (+ 2787us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.193:37753: BlockingRecv error: recv got EOF from 127.11.99.193:37753 (error 108)
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":104,"threads_started":1}
Aug 09 09:23:37 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:37 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:37.317628 21956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:37.311742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.194:44037)
0809 09:23:37.312060 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:37.312073 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:37.312207 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:37.312501 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:37.312504 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:37.312729 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:37.312826 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:37.312832 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:37.313636 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:37.313642 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:37.314200 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:37.314209 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:37.314848 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:37.314852 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:37.314940 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:37.315594 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:37.315609 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:37.317519 (+ 1910us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":84,"threads_started":1}
W20260809 09:23:37.317757 21955 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:37.311858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:44037 (local address 127.11.99.254:46645)
0809 09:23:37.312017 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:37.312022 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:37.312142 (+ 120us) server_negotiation.cc:407] Connection header received
0809 09:23:37.312327 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:37.312330 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:37.312387 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:37.312474 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:37.312943 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:37.313512 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:37.314355 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:37.314714 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:37.314824 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:37.317642 (+ 2818us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.194:44037: BlockingRecv error: recv got EOF from 127.11.99.194:44037 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 09 09:23:37 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:37 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:37.500842 21958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:37.495485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.195:50839)
0809 09:23:37.495770 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:37.495787 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:37.495930 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:37.496228 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:37.496232 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:37.496422 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:37.496524 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:37.496529 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:37.497229 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:37.497232 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:37.497791 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:37.497798 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:37.498206 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:37.498209 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:37.498275 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:37.498826 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:37.498838 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:37.500723 (+ 1885us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":111,"threads_started":1}
W20260809 09:23:37.501024 21955 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:37.495549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:50839 (local address 127.11.99.254:46645)
0809 09:23:37.495691 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:37.495694 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:37.495888 (+ 194us) server_negotiation.cc:407] Connection header received
0809 09:23:37.496049 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:37.496051 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:37.496110 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:37.496197 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:37.496623 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:37.497138 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:37.497900 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:37.498111 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:37.498188 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:37.500857 (+ 2669us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.195:50839: BlockingRecv error: recv got EOF from 127.11.99.195:50839 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 09 09:23:38 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:38 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:38.139866 21959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:38.134935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.193:44377)
0809 09:23:38.135193 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:38.135206 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:38.135288 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:38.135514 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:38.135515 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:38.135715 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:38.135803 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:38.135807 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:38.136463 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:38.136465 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:38.137005 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:38.137013 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:38.137405 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:38.137407 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:38.137464 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:38.138005 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:38.138016 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:38.139745 (+ 1729us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":92,"threads_started":1}
W20260809 09:23:38.140025 21960 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:38.135075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:44377 (local address 127.11.99.254:46645)
0809 09:23:38.135320 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:38.135323 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:38.135335 (+ 12us) server_negotiation.cc:407] Connection header received
0809 09:23:38.135367 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:38.135369 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:38.135407 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:38.135503 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:38.135897 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:38.136372 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:38.137101 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:38.137292 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:38.137384 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:38.139878 (+ 2494us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.193:44377: BlockingRecv error: recv got EOF from 127.11.99.193:44377 (error 108)
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":94,"threads_started":1}
Aug 09 09:23:38 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:38 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:38.324352 21961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:38.318502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.194:58995)
0809 09:23:38.318832 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:38.318847 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:38.318982 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:38.319271 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:38.319275 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:38.319494 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:38.319585 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:38.319590 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:38.320303 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:38.320308 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:38.320829 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:38.320837 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:38.321268 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:38.321271 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:38.321351 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:38.321884 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:38.321904 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:38.324168 (+ 2264us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":134,"threads_started":1}
W20260809 09:23:38.324378 21960 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:38.318672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:58995 (local address 127.11.99.254:46645)
0809 09:23:38.318828 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:38.318832 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:38.318923 (+ 91us) server_negotiation.cc:407] Connection header received
0809 09:23:38.319083 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:38.319085 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:38.319135 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:38.319235 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:38.319693 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:38.320199 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:38.320942 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:38.321153 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:38.321258 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:38.324280 (+ 3022us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.194:58995: BlockingRecv error: recv got EOF from 127.11.99.194:58995 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 09 09:23:38 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:38 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:38.507539 21962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:38.501567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.195:55527)
0809 09:23:38.501870 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:38.501888 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:38.502002 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:38.502278 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:38.502280 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:38.502511 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:38.502666 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:38.502673 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:38.503509 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:38.503513 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:38.504326 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:38.504340 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:38.505007 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:38.505018 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:38.505124 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:38.505675 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:38.505686 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:38.507435 (+ 1749us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":90,"threads_started":1}
W20260809 09:23:38.507709 21960 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:38.501725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:55527 (local address 127.11.99.254:46645)
0809 09:23:38.501870 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:38.501875 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:38.501946 (+ 71us) server_negotiation.cc:407] Connection header received
0809 09:23:38.502130 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:38.502132 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:38.502175 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:38.502262 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:38.502794 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:38.503390 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:38.504477 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:38.504886 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:38.505005 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:38.507567 (+ 2562us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.195:55527: BlockingRecv error: recv got EOF from 127.11.99.195:55527 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 09 09:23:39 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:39 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:39.146368 21963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:39.140735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.193:56021)
0809 09:23:39.141160 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:39.141177 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:39.141280 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:39.141490 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:39.141492 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:39.141701 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:39.141790 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:39.141795 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:39.142540 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:39.142542 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:39.143300 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:39.143310 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:39.143739 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:39.143742 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:39.143798 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:39.144311 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:39.144323 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:39.146177 (+ 1854us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":129,"threads_started":1}
W20260809 09:23:39.146425 21964 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:39.140793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:56021 (local address 127.11.99.254:46645)
0809 09:23:39.141128 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:39.141132 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:39.141269 (+ 137us) server_negotiation.cc:407] Connection header received
0809 09:23:39.141360 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:39.141362 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:39.141406 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:39.141482 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:39.141903 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:39.142430 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:39.143411 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:39.143627 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:39.143707 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:39.146309 (+ 2602us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.193:56021: BlockingRecv error: recv got EOF from 127.11.99.193:56021 (error 108)
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":71,"threads_started":1}
Aug 09 09:23:39 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:39 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:39.335383 21965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:39.325159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.194:42429)
0809 09:23:39.325430 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:39.325442 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:39.325572 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:39.325839 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:39.325841 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:39.326068 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:39.326160 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:39.326165 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:39.326998 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:39.327003 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:39.327576 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:39.327585 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:39.328052 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:39.328055 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:39.328161 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:39.333053 (+ 4892us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:39.333070 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:39.335202 (+ 2132us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":85,"threads_started":1}
W20260809 09:23:39.335440 21964 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:39.325216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:42429 (local address 127.11.99.254:46645)
0809 09:23:39.325380 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:39.325384 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:39.325513 (+ 129us) server_negotiation.cc:407] Connection header received
0809 09:23:39.325666 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:39.325669 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:39.325723 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:39.325806 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:39.326281 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:39.326885 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:39.327700 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:39.327940 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:39.328040 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:39.335332 (+ 7292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.194:42429: BlockingRecv error: recv got EOF from 127.11.99.194:42429 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 09 09:23:39 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:39 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.195@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:39.513247 21966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:39.508270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.195:35589)
0809 09:23:39.508577 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:39.508590 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:39.508686 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:39.508952 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:39.508955 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:39.509151 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:39.509245 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:39.509250 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:39.509921 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:39.509923 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:39.510412 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:39.510419 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:39.510802 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:39.510804 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:39.510862 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:39.511324 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:39.511334 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:39.513136 (+ 1802us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":135,"threads_started":1}
W20260809 09:23:39.513370 21964 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:39.508353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:35589 (local address 127.11.99.254:46645)
0809 09:23:39.508483 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:39.508486 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:39.508655 (+ 169us) server_negotiation.cc:407] Connection header received
0809 09:23:39.508768 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:39.508770 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:39.508815 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:39.508883 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:39.509341 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:39.509830 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:39.510501 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:39.510709 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:39.510786 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:39.513257 (+ 2471us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.195:35589: BlockingRecv error: recv got EOF from 127.11.99.195:35589 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 09 09:23:40 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:40 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.193@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:40.152493 21967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:40.147291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.193:60615)
0809 09:23:40.147613 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:40.147627 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:40.147721 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:40.147936 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:40.147938 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:40.148108 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:40.148193 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:40.148198 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:40.148894 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:40.148896 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:40.149384 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:40.149391 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:40.149794 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:40.149797 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:40.149851 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:40.150440 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:40.150450 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:40.152385 (+ 1935us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":119,"threads_started":1}
W20260809 09:23:40.152683 21968 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:40.147418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:60615 (local address 127.11.99.254:46645)
0809 09:23:40.147654 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:40.147657 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:40.147672 (+ 15us) server_negotiation.cc:407] Connection header received
0809 09:23:40.147814 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:40.147816 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:40.147855 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:40.147925 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:40.148282 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:40.148807 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:40.149484 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:40.149701 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:40.149771 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:40.152555 (+ 2784us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.193:60615: BlockingRecv error: recv got EOF from 127.11.99.193:60615 (error 108)
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":62,"threads_started":1}
Aug 09 09:23:40 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 09:23:40 dist-test-slave-pgkr krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.99.194@KRBTEST.COM for oryx/127.11.99.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 09:23:40.341295 21969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:40.336218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46645 (local address 127.11.99.194:46183)
0809 09:23:40.336503 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:40.336516 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:40.336626 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:40.336853 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:40.336855 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:40.337041 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:40.337135 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:40.337140 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:40.337849 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:40.337851 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:40.338387 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:40.338394 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:40.338787 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:40.338789 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:40.338848 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:40.339335 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:40.339346 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:40.341181 (+ 1835us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.99.254:46645: Server oryx/127.11.99.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":95,"threads_started":1}
W20260809 09:23:40.341423 21968 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:40.336310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:46183 (local address 127.11.99.254:46645)
0809 09:23:40.336480 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:40.336483 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:40.336602 (+ 119us) server_negotiation.cc:407] Connection header received
0809 09:23:40.336695 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:40.336697 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:40.336745 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:40.336814 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:40.337234 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:40.337759 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:40.338481 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:40.338700 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:40.338780 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:40.341308 (+ 2528us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.99.194:46183: BlockingRecv error: recv got EOF from 127.11.99.194:46183 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 09:23:40.413236 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 21452
I20260809 09:23:40.421926 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 21620
I20260809 09:23:40.428524 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 21764
I20260809 09:23:40.435772 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 21379
2026-08-09T09:23:40Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17881 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-09T09:23:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:23:40Z Disabled control of system clock
I20260809 09:23:40.468868 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:43797
--webserver_interface=127.11.99.254
--webserver_port=0
--builtin_ntp_servers=127.11.99.212:46839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:43797
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 09:23:40.573961 21975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:40.574182 21975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:40.574213 21975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:40.577888 21975 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:23:40.577932 21975 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:40.577947 21975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:40.577963 21975 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:23:40.577977 21975 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:23:40.582067 21975 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:46839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:43797
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:43797
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21975
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:40.582970 21975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:40.584184 21975 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:40.592034 21983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:40.592028 21981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:40.592078 21980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:40.592101 21975 server_base.cc:1034] running on GCE node
I20260809 09:23:40.592927 21975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:40.594115 21975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:40.595301 21975 hybrid_clock.cc:648] HybridClock initialized: now 1786267420595283 us; error 31 us; skew 500 ppm
I20260809 09:23:40.597036 21975 webserver.cc:460] Webserver started at http://127.11.99.254:42089/ using document root <none> and password file <none>
I20260809 09:23:40.597530 21975 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:40.597599 21975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:40.597759 21975 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:40.599699 21975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "e5083fb73efe45b98f54e7e38aee5487"
format_stamp: "Formatted at 2026-08-09 09:23:40 on dist-test-slave-pgkr"
server_key: "d8afa4c9c53a4fefd3fff9f9e2780c2b"
server_key_iv: "606ede72dfe682e18a761ab3493aec4c"
server_key_version: "encryptionkey@0"
I20260809 09:23:40.600200 21975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "e5083fb73efe45b98f54e7e38aee5487"
format_stamp: "Formatted at 2026-08-09 09:23:40 on dist-test-slave-pgkr"
server_key: "d8afa4c9c53a4fefd3fff9f9e2780c2b"
server_key_iv: "606ede72dfe682e18a761ab3493aec4c"
server_key_version: "encryptionkey@0"
I20260809 09:23:40.604032 21975 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 09:23:40.606307 21989 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:40.607527 21975 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:23:40.607648 21975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "e5083fb73efe45b98f54e7e38aee5487"
format_stamp: "Formatted at 2026-08-09 09:23:40 on dist-test-slave-pgkr"
server_key: "d8afa4c9c53a4fefd3fff9f9e2780c2b"
server_key_iv: "606ede72dfe682e18a761ab3493aec4c"
server_key_version: "encryptionkey@0"
I20260809 09:23:40.607726 21975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:40.619174 21975 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:40.619746 21975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:40.619879 21975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:40.626448 21975 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:43797
I20260809 09:23:40.626454 22048 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:43797 every 8 connection(s)
I20260809 09:23:40.627406 21975 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:23:40.630376 22050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:40.633533 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 21975
I20260809 09:23:40.633628 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:23:40.633893 11663 external_mini_cluster.cc:1428] Setting key f2858ee3ef1065c5f9d5d3d3c8522601
I20260809 09:23:40.635862 22050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5083fb73efe45b98f54e7e38aee5487: Bootstrap starting.
I20260809 09:23:40.638159 22050 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e5083fb73efe45b98f54e7e38aee5487: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:40.638991 22050 log.cc:824] T 00000000000000000000000000000000 P e5083fb73efe45b98f54e7e38aee5487: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:40.640905 22050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5083fb73efe45b98f54e7e38aee5487: No bootstrap required, opened a new log
I20260809 09:23:40.642771 22053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:40.635339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45976 (local address 127.11.99.254:43797)
0809 09:23:40.635906 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:40.635921 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:40.635966 (+ 45us) server_negotiation.cc:407] Connection header received
0809 09:23:40.636656 (+ 690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:40.636672 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:40.637016 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:40.637277 (+ 261us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:40.637605 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:40.638562 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:40.639686 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:40.640105 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:40.640220 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:40.641052 (+ 832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:40.641057 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:40.641067 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:23:40.641458 (+ 391us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:40.641509 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:23:40.641528 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:40.641621 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:40.641787 (+ 166us) server_negotiation.cc:299] Negotiation successful
0809 09:23:40.642046 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":124,"threads_started":1}
I20260809 09:23:40.644452 22050 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5083fb73efe45b98f54e7e38aee5487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5083fb73efe45b98f54e7e38aee5487" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 43797 } }
I20260809 09:23:40.644701 22050 raft_consensus.cc:374] T 00000000000000000000000000000000 P e5083fb73efe45b98f54e7e38aee5487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:40.644776 22050 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5083fb73efe45b98f54e7e38aee5487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5083fb73efe45b98f54e7e38aee5487, State: Initialized, Role: FOLLOWER
I20260809 09:23:40.645124 22050 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5083fb73efe45b98f54e7e38aee5487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5083fb73efe45b98f54e7e38aee5487" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 43797 } }
I20260809 09:23:40.645242 22050 raft_consensus.cc:388] T 00000000000000000000000000000000 P e5083fb73efe45b98f54e7e38aee5487 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:23:40.645283 22050 raft_consensus.cc:482] T 00000000000000000000000000000000 P e5083fb73efe45b98f54e7e38aee5487 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:23:40.645345 22050 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5083fb73efe45b98f54e7e38aee5487 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:40.646162 22050 raft_consensus.cc:504] T 00000000000000000000000000000000 P e5083fb73efe45b98f54e7e38aee5487 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5083fb73efe45b98f54e7e38aee5487" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 43797 } }
I20260809 09:23:40.646431 22050 leader_election.cc:302] T 00000000000000000000000000000000 P e5083fb73efe45b98f54e7e38aee5487 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e5083fb73efe45b98f54e7e38aee5487; no voters:
I20260809 09:23:40.646785 22050 leader_election.cc:288] T 00000000000000000000000000000000 P e5083fb73efe45b98f54e7e38aee5487 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:23:40.647284 22057 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e5083fb73efe45b98f54e7e38aee5487 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:23:40.647805 22057 raft_consensus.cc:686] T 00000000000000000000000000000000 P e5083fb73efe45b98f54e7e38aee5487 [term 1 LEADER]: Becoming Leader. State: Replica: e5083fb73efe45b98f54e7e38aee5487, State: Running, Role: LEADER
I20260809 09:23:40.648005 22050 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5083fb73efe45b98f54e7e38aee5487 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:23:40.648181 22057 consensus_queue.cc:237] T 00000000000000000000000000000000 P e5083fb73efe45b98f54e7e38aee5487 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5083fb73efe45b98f54e7e38aee5487" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 43797 } }
I20260809 09:23:40.649858 22058 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5083fb73efe45b98f54e7e38aee5487 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5083fb73efe45b98f54e7e38aee5487. Latest consensus state: current_term: 1 leader_uuid: "e5083fb73efe45b98f54e7e38aee5487" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5083fb73efe45b98f54e7e38aee5487" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 43797 } } }
I20260809 09:23:40.649858 22056 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5083fb73efe45b98f54e7e38aee5487 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e5083fb73efe45b98f54e7e38aee5487" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5083fb73efe45b98f54e7e38aee5487" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 43797 } } }
I20260809 09:23:40.650000 22056 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5083fb73efe45b98f54e7e38aee5487 [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:40.650000 22058 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5083fb73efe45b98f54e7e38aee5487 [sys.catalog]: This master's current role is: LEADER
W20260809 09:23:40.652551 22071 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e5083fb73efe45b98f54e7e38aee5487: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 09:23:40.652614 22071 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 09:23:40.652694 22072 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:23:40.653385 22072 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:23:40.658231 22072 catalog_manager.cc:1347] Generated new cluster ID: 8f400b4835ad4f28ba3e78613fbf72ec
I20260809 09:23:40.658288 22072 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:23:40.673846 22072 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:23:40.674968 22072 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:23:40.682685 22072 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e5083fb73efe45b98f54e7e38aee5487: Generated new TSK 0
I20260809 09:23:40.683320 22072 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:23:40.687999 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:0
--local_ip_for_outbound_sockets=127.11.99.193
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:43797
--builtin_ntp_servers=127.11.99.212:46839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260809 09:23:40.804817 22076 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:40.805044 22076 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:40.805107 22076 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:40.809115 22076 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:40.809165 22076 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:40.809258 22076 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:23:40.813915 22076 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:46839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:43797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22076
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:40.814971 22076 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:40.816287 22076 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:40.825454 22085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:40.825479 22081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:40.825440 22083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:40.825838 22076 server_base.cc:1034] running on GCE node
I20260809 09:23:40.826198 22076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:40.826853 22076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:40.828034 22076 hybrid_clock.cc:648] HybridClock initialized: now 1786267420828026 us; error 26 us; skew 500 ppm
I20260809 09:23:40.829777 22076 webserver.cc:460] Webserver started at http://127.11.99.193:38969/ using document root <none> and password file <none>
I20260809 09:23:40.830343 22076 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:40.830435 22076 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:40.830730 22076 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:40.832715 22076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/data/instance:
uuid: "ef0c3b734c7e4cb2bc722a3f27250769"
format_stamp: "Formatted at 2026-08-09 09:23:40 on dist-test-slave-pgkr"
server_key: "e448a50ce900e52cf84dca7d53cb23ca"
server_key_iv: "2e8fc4303e6afc126f329660aeb86147"
server_key_version: "encryptionkey@0"
I20260809 09:23:40.833292 22076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance:
uuid: "ef0c3b734c7e4cb2bc722a3f27250769"
format_stamp: "Formatted at 2026-08-09 09:23:40 on dist-test-slave-pgkr"
server_key: "e448a50ce900e52cf84dca7d53cb23ca"
server_key_iv: "2e8fc4303e6afc126f329660aeb86147"
server_key_version: "encryptionkey@0"
I20260809 09:23:40.836882 22076 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:23:40.839238 22091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:40.840358 22076 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:23:40.840489 22076 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "ef0c3b734c7e4cb2bc722a3f27250769"
format_stamp: "Formatted at 2026-08-09 09:23:40 on dist-test-slave-pgkr"
server_key: "e448a50ce900e52cf84dca7d53cb23ca"
server_key_iv: "2e8fc4303e6afc126f329660aeb86147"
server_key_version: "encryptionkey@0"
I20260809 09:23:40.840595 22076 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:40.870744 22076 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:40.871433 22076 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:40.871631 22076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:40.872205 22076 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:40.873142 22076 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:40.873214 22076 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:40.873279 22076 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:40.873323 22076 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:40.883306 22076 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:40327
I20260809 09:23:40.883330 22215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:40327 every 8 connection(s)
I20260809 09:23:40.884229 22076 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:23:40.885272 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 22076
I20260809 09:23:40.885388 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance
I20260809 09:23:40.885722 11663 external_mini_cluster.cc:1428] Setting key ce628f26c32acf06d267e05779e109e0
I20260809 09:23:40.887648 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:0
--local_ip_for_outbound_sockets=127.11.99.194
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:43797
--builtin_ntp_servers=127.11.99.212:46839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 09:23:40.893432 22053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:40.885960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:34983 (local address 127.11.99.254:43797)
0809 09:23:40.886101 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:40.886104 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:40.887186 (+ 1082us) server_negotiation.cc:407] Connection header received
0809 09:23:40.888584 (+ 1398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:40.888590 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:40.888649 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:40.888742 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:40.889561 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:40.890348 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:40.891440 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:40.891697 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:40.891816 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:40.892915 (+ 1099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:40.892918 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:40.892921 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:23:40.892934 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:40.892963 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:23:40.892971 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:40.893067 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:40.893237 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 09:23:40.893295 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 09:23:40.894220 22218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:40.886391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:43797 (local address 127.11.99.193:34983)
0809 09:23:40.887045 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:40.887101 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:40.888370 (+ 1269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:40.888879 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:40.888885 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:40.888957 (+ 72us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:40.889429 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:40.889440 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:40.890455 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:40.890457 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:40.891315 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:40.891324 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:40.891845 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:40.891849 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:40.892023 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:40.892664 (+ 641us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 09:23:40.892666 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:40.892702 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 09:23:40.892760 (+ 58us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:40.893071 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:40.893082 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:40.893089 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 09:23:40.893223 (+ 134us) client_negotiation.cc:240] Negotiation successful
0809 09:23:40.893480 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":135,"threads_started":1}
I20260809 09:23:40.895604 22216 heartbeater.cc:347] Connected to a master server at 127.11.99.254:43797
I20260809 09:23:40.895831 22216 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:40.896317 22216 heartbeater.cc:511] Master 127.11.99.254:43797 requested a full tablet report, sending...
I20260809 09:23:40.898030 22010 ts_manager.cc:194] Registered new tserver with Master: ef0c3b734c7e4cb2bc722a3f27250769 (127.11.99.193:40327)
I20260809 09:23:40.899718 22010 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.99.193:34983
W20260809 09:23:40.993384 22219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:40.993587 22219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:40.993620 22219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:40.997200 22219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:40.997242 22219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:40.997287 22219 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:23:41.001263 22219 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:46839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:43797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22219
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:41.002094 22219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:41.003325 22219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:41.012584 22228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:41.012614 22225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:41.012643 22224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:41.012827 22219 server_base.cc:1034] running on GCE node
I20260809 09:23:41.013304 22219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:41.014000 22219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:41.015188 22219 hybrid_clock.cc:648] HybridClock initialized: now 1786267421015176 us; error 35 us; skew 500 ppm
I20260809 09:23:41.016846 22219 webserver.cc:460] Webserver started at http://127.11.99.194:43119/ using document root <none> and password file <none>
I20260809 09:23:41.017385 22219 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:41.017473 22219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:41.017700 22219 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:41.019677 22219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/data/instance:
uuid: "dbfd886f3c3c42b2b427dd6520119444"
format_stamp: "Formatted at 2026-08-09 09:23:41 on dist-test-slave-pgkr"
server_key: "c86bc02424d88102439fa2c9cd7eec13"
server_key_iv: "87f6baf09543b7e983a333ddb2705ca3"
server_key_version: "encryptionkey@0"
I20260809 09:23:41.020210 22219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance:
uuid: "dbfd886f3c3c42b2b427dd6520119444"
format_stamp: "Formatted at 2026-08-09 09:23:41 on dist-test-slave-pgkr"
server_key: "c86bc02424d88102439fa2c9cd7eec13"
server_key_iv: "87f6baf09543b7e983a333ddb2705ca3"
server_key_version: "encryptionkey@0"
I20260809 09:23:41.023674 22219 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 09:23:41.025952 22234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:41.027254 22219 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:23:41.027448 22219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "dbfd886f3c3c42b2b427dd6520119444"
format_stamp: "Formatted at 2026-08-09 09:23:41 on dist-test-slave-pgkr"
server_key: "c86bc02424d88102439fa2c9cd7eec13"
server_key_iv: "87f6baf09543b7e983a333ddb2705ca3"
server_key_version: "encryptionkey@0"
I20260809 09:23:41.027586 22219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:41.053603 22219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:41.054459 22219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:41.054754 22219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:41.055419 22219 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:41.056459 22219 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:41.056516 22219 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:41.056617 22219 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:41.056665 22219 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:41.067049 22219 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:36657
I20260809 09:23:41.067075 22355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:36657 every 8 connection(s)
I20260809 09:23:41.067976 22219 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:23:41.074762 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 22219
I20260809 09:23:41.074882 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance
I20260809 09:23:41.075140 11663 external_mini_cluster.cc:1428] Setting key e241ea0e0ef2ab2869b588e3e754c639
I20260809 09:23:41.076960 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:0
--local_ip_for_outbound_sockets=127.11.99.195
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:43797
--builtin_ntp_servers=127.11.99.212:46839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 09:23:41.077162 22053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:41.069799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:38753 (local address 127.11.99.254:43797)
0809 09:23:41.069936 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:41.069939 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:41.070985 (+ 1046us) server_negotiation.cc:407] Connection header received
0809 09:23:41.072407 (+ 1422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:41.072410 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:41.072471 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:41.072576 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:41.073423 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:41.073937 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:41.075178 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:41.075462 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:41.075577 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:41.076625 (+ 1048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:41.076628 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:41.076631 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:23:41.076642 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:41.076674 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:23:41.076682 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:41.076780 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:41.076963 (+ 183us) server_negotiation.cc:299] Negotiation successful
0809 09:23:41.077023 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 09:23:41.077958 22358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:41.070173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:43797 (local address 127.11.99.194:38753)
0809 09:23:41.070823 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:41.070860 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:41.072184 (+ 1324us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:41.072747 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:41.072755 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:41.072829 (+ 74us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:41.073265 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:41.073275 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:41.074068 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:41.074078 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:41.075060 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:41.075069 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:41.075612 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:41.075615 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:41.075786 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:41.076389 (+ 603us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 09:23:41.076390 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:41.076425 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 09:23:41.076479 (+ 54us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:41.076782 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:41.076794 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:41.076802 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 09:23:41.076961 (+ 159us) client_negotiation.cc:240] Negotiation successful
0809 09:23:41.077215 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":129,"threads_started":1}
I20260809 09:23:41.079150 22356 heartbeater.cc:347] Connected to a master server at 127.11.99.254:43797
I20260809 09:23:41.079373 22356 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:41.079833 22356 heartbeater.cc:511] Master 127.11.99.254:43797 requested a full tablet report, sending...
I20260809 09:23:41.080758 22010 ts_manager.cc:194] Registered new tserver with Master: dbfd886f3c3c42b2b427dd6520119444 (127.11.99.194:36657)
I20260809 09:23:41.081274 22010 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.99.194:38753
W20260809 09:23:41.182336 22359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:41.182639 22359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:41.182698 22359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:41.186306 22359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:41.186348 22359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:41.186407 22359 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:23:41.190593 22359 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:46839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:43797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22359
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:41.191442 22359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:41.192555 22359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:41.201267 22369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:41.201283 22366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:41.201283 22365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:41.201573 22359 server_base.cc:1034] running on GCE node
I20260809 09:23:41.201974 22359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:41.202562 22359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:41.203761 22359 hybrid_clock.cc:648] HybridClock initialized: now 1786267421203751 us; error 25 us; skew 500 ppm
I20260809 09:23:41.205648 22359 webserver.cc:460] Webserver started at http://127.11.99.195:43867/ using document root <none> and password file <none>
I20260809 09:23:41.206205 22359 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:41.206314 22359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:41.206542 22359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:41.208588 22359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/data/instance:
uuid: "d2cd5e6a39fe44ef8a6fe70e242346a9"
format_stamp: "Formatted at 2026-08-09 09:23:41 on dist-test-slave-pgkr"
server_key: "7d9eaea4c6e39b1a6b9b86d42d572d08"
server_key_iv: "b40ebeaad7946424e8536ebef19d5de2"
server_key_version: "encryptionkey@0"
I20260809 09:23:41.209172 22359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance:
uuid: "d2cd5e6a39fe44ef8a6fe70e242346a9"
format_stamp: "Formatted at 2026-08-09 09:23:41 on dist-test-slave-pgkr"
server_key: "7d9eaea4c6e39b1a6b9b86d42d572d08"
server_key_iv: "b40ebeaad7946424e8536ebef19d5de2"
server_key_version: "encryptionkey@0"
I20260809 09:23:41.212719 22359 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:23:41.215077 22375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:41.216171 22359 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:23:41.216296 22359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "d2cd5e6a39fe44ef8a6fe70e242346a9"
format_stamp: "Formatted at 2026-08-09 09:23:41 on dist-test-slave-pgkr"
server_key: "7d9eaea4c6e39b1a6b9b86d42d572d08"
server_key_iv: "b40ebeaad7946424e8536ebef19d5de2"
server_key_version: "encryptionkey@0"
I20260809 09:23:41.216398 22359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:41.226382 22359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:41.226972 22359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:41.227141 22359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:41.227627 22359 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:41.228417 22359 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:41.228485 22359 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:41.228559 22359 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:41.228593 22359 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:41.237370 22359 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:41017
I20260809 09:23:41.237393 22494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:41017 every 8 connection(s)
I20260809 09:23:41.238147 22359 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:23:41.243800 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 22359
I20260809 09:23:41.243956 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance
I20260809 09:23:41.244218 11663 external_mini_cluster.cc:1428] Setting key 57b4848eecc9b13041b1acfe077d0722
I20260809 09:23:41.247619 22053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:41.239773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:57091 (local address 127.11.99.254:43797)
0809 09:23:41.239904 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:41.239907 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:41.240781 (+ 874us) server_negotiation.cc:407] Connection header received
0809 09:23:41.242089 (+ 1308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:41.242092 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:41.242137 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:41.242213 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:41.243073 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:41.243667 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:41.245175 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:41.245541 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:41.245680 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:41.247009 (+ 1329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:41.247028 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:41.247033 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:23:41.247048 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:41.247072 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:23:41.247081 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:41.247175 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:41.247352 (+ 177us) server_negotiation.cc:299] Negotiation successful
0809 09:23:41.247432 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 09:23:41.248587 22497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:41.240077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:43797 (local address 127.11.99.195:57091)
0809 09:23:41.240669 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:41.240705 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:41.241907 (+ 1202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:41.242379 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:41.242384 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:41.242456 (+ 72us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:41.242922 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:41.242934 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:41.243809 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:41.243812 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:41.245066 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:41.245078 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:41.245721 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:41.245728 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:41.245945 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:41.246686 (+ 741us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 09:23:41.246690 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:41.246742 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 09:23:41.246822 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:41.247194 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:41.247205 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:41.247212 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 09:23:41.247343 (+ 131us) client_negotiation.cc:240] Negotiation successful
0809 09:23:41.247626 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":134,"threads_started":1}
I20260809 09:23:41.250936 22495 heartbeater.cc:347] Connected to a master server at 127.11.99.254:43797
I20260809 09:23:41.251183 22495 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:41.251760 22495 heartbeater.cc:511] Master 127.11.99.254:43797 requested a full tablet report, sending...
I20260809 09:23:41.252838 22010 ts_manager.cc:194] Registered new tserver with Master: d2cd5e6a39fe44ef8a6fe70e242346a9 (127.11.99.195:41017)
I20260809 09:23:41.253592 22010 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.99.195:57091
I20260809 09:23:41.258080 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 09:23:41.260774 22053 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:41.259857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45988 (local address 127.11.99.254:43797)
0809 09:23:41.259988 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:41.259991 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:41.260162 (+ 171us) server_negotiation.cc:407] Connection header received
0809 09:23:41.260333 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:41.260335 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:41.260380 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:41.260454 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:41.260676 (+ 222us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45988: BlockingRecv error: recv got EOF from 127.0.0.1:45988 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 09:23:41.261032 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 22076
I20260809 09:23:41.269495 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 22219
I20260809 09:23:41.275966 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 22359
I20260809 09:23:41.281824 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 21975
2026-08-09T09:23:41Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (843 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-09T09:23:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:23:41Z Disabled control of system clock
I20260809 09:23:41.311781 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:34991
--webserver_interface=127.11.99.254
--webserver_port=0
--builtin_ntp_servers=127.11.99.212:44735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:34991
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 09:23:41.416096 22506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:41.416355 22506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:41.416414 22506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:41.420871 22506 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:23:41.420922 22506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:41.420936 22506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:41.420950 22506 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:23:41.420982 22506 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:23:41.425364 22506 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:44735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:34991
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:34991
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22506
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:41.426283 22506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:41.427565 22506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:41.435597 22514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:41.435585 22512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:41.435586 22511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:41.435688 22506 server_base.cc:1034] running on GCE node
I20260809 09:23:41.436426 22506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:41.437407 22506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:41.438565 22506 hybrid_clock.cc:648] HybridClock initialized: now 1786267421438547 us; error 36 us; skew 500 ppm
I20260809 09:23:41.440433 22506 webserver.cc:460] Webserver started at http://127.11.99.254:44329/ using document root <none> and password file <none>
I20260809 09:23:41.440961 22506 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:41.441025 22506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:41.441277 22506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:41.443277 22506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "c3fd8a4a91be4682bc51529c676b8979"
format_stamp: "Formatted at 2026-08-09 09:23:41 on dist-test-slave-pgkr"
server_key: "6195950adf347be79bf14fed6e716168"
server_key_iv: "c1b3988fde0aceb8e6ae17db9e625b5c"
server_key_version: "encryptionkey@0"
I20260809 09:23:41.443797 22506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "c3fd8a4a91be4682bc51529c676b8979"
format_stamp: "Formatted at 2026-08-09 09:23:41 on dist-test-slave-pgkr"
server_key: "6195950adf347be79bf14fed6e716168"
server_key_iv: "c1b3988fde0aceb8e6ae17db9e625b5c"
server_key_version: "encryptionkey@0"
I20260809 09:23:41.447345 22506 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 09:23:41.449577 22521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:41.450739 22506 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:23:41.450857 22506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "c3fd8a4a91be4682bc51529c676b8979"
format_stamp: "Formatted at 2026-08-09 09:23:41 on dist-test-slave-pgkr"
server_key: "6195950adf347be79bf14fed6e716168"
server_key_iv: "c1b3988fde0aceb8e6ae17db9e625b5c"
server_key_version: "encryptionkey@0"
I20260809 09:23:41.450960 22506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:41.455432 22506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:41.456017 22506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:41.456223 22506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:41.463479 22506 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:34991
I20260809 09:23:41.463507 22579 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:34991 every 8 connection(s)
I20260809 09:23:41.464357 22506 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:23:41.466850 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 22506
I20260809 09:23:41.466967 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:23:41.467243 11663 external_mini_cluster.cc:1428] Setting key 4bbfbf20f51e51cdb1db65c7445b4b42
I20260809 09:23:41.467566 22580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:41.473022 22583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:41.468621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56586 (local address 127.11.99.254:34991)
0809 09:23:41.469263 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:41.469282 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:41.469321 (+ 39us) server_negotiation.cc:407] Connection header received
0809 09:23:41.470167 (+ 846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:41.470189 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:41.470622 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:41.470999 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:41.471655 (+ 656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:41.471660 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:41.471672 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:23:41.471682 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:41.471740 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:23:41.471759 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:41.471915 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:41.471975 (+ 60us) server_negotiation.cc:299] Negotiation successful
0809 09:23:41.472198 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":111,"threads_started":1}
I20260809 09:23:41.474375 22580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3fd8a4a91be4682bc51529c676b8979: Bootstrap starting.
I20260809 09:23:41.476315 22580 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3fd8a4a91be4682bc51529c676b8979: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:41.476984 22580 log.cc:824] T 00000000000000000000000000000000 P c3fd8a4a91be4682bc51529c676b8979: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:41.478659 22580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3fd8a4a91be4682bc51529c676b8979: No bootstrap required, opened a new log
I20260809 09:23:41.482290 22580 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3fd8a4a91be4682bc51529c676b8979 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3fd8a4a91be4682bc51529c676b8979" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34991 } }
I20260809 09:23:41.482486 22580 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3fd8a4a91be4682bc51529c676b8979 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:41.482560 22580 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3fd8a4a91be4682bc51529c676b8979 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3fd8a4a91be4682bc51529c676b8979, State: Initialized, Role: FOLLOWER
I20260809 09:23:41.482942 22580 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3fd8a4a91be4682bc51529c676b8979 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3fd8a4a91be4682bc51529c676b8979" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34991 } }
I20260809 09:23:41.483078 22580 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3fd8a4a91be4682bc51529c676b8979 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:23:41.483139 22580 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3fd8a4a91be4682bc51529c676b8979 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:23:41.483229 22580 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3fd8a4a91be4682bc51529c676b8979 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:41.483994 22580 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3fd8a4a91be4682bc51529c676b8979 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3fd8a4a91be4682bc51529c676b8979" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34991 } }
I20260809 09:23:41.484314 22580 leader_election.cc:302] T 00000000000000000000000000000000 P c3fd8a4a91be4682bc51529c676b8979 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3fd8a4a91be4682bc51529c676b8979; no voters:
I20260809 09:23:41.484591 22580 leader_election.cc:288] T 00000000000000000000000000000000 P c3fd8a4a91be4682bc51529c676b8979 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:23:41.484701 22586 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3fd8a4a91be4682bc51529c676b8979 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:23:41.484947 22586 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3fd8a4a91be4682bc51529c676b8979 [term 1 LEADER]: Becoming Leader. State: Replica: c3fd8a4a91be4682bc51529c676b8979, State: Running, Role: LEADER
I20260809 09:23:41.485220 22586 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3fd8a4a91be4682bc51529c676b8979 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3fd8a4a91be4682bc51529c676b8979" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34991 } }
I20260809 09:23:41.485698 22580 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3fd8a4a91be4682bc51529c676b8979 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:23:41.486822 22587 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3fd8a4a91be4682bc51529c676b8979 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3fd8a4a91be4682bc51529c676b8979" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3fd8a4a91be4682bc51529c676b8979" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34991 } } }
I20260809 09:23:41.486937 22587 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3fd8a4a91be4682bc51529c676b8979 [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:41.487401 22588 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3fd8a4a91be4682bc51529c676b8979 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3fd8a4a91be4682bc51529c676b8979. Latest consensus state: current_term: 1 leader_uuid: "c3fd8a4a91be4682bc51529c676b8979" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3fd8a4a91be4682bc51529c676b8979" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34991 } } }
I20260809 09:23:41.488111 22588 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3fd8a4a91be4682bc51529c676b8979 [sys.catalog]: This master's current role is: LEADER
W20260809 09:23:41.489956 22601 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c3fd8a4a91be4682bc51529c676b8979: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 09:23:41.490028 22601 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 09:23:41.490109 22595 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:23:41.490872 22595 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:23:41.495522 22595 catalog_manager.cc:1347] Generated new cluster ID: 4caa54211110444a864458b4af3b41c5
I20260809 09:23:41.495580 22595 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:23:41.509356 22595 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:23:41.509647 22595 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:23:41.519291 22595 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3fd8a4a91be4682bc51529c676b8979: Generated new TSK 0
I20260809 09:23:41.520009 22595 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:23:41.526989 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:0
--local_ip_for_outbound_sockets=127.11.99.193
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34991
--builtin_ntp_servers=127.11.99.212:44735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 09:23:41.630976 22605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:41.631212 22605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:41.631273 22605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:41.635385 22605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:41.635454 22605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:41.635537 22605 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:23:41.639978 22605 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:44735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34991
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22605
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:41.640842 22605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:41.641997 22605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:41.653345 22615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:41.653355 22612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:41.653337 22613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:41.653982 22605 server_base.cc:1034] running on GCE node
I20260809 09:23:41.654420 22605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:41.655059 22605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:41.656243 22605 hybrid_clock.cc:648] HybridClock initialized: now 1786267421656200 us; error 60 us; skew 500 ppm
I20260809 09:23:41.658587 22605 webserver.cc:460] Webserver started at http://127.11.99.193:40613/ using document root <none> and password file <none>
I20260809 09:23:41.659222 22605 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:41.659304 22605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:41.659507 22605 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:41.662070 22605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/data/instance:
uuid: "970cbde26886434e95a19b8b5ffc7452"
format_stamp: "Formatted at 2026-08-09 09:23:41 on dist-test-slave-pgkr"
server_key: "852a062452e1de9bbfeb35e70e144b31"
server_key_iv: "15092b0017b3f557a1eb1264be1292cd"
server_key_version: "encryptionkey@0"
I20260809 09:23:41.662756 22605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance:
uuid: "970cbde26886434e95a19b8b5ffc7452"
format_stamp: "Formatted at 2026-08-09 09:23:41 on dist-test-slave-pgkr"
server_key: "852a062452e1de9bbfeb35e70e144b31"
server_key_iv: "15092b0017b3f557a1eb1264be1292cd"
server_key_version: "encryptionkey@0"
I20260809 09:23:41.668076 22605 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 09:23:41.671510 22622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:41.673035 22605 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 09:23:41.673148 22605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "970cbde26886434e95a19b8b5ffc7452"
format_stamp: "Formatted at 2026-08-09 09:23:41 on dist-test-slave-pgkr"
server_key: "852a062452e1de9bbfeb35e70e144b31"
server_key_iv: "15092b0017b3f557a1eb1264be1292cd"
server_key_version: "encryptionkey@0"
I20260809 09:23:41.673290 22605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:41.679553 22605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:41.680358 22605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:41.680545 22605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:41.681257 22605 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:41.682403 22605 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:41.682471 22605 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:41.682536 22605 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:41.682567 22605 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:41.692914 22605 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:32973
I20260809 09:23:41.692937 22741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:32973 every 8 connection(s)
I20260809 09:23:41.693706 22605 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:23:41.699113 22583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:41.695483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:48163 (local address 127.11.99.254:34991)
0809 09:23:41.695640 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:41.695643 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:41.696566 (+ 923us) server_negotiation.cc:407] Connection header received
0809 09:23:41.697664 (+ 1098us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:41.697666 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:41.697701 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:41.697779 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:41.698737 (+ 958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:41.698740 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:41.698742 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:23:41.698753 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:41.698772 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:23:41.698781 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:41.698859 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:41.698979 (+ 120us) server_negotiation.cc:299] Negotiation successful
0809 09:23:41.699015 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 09:23:41.699870 22745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:41.695822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34991 (local address 127.11.99.193:48163)
0809 09:23:41.696427 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:41.696461 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:41.697501 (+ 1040us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:41.697913 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:41.697918 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:41.697990 (+ 72us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:41.698445 (+ 455us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 09:23:41.698446 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:41.698481 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 09:23:41.698539 (+ 58us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:41.698864 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:41.698870 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:41.698874 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 09:23:41.698992 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 09:23:41.699194 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":117,"threads_started":1}
I20260809 09:23:41.700975 22742 heartbeater.cc:347] Connected to a master server at 127.11.99.254:34991
I20260809 09:23:41.701179 22742 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:41.701522 22742 heartbeater.cc:511] Master 127.11.99.254:34991 requested a full tablet report, sending...
I20260809 09:23:41.702890 22541 ts_manager.cc:194] Registered new tserver with Master: 970cbde26886434e95a19b8b5ffc7452 (127.11.99.193:32973)
I20260809 09:23:41.703596 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 22605
I20260809 09:23:41.703702 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance
I20260809 09:23:41.704030 11663 external_mini_cluster.cc:1428] Setting key af002c0e78cbf4b195c11fcd243e611b
I20260809 09:23:41.705797 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:0
--local_ip_for_outbound_sockets=127.11.99.194
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34991
--builtin_ntp_servers=127.11.99.212:44735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 09:23:41.809510 22746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:41.809722 22746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:41.809799 22746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:41.813619 22746 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:41.813665 22746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:41.813752 22746 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:23:41.818099 22746 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:44735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34991
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22746
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:41.819046 22746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:41.820302 22746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:41.829391 22755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:41.829406 22753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:41.829423 22752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:41.829668 22746 server_base.cc:1034] running on GCE node
I20260809 09:23:41.830117 22746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:41.830811 22746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:41.831982 22746 hybrid_clock.cc:648] HybridClock initialized: now 1786267421831960 us; error 41 us; skew 500 ppm
I20260809 09:23:41.833717 22746 webserver.cc:460] Webserver started at http://127.11.99.194:44885/ using document root <none> and password file <none>
I20260809 09:23:41.834288 22746 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:41.834383 22746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:41.834700 22746 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:41.836658 22746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/data/instance:
uuid: "821bc11864d5465eb52df560ce47c1ff"
format_stamp: "Formatted at 2026-08-09 09:23:41 on dist-test-slave-pgkr"
server_key: "088de0e99d49f61ef6074827caacd604"
server_key_iv: "180c6d39157fd4209887d24e42f3e79b"
server_key_version: "encryptionkey@0"
I20260809 09:23:41.837201 22746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance:
uuid: "821bc11864d5465eb52df560ce47c1ff"
format_stamp: "Formatted at 2026-08-09 09:23:41 on dist-test-slave-pgkr"
server_key: "088de0e99d49f61ef6074827caacd604"
server_key_iv: "180c6d39157fd4209887d24e42f3e79b"
server_key_version: "encryptionkey@0"
I20260809 09:23:41.840852 22746 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20260809 09:23:41.843349 22761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:41.844458 22746 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 09:23:41.844588 22746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "821bc11864d5465eb52df560ce47c1ff"
format_stamp: "Formatted at 2026-08-09 09:23:41 on dist-test-slave-pgkr"
server_key: "088de0e99d49f61ef6074827caacd604"
server_key_iv: "180c6d39157fd4209887d24e42f3e79b"
server_key_version: "encryptionkey@0"
I20260809 09:23:41.844696 22746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:41.849006 22746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:41.849597 22746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:41.849781 22746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:41.850286 22746 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:41.851190 22746 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:41.851241 22746 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:41.851303 22746 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:41.851338 22746 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:41.859930 22746 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:34261
I20260809 09:23:41.859958 22880 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:34261 every 8 connection(s)
I20260809 09:23:41.860749 22746 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:23:41.861788 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 22746
I20260809 09:23:41.861909 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance
I20260809 09:23:41.862197 11663 external_mini_cluster.cc:1428] Setting key 22a7cac3b763dc34dc2d620de086fc2e
I20260809 09:23:41.864403 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:0
--local_ip_for_outbound_sockets=127.11.99.195
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34991
--builtin_ntp_servers=127.11.99.212:44735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 09:23:41.867756 22583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:41.862597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:34651 (local address 127.11.99.254:34991)
0809 09:23:41.862770 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:41.862777 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:41.864016 (+ 1239us) server_negotiation.cc:407] Connection header received
0809 09:23:41.865911 (+ 1895us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:41.865914 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:41.865967 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:41.866037 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:41.867268 (+ 1231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:41.867275 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:41.867280 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:23:41.867299 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:41.867332 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:23:41.867346 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:41.867448 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:41.867602 (+ 154us) server_negotiation.cc:299] Negotiation successful
0809 09:23:41.867643 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 09:23:41.868568 22884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:41.863051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34991 (local address 127.11.99.194:34651)
0809 09:23:41.863845 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:41.863892 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:41.865687 (+ 1795us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:41.866212 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:41.866223 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:41.866341 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:41.867012 (+ 671us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 09:23:41.867013 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:41.867051 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 09:23:41.867114 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:41.867441 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:41.867448 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:41.867452 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 09:23:41.867602 (+ 150us) client_negotiation.cc:240] Negotiation successful
0809 09:23:41.867789 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":146,"threads_started":1}
I20260809 09:23:41.869686 22881 heartbeater.cc:347] Connected to a master server at 127.11.99.254:34991
I20260809 09:23:41.869906 22881 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:41.870275 22881 heartbeater.cc:511] Master 127.11.99.254:34991 requested a full tablet report, sending...
I20260809 09:23:41.871302 22541 ts_manager.cc:194] Registered new tserver with Master: 821bc11864d5465eb52df560ce47c1ff (127.11.99.194:34261)
W20260809 09:23:41.972734 22885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:41.972999 22885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:41.973074 22885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:41.976923 22885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:41.976996 22885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:41.977085 22885 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:23:41.981631 22885 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:44735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34991
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:41.982543 22885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:41.983788 22885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:41.992887 22892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:41.992898 22891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:41.992916 22894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:41.993275 22885 server_base.cc:1034] running on GCE node
I20260809 09:23:41.993618 22885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:41.994217 22885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:41.995400 22885 hybrid_clock.cc:648] HybridClock initialized: now 1786267421995388 us; error 23 us; skew 500 ppm
I20260809 09:23:41.997108 22885 webserver.cc:460] Webserver started at http://127.11.99.195:36061/ using document root <none> and password file <none>
I20260809 09:23:41.997624 22885 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:41.997709 22885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:41.997925 22885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:41.999910 22885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/data/instance:
uuid: "d390a730e6eb4832be10231339f96b5a"
format_stamp: "Formatted at 2026-08-09 09:23:41 on dist-test-slave-pgkr"
server_key: "064f15a6839efefb3ea558557ef3d3e5"
server_key_iv: "e395b1c8667d2b47c420c0ac65e207e5"
server_key_version: "encryptionkey@0"
I20260809 09:23:42.000455 22885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance:
uuid: "d390a730e6eb4832be10231339f96b5a"
format_stamp: "Formatted at 2026-08-09 09:23:41 on dist-test-slave-pgkr"
server_key: "064f15a6839efefb3ea558557ef3d3e5"
server_key_iv: "e395b1c8667d2b47c420c0ac65e207e5"
server_key_version: "encryptionkey@0"
I20260809 09:23:42.003865 22885 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 09:23:42.006101 22900 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:42.007347 22885 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:23:42.007476 22885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "d390a730e6eb4832be10231339f96b5a"
format_stamp: "Formatted at 2026-08-09 09:23:41 on dist-test-slave-pgkr"
server_key: "064f15a6839efefb3ea558557ef3d3e5"
server_key_iv: "e395b1c8667d2b47c420c0ac65e207e5"
server_key_version: "encryptionkey@0"
I20260809 09:23:42.007588 22885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:42.012085 22885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:42.012655 22885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:42.012832 22885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:42.013341 22885 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:42.014178 22885 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:42.014245 22885 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:42.014312 22885 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:42.014364 22885 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:42.023171 22885 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:43137
I20260809 09:23:42.023242 23027 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:43137 every 8 connection(s)
I20260809 09:23:42.023998 22885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:23:42.029532 22583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:42.025668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:37505 (local address 127.11.99.254:34991)
0809 09:23:42.025800 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:42.025803 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:42.026903 (+ 1100us) server_negotiation.cc:407] Connection header received
0809 09:23:42.028102 (+ 1199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:42.028104 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:42.028141 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:42.028210 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:42.029222 (+ 1012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:42.029224 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:42.029231 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:23:42.029239 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:42.029253 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:23:42.029259 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:42.029319 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:42.029400 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 09:23:42.029434 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 09:23:42.030328 23030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:42.026098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34991 (local address 127.11.99.195:37505)
0809 09:23:42.026765 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:42.026803 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:42.027923 (+ 1120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:42.028322 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:42.028327 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:42.028400 (+ 73us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:42.029002 (+ 602us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 09:23:42.029004 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:42.029046 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 09:23:42.029107 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:42.029307 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:42.029311 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:42.029314 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 09:23:42.029416 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 09:23:42.029607 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":100,"threads_started":1}
I20260809 09:23:42.031469 23028 heartbeater.cc:347] Connected to a master server at 127.11.99.254:34991
I20260809 09:23:42.031684 23028 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:42.032047 23028 heartbeater.cc:511] Master 127.11.99.254:34991 requested a full tablet report, sending...
I20260809 09:23:42.032716 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 22885
I20260809 09:23:42.032823 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance
I20260809 09:23:42.033098 11663 external_mini_cluster.cc:1428] Setting key 2c653f8ca9b4d4d1148f727f54d9f9cf
I20260809 09:23:42.033097 22541 ts_manager.cc:194] Registered new tserver with Master: d390a730e6eb4832be10231339f96b5a (127.11.99.195:43137)
I20260809 09:23:42.035110 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 09:23:42.037874 22583 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:23:42.036946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56596 (local address 127.11.99.254:34991)
0809 09:23:42.037048 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:42.037051 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:42.037368 (+ 317us) server_negotiation.cc:407] Connection header received
0809 09:23:42.037455 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:42.037456 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:42.037482 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:42.037541 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:42.037795 (+ 254us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56596: BlockingRecv error: recv got EOF from 127.0.0.1:56596 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 09:23:42.038071 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 22605
I20260809 09:23:42.048199 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 22746
I20260809 09:23:42.054703 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 22885
I20260809 09:23:42.062567 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 22506
2026-08-09T09:23:42Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (781 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:23:42 dist-test-slave-pgkr krb5kdc[23041](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:23:42 dist-test-slave-pgkr krb5kdc[23041](info): set up 2 sockets
Aug 09 09:23:42 dist-test-slave-pgkr krb5kdc[23041](info): commencing operation
krb5kdc: starting...
W20260809 09:23:43.116212 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.032s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:23:43 dist-test-slave-pgkr krb5kdc[23041](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267423, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:23:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:23:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:23:43.232704 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:34029
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:43321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:34029
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:43.340271 23054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:43.340533 23054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:43.340633 23054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:43.344430 23054 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:23:43.344521 23054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:43.344563 23054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:43.344640 23054 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:23:43.344681 23054 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:23:43.349315 23054 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:43321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:34029
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:34029
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23054
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:43.350178 23054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:43.351097 23054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 09:23:43.358883 23054 server_base.cc:1034] running on GCE node
W20260809 09:23:43.358793 23063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:43.358803 23061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:43.358793 23060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:43.359540 23054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:43.360543 23054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:43.361696 23054 hybrid_clock.cc:648] HybridClock initialized: now 1786267423361683 us; error 41 us; skew 500 ppm
Aug 09 09:23:43 dist-test-slave-pgkr krb5kdc[23041](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267423, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:43.364348 23054 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:23:43.365145 23054 webserver.cc:460] Webserver started at http://127.11.99.254:38345/ using document root <none> and password file <none>
I20260809 09:23:43.365649 23054 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:43.365705 23054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:43.365917 23054 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:43.367954 23054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "2a05b0bc47194857b23ded1b70c07b41"
format_stamp: "Formatted at 2026-08-09 09:23:43 on dist-test-slave-pgkr"
server_key: "10df0330469cf47bb77341e69bbbc69e"
server_key_iv: "2c124a82f4c030e76736d834d67f464a"
server_key_version: "encryptionkey@0"
I20260809 09:23:43.368481 23054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "2a05b0bc47194857b23ded1b70c07b41"
format_stamp: "Formatted at 2026-08-09 09:23:43 on dist-test-slave-pgkr"
server_key: "10df0330469cf47bb77341e69bbbc69e"
server_key_iv: "2c124a82f4c030e76736d834d67f464a"
server_key_version: "encryptionkey@0"
I20260809 09:23:43.371979 23054 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 09:23:43.374269 23072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:43.375481 23054 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:23:43.375618 23054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "2a05b0bc47194857b23ded1b70c07b41"
format_stamp: "Formatted at 2026-08-09 09:23:43 on dist-test-slave-pgkr"
server_key: "10df0330469cf47bb77341e69bbbc69e"
server_key_iv: "2c124a82f4c030e76736d834d67f464a"
server_key_version: "encryptionkey@0"
I20260809 09:23:43.375722 23054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:43.385795 23054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:43.388414 23054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:43.388588 23054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:43.395068 23054 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:34029
I20260809 09:23:43.395357 23133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:34029 every 8 connection(s)
I20260809 09:23:43.395977 23054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:23:43.398336 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 23054
I20260809 09:23:43.398480 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:23:43.398780 23134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:43.398839 11663 external_mini_cluster.cc:1428] Setting key 3af5291a6cb6de519d596bccb191ecb4
I20260809 09:23:43.405555 23134 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a05b0bc47194857b23ded1b70c07b41: Bootstrap starting.
Aug 09 09:23:43 dist-test-slave-pgkr krb5kdc[23041](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267423, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:23:43.407837 23134 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a05b0bc47194857b23ded1b70c07b41: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:43.408636 23134 log.cc:824] T 00000000000000000000000000000000 P 2a05b0bc47194857b23ded1b70c07b41: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:43.410430 23134 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a05b0bc47194857b23ded1b70c07b41: No bootstrap required, opened a new log
I20260809 09:23:43.413160 23137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:43.400103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54400 (local address 127.11.99.254:34029)
0809 09:23:43.400494 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:43.400507 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:43.400540 (+ 33us) server_negotiation.cc:407] Connection header received
0809 09:23:43.401518 (+ 978us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:43.401540 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:43.401903 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:43.402230 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:43.402917 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:43.404389 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:43.405136 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:43.405735 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:43.405882 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:43.408440 (+ 2558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:43.408445 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:43.408456 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:43.408480 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:43.410140 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:43.410658 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:43.410664 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:43.410669 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:43.410807 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:43.411083 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:43.411086 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:43.411087 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:43.411537 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:43.411702 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:43.411911 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 09:23:43.412161 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":131,"threads_started":1}
I20260809 09:23:43.414755 23134 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a05b0bc47194857b23ded1b70c07b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a05b0bc47194857b23ded1b70c07b41" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34029 } }
I20260809 09:23:43.414958 23134 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a05b0bc47194857b23ded1b70c07b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:43.415019 23134 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a05b0bc47194857b23ded1b70c07b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a05b0bc47194857b23ded1b70c07b41, State: Initialized, Role: FOLLOWER
I20260809 09:23:43.415428 23134 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a05b0bc47194857b23ded1b70c07b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a05b0bc47194857b23ded1b70c07b41" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34029 } }
I20260809 09:23:43.415551 23134 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a05b0bc47194857b23ded1b70c07b41 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:23:43.415632 23134 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a05b0bc47194857b23ded1b70c07b41 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:23:43.415743 23134 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a05b0bc47194857b23ded1b70c07b41 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:43.416544 23134 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a05b0bc47194857b23ded1b70c07b41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a05b0bc47194857b23ded1b70c07b41" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34029 } }
I20260809 09:23:43.416842 23134 leader_election.cc:302] T 00000000000000000000000000000000 P 2a05b0bc47194857b23ded1b70c07b41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a05b0bc47194857b23ded1b70c07b41; no voters:
I20260809 09:23:43.417136 23134 leader_election.cc:288] T 00000000000000000000000000000000 P 2a05b0bc47194857b23ded1b70c07b41 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:23:43.417254 23140 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a05b0bc47194857b23ded1b70c07b41 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:23:43.417531 23140 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a05b0bc47194857b23ded1b70c07b41 [term 1 LEADER]: Becoming Leader. State: Replica: 2a05b0bc47194857b23ded1b70c07b41, State: Running, Role: LEADER
I20260809 09:23:43.417814 23140 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a05b0bc47194857b23ded1b70c07b41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a05b0bc47194857b23ded1b70c07b41" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34029 } }
I20260809 09:23:43.418188 23134 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a05b0bc47194857b23ded1b70c07b41 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:23:43.419365 23141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a05b0bc47194857b23ded1b70c07b41 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a05b0bc47194857b23ded1b70c07b41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a05b0bc47194857b23ded1b70c07b41" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34029 } } }
I20260809 09:23:43.419514 23141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a05b0bc47194857b23ded1b70c07b41 [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:43.419903 23151 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:23:43.419365 23142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a05b0bc47194857b23ded1b70c07b41 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a05b0bc47194857b23ded1b70c07b41. Latest consensus state: current_term: 1 leader_uuid: "2a05b0bc47194857b23ded1b70c07b41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a05b0bc47194857b23ded1b70c07b41" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34029 } } }
I20260809 09:23:43.420282 23142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a05b0bc47194857b23ded1b70c07b41 [sys.catalog]: This master's current role is: LEADER
I20260809 09:23:43.422917 23151 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:23:43.428277 23151 catalog_manager.cc:1347] Generated new cluster ID: ddd2ae9c962f41be99990a925e82d3f4
I20260809 09:23:43.428340 23151 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:23:43.441855 23151 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:23:43.442762 23151 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:23:43.449501 23151 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a05b0bc47194857b23ded1b70c07b41: Generated new TSK 0
I20260809 09:23:43.450098 23151 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.99.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
I20260809 09:23:43.483686 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:0
--local_ip_for_outbound_sockets=127.11.99.193
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34029
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:43321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:43.590590 23163 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:43.590888 23163 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:43.590968 23163 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:43.594889 23163 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:43.594969 23163 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:43.595055 23163 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:23:43.600216 23163 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:43321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23163
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:43.601231 23163 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:43.602209 23163 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:43.611374 23173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:43.611496 23170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:43.611732 23163 server_base.cc:1034] running on GCE node
W20260809 09:23:43.611456 23171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:43.612134 23163 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:43.612710 23163 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:43.613909 23163 hybrid_clock.cc:648] HybridClock initialized: now 1786267423613890 us; error 43 us; skew 500 ppm
Aug 09 09:23:43 dist-test-slave-pgkr krb5kdc[23041](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267423, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:43.616580 23163 init.cc:377] Logged in from keytab as kudu/127.11.99.193@KRBTEST.COM (short username kudu)
I20260809 09:23:43.617333 23163 webserver.cc:460] Webserver started at http://127.11.99.193:41845/ using document root <none> and password file <none>
I20260809 09:23:43.617846 23163 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:43.617902 23163 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:43.618063 23163 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:43.620095 23163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/data/instance:
uuid: "87aed8ccbee2480dbfe2a81638ac4015"
format_stamp: "Formatted at 2026-08-09 09:23:43 on dist-test-slave-pgkr"
server_key: "6e0347390cff5264d8670f571133d395"
server_key_iv: "4e09917e412cc9cde4412e04340e5e28"
server_key_version: "encryptionkey@0"
I20260809 09:23:43.620594 23163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance:
uuid: "87aed8ccbee2480dbfe2a81638ac4015"
format_stamp: "Formatted at 2026-08-09 09:23:43 on dist-test-slave-pgkr"
server_key: "6e0347390cff5264d8670f571133d395"
server_key_iv: "4e09917e412cc9cde4412e04340e5e28"
server_key_version: "encryptionkey@0"
I20260809 09:23:43.623970 23163 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 09:23:43.626098 23181 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:43.627403 23163 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:23:43.627547 23163 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "87aed8ccbee2480dbfe2a81638ac4015"
format_stamp: "Formatted at 2026-08-09 09:23:43 on dist-test-slave-pgkr"
server_key: "6e0347390cff5264d8670f571133d395"
server_key_iv: "4e09917e412cc9cde4412e04340e5e28"
server_key_version: "encryptionkey@0"
I20260809 09:23:43.627652 23163 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:43.637182 23163 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:43.639715 23163 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:43.639917 23163 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:43.640491 23163 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:43.641245 23163 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:43.641314 23163 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:43.641350 23163 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:43.641369 23163 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:43.650185 23163 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:39047
I20260809 09:23:43.650209 23307 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:39047 every 8 connection(s)
I20260809 09:23:43.651065 23163 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:23:43.659730 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 23163
I20260809 09:23:43.659835 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance
Aug 09 09:23:43 dist-test-slave-pgkr krb5kdc[23041](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267423, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:23:43.660122 11663 external_mini_cluster.cc:1428] Setting key 44296d1326d5784ef24d257d3b19f9bf
I20260809 09:23:43.664346 23137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:43.652792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:44443 (local address 127.11.99.254:34029)
0809 09:23:43.652921 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:43.652928 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:43.653608 (+ 680us) server_negotiation.cc:407] Connection header received
0809 09:23:43.655022 (+ 1414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:43.655026 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:43.655085 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:43.655192 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:43.656263 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:43.656749 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:43.657776 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:43.658012 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:43.658134 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:43.660578 (+ 2444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:43.660581 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:43.660584 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:43.660611 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:43.661998 (+ 1387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:43.662568 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:43.662571 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:43.662572 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:43.662685 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:43.663111 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:43.663115 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:43.663116 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:43.663298 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:43.663389 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:43.663992 (+ 603us) server_negotiation.cc:299] Negotiation successful
0809 09:23:43.664134 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 09:23:43.664848 23310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:43.653035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34029 (local address 127.11.99.193:44443)
0809 09:23:43.653458 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:43.653502 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:43.654822 (+ 1320us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:43.655341 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:43.655347 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:43.655683 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:43.656097 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:43.656110 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:43.656874 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:43.656879 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:43.657645 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:43.657654 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:43.658166 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:43.658170 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:43.658325 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:43.658815 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:43.658829 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:43.660376 (+ 1547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:43.662116 (+ 1740us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:43.662123 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:43.662136 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:43.662470 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:43.662794 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:43.662799 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:43.662804 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:43.662988 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:43.663408 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:43.663416 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:43.663706 (+ 290us) client_negotiation.cc:769] Sending connection context
0809 09:23:43.663895 (+ 189us) client_negotiation.cc:240] Negotiation successful
0809 09:23:43.664103 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":108,"threads_started":1}
I20260809 09:23:43.666006 23308 heartbeater.cc:347] Connected to a master server at 127.11.99.254:34029
I20260809 09:23:43.666251 23308 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:43.666775 23308 heartbeater.cc:511] Master 127.11.99.254:34029 requested a full tablet report, sending...
I20260809 09:23:43.668407 23094 ts_manager.cc:194] Registered new tserver with Master: 87aed8ccbee2480dbfe2a81638ac4015 (127.11.99.193:39047)
I20260809 09:23:43.670068 23094 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.193@KRBTEST.COM'} at 127.11.99.193:44443
WARNING: no policy specified for kudu/127.11.99.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
I20260809 09:23:43.688897 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:0
--local_ip_for_outbound_sockets=127.11.99.194
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34029
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:43321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:43.791926 23313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:43.792160 23313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:43.792200 23313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:43.795943 23313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:43.795995 23313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:43.796048 23313 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:23:43.800603 23313 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:43321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23313
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:43.801384 23313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:43.802165 23313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:43.810531 23319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:43.810585 23320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:43.810583 23322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:43.811007 23313 server_base.cc:1034] running on GCE node
I20260809 09:23:43.811439 23313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:43.812040 23313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:43.813228 23313 hybrid_clock.cc:648] HybridClock initialized: now 1786267423813198 us; error 40 us; skew 500 ppm
Aug 09 09:23:43 dist-test-slave-pgkr krb5kdc[23041](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267423, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:43.816044 23313 init.cc:377] Logged in from keytab as kudu/127.11.99.194@KRBTEST.COM (short username kudu)
I20260809 09:23:43.816932 23313 webserver.cc:460] Webserver started at http://127.11.99.194:46849/ using document root <none> and password file <none>
I20260809 09:23:43.817467 23313 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:43.817586 23313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:43.817824 23313 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:43.819980 23313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/data/instance:
uuid: "6cffa6d465aa4354bd4e66ee25fcb908"
format_stamp: "Formatted at 2026-08-09 09:23:43 on dist-test-slave-pgkr"
server_key: "9f2b363edd91fa14704a4c082c0643f7"
server_key_iv: "e7e80798a4aca6a7563bd363457fe0d9"
server_key_version: "encryptionkey@0"
I20260809 09:23:43.820574 23313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance:
uuid: "6cffa6d465aa4354bd4e66ee25fcb908"
format_stamp: "Formatted at 2026-08-09 09:23:43 on dist-test-slave-pgkr"
server_key: "9f2b363edd91fa14704a4c082c0643f7"
server_key_iv: "e7e80798a4aca6a7563bd363457fe0d9"
server_key_version: "encryptionkey@0"
I20260809 09:23:43.824438 23313 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260809 09:23:43.826785 23331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:43.827836 23313 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 09:23:43.827957 23313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "6cffa6d465aa4354bd4e66ee25fcb908"
format_stamp: "Formatted at 2026-08-09 09:23:43 on dist-test-slave-pgkr"
server_key: "9f2b363edd91fa14704a4c082c0643f7"
server_key_iv: "e7e80798a4aca6a7563bd363457fe0d9"
server_key_version: "encryptionkey@0"
I20260809 09:23:43.828083 23313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:43.837407 23313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:43.839957 23313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:43.840131 23313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:43.840610 23313 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:43.841301 23313 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:43.841364 23313 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:43.841423 23313 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:43.841464 23313 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:43.849606 23313 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:33619
I20260809 09:23:43.849627 23453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:33619 every 8 connection(s)
I20260809 09:23:43.850327 23313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:23:43.853940 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 23313
I20260809 09:23:43.854072 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance
I20260809 09:23:43.854331 11663 external_mini_cluster.cc:1428] Setting key b5011c14f7bbd03e5a606622062c69dd
Aug 09 09:23:43 dist-test-slave-pgkr krb5kdc[23041](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267423, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:23:43.864086 23137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:43.851890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:40471 (local address 127.11.99.254:34029)
0809 09:23:43.852023 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:43.852026 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:43.852714 (+ 688us) server_negotiation.cc:407] Connection header received
0809 09:23:43.854081 (+ 1367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:43.854084 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:43.854145 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:43.854259 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:43.855678 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:43.856217 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:43.857318 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:43.857562 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:43.857669 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:43.860452 (+ 2783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:43.860455 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:43.860456 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:43.860480 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:43.861874 (+ 1394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:43.862522 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:43.862525 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:43.862526 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:43.862594 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:43.863007 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:43.863009 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:43.863010 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:43.863197 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:43.863270 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:43.863881 (+ 611us) server_negotiation.cc:299] Negotiation successful
0809 09:23:43.863975 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
WARNING: no policy specified for kudu/127.11.99.195@KRBTEST.COM; defaulting to no policy
I20260809 09:23:43.865272 23456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:43.852178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34029 (local address 127.11.99.194:40471)
0809 09:23:43.852576 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:43.852613 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:43.853874 (+ 1261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:43.854436 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:43.854445 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:43.854944 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:43.855526 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:43.855546 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:43.856342 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:43.856347 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:43.857182 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:43.857191 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:43.857705 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:43.857709 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:43.857866 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:43.858410 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:43.858425 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:43.860292 (+ 1867us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:43.861990 (+ 1698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:43.861998 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:43.862015 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:43.862403 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:43.862715 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:43.862719 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:43.862721 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:43.862912 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:43.863300 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:43.863309 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:43.863625 (+ 316us) client_negotiation.cc:769] Sending connection context
0809 09:23:43.863848 (+ 223us) client_negotiation.cc:240] Negotiation successful
0809 09:23:43.864180 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":96,"threads_started":1}
I20260809 09:23:43.866415 23454 heartbeater.cc:347] Connected to a master server at 127.11.99.254:34029
I20260809 09:23:43.866706 23454 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:43.867197 23454 heartbeater.cc:511] Master 127.11.99.254:34029 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.195@KRBTEST.COM" created.
I20260809 09:23:43.868275 23094 ts_manager.cc:194] Registered new tserver with Master: 6cffa6d465aa4354bd4e66ee25fcb908 (127.11.99.194:33619)
I20260809 09:23:43.868841 23094 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.194@KRBTEST.COM'} at 127.11.99.194:40471
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
I20260809 09:23:43.881325 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:0
--local_ip_for_outbound_sockets=127.11.99.195
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34029
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:43321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:23:43.987330 23459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:23:43.987576 23459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:23:43.987661 23459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:23:43.991470 23459 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:23:43.991515 23459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:23:43.991611 23459 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:23:43.996271 23459 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:43321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23459
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:23:43.997110 23459 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:23:43.997988 23459 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:23:44.006680 23466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:44.006695 23465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:23:44.006721 23468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:23:44.006857 23459 server_base.cc:1034] running on GCE node
I20260809 09:23:44.007767 23459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:23:44.008313 23459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:23:44.009497 23459 hybrid_clock.cc:648] HybridClock initialized: now 1786267424009466 us; error 46 us; skew 500 ppm
Aug 09 09:23:44 dist-test-slave-pgkr krb5kdc[23041](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267424, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:23:44.012347 23459 init.cc:377] Logged in from keytab as kudu/127.11.99.195@KRBTEST.COM (short username kudu)
I20260809 09:23:44.013175 23459 webserver.cc:460] Webserver started at http://127.11.99.195:36361/ using document root <none> and password file <none>
I20260809 09:23:44.013844 23459 fs_manager.cc:359] Metadata directory not provided
I20260809 09:23:44.013943 23459 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:23:44.014181 23459 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:23:44.016299 23459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/data/instance:
uuid: "556e63d7d86b4fc5ad9c71e74c0bffbb"
format_stamp: "Formatted at 2026-08-09 09:23:44 on dist-test-slave-pgkr"
server_key: "12325defe31a413ed21957027755aaee"
server_key_iv: "de9926043b31f647c52ac988c3d7b067"
server_key_version: "encryptionkey@0"
I20260809 09:23:44.016911 23459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance:
uuid: "556e63d7d86b4fc5ad9c71e74c0bffbb"
format_stamp: "Formatted at 2026-08-09 09:23:44 on dist-test-slave-pgkr"
server_key: "12325defe31a413ed21957027755aaee"
server_key_iv: "de9926043b31f647c52ac988c3d7b067"
server_key_version: "encryptionkey@0"
I20260809 09:23:44.020824 23459 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260809 09:23:44.023180 23476 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:44.024325 23459 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:23:44.024456 23459 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "556e63d7d86b4fc5ad9c71e74c0bffbb"
format_stamp: "Formatted at 2026-08-09 09:23:44 on dist-test-slave-pgkr"
server_key: "12325defe31a413ed21957027755aaee"
server_key_iv: "de9926043b31f647c52ac988c3d7b067"
server_key_version: "encryptionkey@0"
I20260809 09:23:44.024571 23459 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:23:44.035286 23459 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:23:44.037810 23459 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:23:44.037988 23459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:23:44.038520 23459 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:23:44.039275 23459 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:23:44.039353 23459 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:44.039423 23459 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:23:44.039456 23459 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:23:44.047755 23459 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:37265
I20260809 09:23:44.047845 23603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:37265 every 8 connection(s)
I20260809 09:23:44.048588 23459 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:23:44.057230 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 23459
I20260809 09:23:44.057364 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance
Aug 09 09:23:44 dist-test-slave-pgkr krb5kdc[23041](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267424, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:23:44.057634 11663 external_mini_cluster.cc:1428] Setting key 381877c5c9306b14f8337d285d7f80c4
I20260809 09:23:44.061465 23137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:44.050223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:46037 (local address 127.11.99.254:34029)
0809 09:23:44.050349 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:44.050353 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:44.051079 (+ 726us) server_negotiation.cc:407] Connection header received
0809 09:23:44.052397 (+ 1318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:44.052400 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:44.052461 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:44.052565 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:44.053620 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.054136 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.055306 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.055532 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.055633 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:44.058176 (+ 2543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:44.058179 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:44.058182 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:44.058210 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:44.059886 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:44.060310 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:44.060312 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:44.060314 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:44.060384 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:44.060626 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:44.060628 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:44.060629 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:44.060788 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:44.060861 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:44.061267 (+ 406us) server_negotiation.cc:299] Negotiation successful
0809 09:23:44.061357 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 09:23:44.062206 23606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:44.050503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34029 (local address 127.11.99.195:46037)
0809 09:23:44.050929 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:44.050967 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:44.052177 (+ 1210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:44.052724 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:44.052730 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:44.053060 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:23:44.053478 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:44.053489 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.054268 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.054289 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:44.055177 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:44.055186 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.055677 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.055681 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:44.055832 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:44.056499 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:23:44.056516 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:23:44.058052 (+ 1536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:23:44.059976 (+ 1924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:44.059980 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:44.059989 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:44.060227 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:44.060442 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:23:44.060444 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:23:44.060445 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:23:44.060556 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:23:44.060873 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:23:44.060878 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:23:44.061081 (+ 203us) client_negotiation.cc:769] Sending connection context
0809 09:23:44.061223 (+ 142us) client_negotiation.cc:240] Negotiation successful
0809 09:23:44.061450 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":126,"threads_started":1}
I20260809 09:23:44.063265 23604 heartbeater.cc:347] Connected to a master server at 127.11.99.254:34029
I20260809 09:23:44.063481 23604 heartbeater.cc:464] Registering TS with master...
I20260809 09:23:44.063925 23604 heartbeater.cc:511] Master 127.11.99.254:34029 requested a full tablet report, sending...
I20260809 09:23:44.064899 23094 ts_manager.cc:194] Registered new tserver with Master: 556e63d7d86b4fc5ad9c71e74c0bffbb (127.11.99.195:37265)
I20260809 09:23:44.065412 23094 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.195@KRBTEST.COM'} at 127.11.99.195:46037
I20260809 09:23:44.071266 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 09:23:44.079582 23137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:44.073084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54414 (local address 127.11.99.254:34029)
0809 09:23:44.073210 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:44.073216 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:44.073397 (+ 181us) server_negotiation.cc:407] Connection header received
0809 09:23:44.073485 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:44.073487 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:44.073523 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:44.073581 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:23:44.074151 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.074658 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.075397 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.075595 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.075662 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:44.076747 (+ 1085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:23:44.076749 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:23:44.076751 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:23:44.076770 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:23:44.078139 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:44.078528 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:44.078531 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:44.078532 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:44.078600 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:23:44.078934 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:23:44.078937 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:23:44.078938 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:23:44.079137 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:23:44.079282 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:44.079384 (+ 102us) server_negotiation.cc:299] Negotiation successful
0809 09:23:44.079482 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 09:23:44.082057 23094 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54414:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 09:23:44.084910 23094 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:23:44.098543 23621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:44.093678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56872 (local address 127.11.99.194:33619)
0809 09:23:44.094079 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:44.094096 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:44.094115 (+ 19us) server_negotiation.cc:407] Connection header received
0809 09:23:44.094180 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:44.094184 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:44.094373 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:44.094508 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:44.094829 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.095534 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.097219 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.097799 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.097925 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:44.098068 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:44.098293 (+ 225us) server_negotiation.cc:299] Negotiation successful
0809 09:23:44.098396 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":95,"threads_started":1}
I20260809 09:23:44.098537 23616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:44.092653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:39047 (local address 127.0.0.1:48496)
0809 09:23:44.093455 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:44.093467 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:44.093559 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:44.094527 (+ 968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:44.094530 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:44.094547 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:44.094755 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:44.094760 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.096029 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.096033 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:44.097129 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:44.097139 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.097931 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.097934 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:44.098102 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:44.098143 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 09:23:44.098239 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 09:23:44.098386 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":730,"mutex_wait_us":81,"thread_start_us":92,"threads_started":1}
I20260809 09:23:44.098546 23620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:44.093245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:33619 (local address 127.0.0.1:56872)
0809 09:23:44.093741 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:44.093757 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:44.093846 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:44.094486 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:44.094488 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:44.094505 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:44.094709 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:44.094718 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.095659 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.095662 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:44.097095 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:44.097101 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.097925 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.097929 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:44.098091 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:44.098139 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 09:23:44.098248 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 09:23:44.098391 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434,"mutex_wait_us":259,"thread_start_us":77,"threads_started":1}
I20260809 09:23:44.099189 23618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:44.092868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48496 (local address 127.11.99.193:39047)
0809 09:23:44.093352 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:44.093364 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:44.093564 (+ 200us) server_negotiation.cc:407] Connection header received
0809 09:23:44.093994 (+ 430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:44.094000 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:44.094191 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:44.094357 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:44.094900 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.095910 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.097254 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.097805 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.097924 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:44.098074 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:44.098931 (+ 857us) server_negotiation.cc:299] Negotiation successful
0809 09:23:44.099043 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":142,"threads_started":1}
I20260809 09:23:44.099479 23617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:44.092588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:37265 (local address 127.0.0.1:51704)
0809 09:23:44.093021 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:44.093095 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:44.093236 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:44.094297 (+ 1061us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:44.094303 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:44.094342 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:44.094472 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:44.094479 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.095866 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.095869 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:44.097091 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:44.097101 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.099087 (+ 1986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.099091 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:44.099172 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:44.099198 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 09:23:44.099266 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 09:23:44.099358 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"mutex_wait_us":67,"thread_start_us":65,"threads_started":1}
I20260809 09:23:44.100232 23619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:44.093210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51704 (local address 127.11.99.195:37265)
0809 09:23:44.093804 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:44.093816 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:44.093838 (+ 22us) server_negotiation.cc:407] Connection header received
0809 09:23:44.093905 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:44.093910 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:44.094111 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:44.094306 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:44.094599 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.095741 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.098132 (+ 2391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.098957 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.099854 (+ 897us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:44.099993 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:44.100049 (+ 56us) server_negotiation.cc:299] Negotiation successful
0809 09:23:44.100113 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":500,"thread_start_us":94,"threads_started":1}
I20260809 09:23:44.101788 23238 tablet_service.cc:1467] Processing CreateTablet for tablet 69fafef17e784f91b9ed9b2fc5d7d491 (DEFAULT_TABLE table=test-table [id=d87f2a0109524ac8adc304dd57a7a942]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:44.101788 23382 tablet_service.cc:1467] Processing CreateTablet for tablet 69fafef17e784f91b9ed9b2fc5d7d491 (DEFAULT_TABLE table=test-table [id=d87f2a0109524ac8adc304dd57a7a942]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:44.102895 23382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69fafef17e784f91b9ed9b2fc5d7d491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:44.102895 23238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69fafef17e784f91b9ed9b2fc5d7d491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:44.104948 23530 tablet_service.cc:1467] Processing CreateTablet for tablet 69fafef17e784f91b9ed9b2fc5d7d491 (DEFAULT_TABLE table=test-table [id=d87f2a0109524ac8adc304dd57a7a942]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:23:44.105799 23530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69fafef17e784f91b9ed9b2fc5d7d491. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:23:44.110657 23623 tablet_bootstrap.cc:492] T 69fafef17e784f91b9ed9b2fc5d7d491 P 6cffa6d465aa4354bd4e66ee25fcb908: Bootstrap starting.
I20260809 09:23:44.111454 23625 tablet_bootstrap.cc:492] T 69fafef17e784f91b9ed9b2fc5d7d491 P 556e63d7d86b4fc5ad9c71e74c0bffbb: Bootstrap starting.
I20260809 09:23:44.111979 23624 tablet_bootstrap.cc:492] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015: Bootstrap starting.
I20260809 09:23:44.113569 23623 tablet_bootstrap.cc:654] T 69fafef17e784f91b9ed9b2fc5d7d491 P 6cffa6d465aa4354bd4e66ee25fcb908: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:44.113919 23625 tablet_bootstrap.cc:654] T 69fafef17e784f91b9ed9b2fc5d7d491 P 556e63d7d86b4fc5ad9c71e74c0bffbb: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:44.114135 23624 tablet_bootstrap.cc:654] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015: Neither blocks nor log segments found. Creating new log.
I20260809 09:23:44.114603 23623 log.cc:824] T 69fafef17e784f91b9ed9b2fc5d7d491 P 6cffa6d465aa4354bd4e66ee25fcb908: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:44.114910 23624 log.cc:824] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:44.115109 23625 log.cc:824] T 69fafef17e784f91b9ed9b2fc5d7d491 P 556e63d7d86b4fc5ad9c71e74c0bffbb: Log is configured to *not* fsync() on all Append() calls
I20260809 09:23:44.116611 23624 tablet_bootstrap.cc:492] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015: No bootstrap required, opened a new log
I20260809 09:23:44.116670 23623 tablet_bootstrap.cc:492] T 69fafef17e784f91b9ed9b2fc5d7d491 P 6cffa6d465aa4354bd4e66ee25fcb908: No bootstrap required, opened a new log
I20260809 09:23:44.116747 23624 ts_tablet_manager.cc:1397] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 09:23:44.116845 23623 ts_tablet_manager.cc:1397] T 69fafef17e784f91b9ed9b2fc5d7d491 P 6cffa6d465aa4354bd4e66ee25fcb908: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260809 09:23:44.116873 23625 tablet_bootstrap.cc:492] T 69fafef17e784f91b9ed9b2fc5d7d491 P 556e63d7d86b4fc5ad9c71e74c0bffbb: No bootstrap required, opened a new log
I20260809 09:23:44.117019 23625 ts_tablet_manager.cc:1397] T 69fafef17e784f91b9ed9b2fc5d7d491 P 556e63d7d86b4fc5ad9c71e74c0bffbb: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 09:23:44.119779 23624 raft_consensus.cc:348] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "556e63d7d86b4fc5ad9c71e74c0bffbb" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37265 } } peers { permanent_uuid: "87aed8ccbee2480dbfe2a81638ac4015" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 39047 } } peers { permanent_uuid: "6cffa6d465aa4354bd4e66ee25fcb908" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 33619 } }
I20260809 09:23:44.120033 23624 raft_consensus.cc:374] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:44.120095 23624 raft_consensus.cc:729] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87aed8ccbee2480dbfe2a81638ac4015, State: Initialized, Role: FOLLOWER
I20260809 09:23:44.120497 23624 consensus_queue.cc:260] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "556e63d7d86b4fc5ad9c71e74c0bffbb" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37265 } } peers { permanent_uuid: "87aed8ccbee2480dbfe2a81638ac4015" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 39047 } } peers { permanent_uuid: "6cffa6d465aa4354bd4e66ee25fcb908" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 33619 } }
I20260809 09:23:44.120466 23625 raft_consensus.cc:348] T 69fafef17e784f91b9ed9b2fc5d7d491 P 556e63d7d86b4fc5ad9c71e74c0bffbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "556e63d7d86b4fc5ad9c71e74c0bffbb" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37265 } } peers { permanent_uuid: "87aed8ccbee2480dbfe2a81638ac4015" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 39047 } } peers { permanent_uuid: "6cffa6d465aa4354bd4e66ee25fcb908" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 33619 } }
I20260809 09:23:44.120466 23623 raft_consensus.cc:348] T 69fafef17e784f91b9ed9b2fc5d7d491 P 6cffa6d465aa4354bd4e66ee25fcb908 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "556e63d7d86b4fc5ad9c71e74c0bffbb" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37265 } } peers { permanent_uuid: "87aed8ccbee2480dbfe2a81638ac4015" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 39047 } } peers { permanent_uuid: "6cffa6d465aa4354bd4e66ee25fcb908" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 33619 } }
I20260809 09:23:44.120705 23625 raft_consensus.cc:374] T 69fafef17e784f91b9ed9b2fc5d7d491 P 556e63d7d86b4fc5ad9c71e74c0bffbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:44.120783 23623 raft_consensus.cc:374] T 69fafef17e784f91b9ed9b2fc5d7d491 P 6cffa6d465aa4354bd4e66ee25fcb908 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:23:44.120769 23625 raft_consensus.cc:729] T 69fafef17e784f91b9ed9b2fc5d7d491 P 556e63d7d86b4fc5ad9c71e74c0bffbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 556e63d7d86b4fc5ad9c71e74c0bffbb, State: Initialized, Role: FOLLOWER
I20260809 09:23:44.120862 23623 raft_consensus.cc:729] T 69fafef17e784f91b9ed9b2fc5d7d491 P 6cffa6d465aa4354bd4e66ee25fcb908 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cffa6d465aa4354bd4e66ee25fcb908, State: Initialized, Role: FOLLOWER
I20260809 09:23:44.121155 23308 heartbeater.cc:503] Master 127.11.99.254:34029 was elected leader, sending a full tablet report...
I20260809 09:23:44.121209 23625 consensus_queue.cc:260] T 69fafef17e784f91b9ed9b2fc5d7d491 P 556e63d7d86b4fc5ad9c71e74c0bffbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "556e63d7d86b4fc5ad9c71e74c0bffbb" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37265 } } peers { permanent_uuid: "87aed8ccbee2480dbfe2a81638ac4015" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 39047 } } peers { permanent_uuid: "6cffa6d465aa4354bd4e66ee25fcb908" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 33619 } }
I20260809 09:23:44.121246 23623 consensus_queue.cc:260] T 69fafef17e784f91b9ed9b2fc5d7d491 P 6cffa6d465aa4354bd4e66ee25fcb908 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "556e63d7d86b4fc5ad9c71e74c0bffbb" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37265 } } peers { permanent_uuid: "87aed8ccbee2480dbfe2a81638ac4015" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 39047 } } peers { permanent_uuid: "6cffa6d465aa4354bd4e66ee25fcb908" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 33619 } }
I20260809 09:23:44.121376 23624 ts_tablet_manager.cc:1428] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 09:23:44.122058 23625 ts_tablet_manager.cc:1428] T 69fafef17e784f91b9ed9b2fc5d7d491 P 556e63d7d86b4fc5ad9c71e74c0bffbb: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 09:23:44.122058 23623 ts_tablet_manager.cc:1428] T 69fafef17e784f91b9ed9b2fc5d7d491 P 6cffa6d465aa4354bd4e66ee25fcb908: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260809 09:23:44.122483 23604 heartbeater.cc:503] Master 127.11.99.254:34029 was elected leader, sending a full tablet report...
I20260809 09:23:44.122736 23454 heartbeater.cc:503] Master 127.11.99.254:34029 was elected leader, sending a full tablet report...
W20260809 09:23:44.152112 23309 tablet.cc:2369] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 09:23:44.299521 23605 tablet.cc:2369] T 69fafef17e784f91b9ed9b2fc5d7d491 P 556e63d7d86b4fc5ad9c71e74c0bffbb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:23:44.349619 23630 raft_consensus.cc:482] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:23:44.349875 23630 raft_consensus.cc:504] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "556e63d7d86b4fc5ad9c71e74c0bffbb" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37265 } } peers { permanent_uuid: "87aed8ccbee2480dbfe2a81638ac4015" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 39047 } } peers { permanent_uuid: "6cffa6d465aa4354bd4e66ee25fcb908" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 33619 } }
I20260809 09:23:44.351074 23630 leader_election.cc:288] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 556e63d7d86b4fc5ad9c71e74c0bffbb (127.11.99.195:37265), 6cffa6d465aa4354bd4e66ee25fcb908 (127.11.99.194:33619)
W20260809 09:23:44.351466 23455 tablet.cc:2369] T 69fafef17e784f91b9ed9b2fc5d7d491 P 6cffa6d465aa4354bd4e66ee25fcb908: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:23:44.355362 23633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:44.351383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:37265 (local address 127.11.99.193:38007)
0809 09:23:44.351721 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:44.351739 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:44.351912 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:44.352391 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:44.352393 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:44.352431 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:44.352578 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:44.352585 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.353333 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.353335 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:44.354339 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:44.354348 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.355049 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.355052 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:44.355120 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:44.355140 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 09:23:44.355196 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 09:23:44.355244 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":124,"threads_started":1}
I20260809 09:23:44.355419 23619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:44.351511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:38007 (local address 127.11.99.195:37265)
0809 09:23:44.351668 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:44.351673 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:44.351822 (+ 149us) server_negotiation.cc:407] Connection header received
0809 09:23:44.352071 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:44.352075 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:44.352134 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:44.352208 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:44.352692 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.353213 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.354470 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.354925 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.355045 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:44.355096 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:44.355236 (+ 140us) server_negotiation.cc:299] Negotiation successful
0809 09:23:44.355300 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 09:23:44.355974 23634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:44.351821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:33619 (local address 127.11.99.193:34415)
0809 09:23:44.352106 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:44.352119 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:23:44.352227 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:23:44.352460 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:23:44.352462 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:23:44.352474 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:23:44.352582 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:44.352587 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.353926 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.353933 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:44.354855 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:23:44.354863 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.355661 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.355664 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:23:44.355763 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:44.355780 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 09:23:44.355837 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 09:23:44.355883 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":67,"threads_started":1}
I20260809 09:23:44.356056 23621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:44.351929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:34415 (local address 127.11.99.194:33619)
0809 09:23:44.352040 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:44.352046 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:44.352251 (+ 205us) server_negotiation.cc:407] Connection header received
0809 09:23:44.352310 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:44.352312 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:44.352355 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:44.352430 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:23:44.353351 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.353803 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.354969 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.355506 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.355625 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:44.355669 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:44.355878 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 09:23:44.355955 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 09:23:44.356099 23552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69fafef17e784f91b9ed9b2fc5d7d491" candidate_uuid: "87aed8ccbee2480dbfe2a81638ac4015" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "556e63d7d86b4fc5ad9c71e74c0bffbb" is_pre_election: true
I20260809 09:23:44.356424 23552 raft_consensus.cc:2454] T 69fafef17e784f91b9ed9b2fc5d7d491 P 556e63d7d86b4fc5ad9c71e74c0bffbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87aed8ccbee2480dbfe2a81638ac4015 in term 0.
I20260809 09:23:44.356673 23406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69fafef17e784f91b9ed9b2fc5d7d491" candidate_uuid: "87aed8ccbee2480dbfe2a81638ac4015" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cffa6d465aa4354bd4e66ee25fcb908" is_pre_election: true
I20260809 09:23:44.356967 23185 leader_election.cc:302] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 556e63d7d86b4fc5ad9c71e74c0bffbb, 87aed8ccbee2480dbfe2a81638ac4015; no voters:
I20260809 09:23:44.356980 23406 raft_consensus.cc:2454] T 69fafef17e784f91b9ed9b2fc5d7d491 P 6cffa6d465aa4354bd4e66ee25fcb908 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87aed8ccbee2480dbfe2a81638ac4015 in term 0.
I20260809 09:23:44.357245 23630 raft_consensus.cc:2781] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:23:44.357362 23630 raft_consensus.cc:482] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:23:44.357420 23630 raft_consensus.cc:3037] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:44.358429 23630 raft_consensus.cc:504] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "556e63d7d86b4fc5ad9c71e74c0bffbb" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37265 } } peers { permanent_uuid: "87aed8ccbee2480dbfe2a81638ac4015" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 39047 } } peers { permanent_uuid: "6cffa6d465aa4354bd4e66ee25fcb908" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 33619 } }
I20260809 09:23:44.358794 23630 leader_election.cc:288] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015 [CANDIDATE]: Term 1 election: Requested vote from peers 556e63d7d86b4fc5ad9c71e74c0bffbb (127.11.99.195:37265), 6cffa6d465aa4354bd4e66ee25fcb908 (127.11.99.194:33619)
I20260809 09:23:44.359122 23552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69fafef17e784f91b9ed9b2fc5d7d491" candidate_uuid: "87aed8ccbee2480dbfe2a81638ac4015" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "556e63d7d86b4fc5ad9c71e74c0bffbb"
I20260809 09:23:44.359206 23406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69fafef17e784f91b9ed9b2fc5d7d491" candidate_uuid: "87aed8ccbee2480dbfe2a81638ac4015" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cffa6d465aa4354bd4e66ee25fcb908"
I20260809 09:23:44.359242 23552 raft_consensus.cc:3037] T 69fafef17e784f91b9ed9b2fc5d7d491 P 556e63d7d86b4fc5ad9c71e74c0bffbb [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:44.359303 23406 raft_consensus.cc:3037] T 69fafef17e784f91b9ed9b2fc5d7d491 P 6cffa6d465aa4354bd4e66ee25fcb908 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:23:44.360277 23552 raft_consensus.cc:2454] T 69fafef17e784f91b9ed9b2fc5d7d491 P 556e63d7d86b4fc5ad9c71e74c0bffbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aed8ccbee2480dbfe2a81638ac4015 in term 1.
I20260809 09:23:44.360282 23406 raft_consensus.cc:2454] T 69fafef17e784f91b9ed9b2fc5d7d491 P 6cffa6d465aa4354bd4e66ee25fcb908 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aed8ccbee2480dbfe2a81638ac4015 in term 1.
I20260809 09:23:44.360548 23185 leader_election.cc:302] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cffa6d465aa4354bd4e66ee25fcb908, 87aed8ccbee2480dbfe2a81638ac4015; no voters:
I20260809 09:23:44.360759 23630 raft_consensus.cc:2781] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:23:44.360972 23630 raft_consensus.cc:686] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015 [term 1 LEADER]: Becoming Leader. State: Replica: 87aed8ccbee2480dbfe2a81638ac4015, State: Running, Role: LEADER
I20260809 09:23:44.361281 23630 consensus_queue.cc:237] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "556e63d7d86b4fc5ad9c71e74c0bffbb" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37265 } } peers { permanent_uuid: "87aed8ccbee2480dbfe2a81638ac4015" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 39047 } } peers { permanent_uuid: "6cffa6d465aa4354bd4e66ee25fcb908" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 33619 } }
I20260809 09:23:44.364300 23092 catalog_manager.cc:5495] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87aed8ccbee2480dbfe2a81638ac4015 (127.11.99.193). New cstate: current_term: 1 leader_uuid: "87aed8ccbee2480dbfe2a81638ac4015" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "556e63d7d86b4fc5ad9c71e74c0bffbb" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87aed8ccbee2480dbfe2a81638ac4015" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 39047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cffa6d465aa4354bd4e66ee25fcb908" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 33619 } health_report { overall_health: UNKNOWN } } }
I20260809 09:23:44.389801 23618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:44.387122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48510 (local address 127.11.99.193:39047)
0809 09:23:44.387231 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 09:23:44.387235 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:23:44.387249 (+ 14us) server_negotiation.cc:407] Connection header received
0809 09:23:44.387320 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:23:44.387321 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:23:44.387366 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:23:44.387442 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:23:44.387632 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.388042 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.388741 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:23:44.388913 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:23:44.388980 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:23:44.389194 (+ 214us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:23:44.389536 (+ 342us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:23:44.389614 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 09:23:44.389663 (+ 49us) server_negotiation.cc:299] Negotiation successful
0809 09:23:44.389703 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 09:23:44.395233 23406 raft_consensus.cc:1261] T 69fafef17e784f91b9ed9b2fc5d7d491 P 6cffa6d465aa4354bd4e66ee25fcb908 [term 1 FOLLOWER]: Refusing update from remote peer 87aed8ccbee2480dbfe2a81638ac4015: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:23:44.395262 23552 raft_consensus.cc:1261] T 69fafef17e784f91b9ed9b2fc5d7d491 P 556e63d7d86b4fc5ad9c71e74c0bffbb [term 1 FOLLOWER]: Refusing update from remote peer 87aed8ccbee2480dbfe2a81638ac4015: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:23:44.395974 23635 consensus_queue.cc:1035] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cffa6d465aa4354bd4e66ee25fcb908" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 33619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:23:44.396206 23630 consensus_queue.cc:1035] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015 [LEADER]: Connected to new peer: Peer: permanent_uuid: "556e63d7d86b4fc5ad9c71e74c0bffbb" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:23:44.411633 23639 mvcc.cc:205] Tried to move back new op lower bound from 7316551370315980800 to 7316551370185945088. Current Snapshot: MvccSnapshot[applied={T|T < 7316551370315980800}]
I20260809 09:23:44.413200 23092 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54414:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:23:44.413354 23092 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54414:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:23:44.415717 23092 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2a05b0bc47194857b23ded1b70c07b41: Sending DeleteTablet for 3 replicas of tablet 69fafef17e784f91b9ed9b2fc5d7d491
I20260809 09:23:44.416445 23238 tablet_service.cc:1514] Processing DeleteTablet for tablet 69fafef17e784f91b9ed9b2fc5d7d491 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:44 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:48496
I20260809 09:23:44.416525 23530 tablet_service.cc:1514] Processing DeleteTablet for tablet 69fafef17e784f91b9ed9b2fc5d7d491 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:44 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:51704
I20260809 09:23:44.416908 23651 tablet_replica.cc:330] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015: stopping tablet replica
I20260809 09:23:44.416894 23382 tablet_service.cc:1514] Processing DeleteTablet for tablet 69fafef17e784f91b9ed9b2fc5d7d491 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:23:44 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:56872
I20260809 09:23:44.417212 23651 raft_consensus.cc:2229] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015 [term 1 LEADER]: Raft consensus shutting down.
I20260809 09:23:44.417330 23653 tablet_replica.cc:330] T 69fafef17e784f91b9ed9b2fc5d7d491 P 6cffa6d465aa4354bd4e66ee25fcb908: stopping tablet replica
I20260809 09:23:44.417532 23651 raft_consensus.cc:2258] T 69fafef17e784f91b9ed9b2fc5d7d491 P 87aed8ccbee2480dbfe2a81638ac4015 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:23:44.417673 23653 raft_consensus.cc:2229] T 69fafef17e784f91b9ed9b2fc5d7d491 P 6cffa6d465aa4354bd4e66ee25fcb908 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:23:44.417807 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 23163
I20260809 09:23:44.418015 23653 raft_consensus.cc:2258] T 69fafef17e784f91b9ed9b2fc5d7d491 P 6cffa6d465aa4354bd4e66ee25fcb908 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:23:44.418848 23652 tablet_replica.cc:330] T 69fafef17e784f91b9ed9b2fc5d7d491 P 556e63d7d86b4fc5ad9c71e74c0bffbb: stopping tablet replica
I20260809 09:23:44.419085 23652 raft_consensus.cc:2229] T 69fafef17e784f91b9ed9b2fc5d7d491 P 556e63d7d86b4fc5ad9c71e74c0bffbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:23:44.419296 23652 raft_consensus.cc:2258] T 69fafef17e784f91b9ed9b2fc5d7d491 P 556e63d7d86b4fc5ad9c71e74c0bffbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:23:44.420490 23652 ts_tablet_manager.cc:1905] T 69fafef17e784f91b9ed9b2fc5d7d491 P 556e63d7d86b4fc5ad9c71e74c0bffbb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:23:44.422255 23653 ts_tablet_manager.cc:1905] T 69fafef17e784f91b9ed9b2fc5d7d491 P 6cffa6d465aa4354bd4e66ee25fcb908: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:23:44.423365 23652 ts_tablet_manager.cc:1918] T 69fafef17e784f91b9ed9b2fc5d7d491 P 556e63d7d86b4fc5ad9c71e74c0bffbb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:23:44.423472 23652 log.cc:1196] T 69fafef17e784f91b9ed9b2fc5d7d491 P 556e63d7d86b4fc5ad9c71e74c0bffbb: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/69fafef17e784f91b9ed9b2fc5d7d491
I20260809 09:23:44.423838 23652 ts_tablet_manager.cc:1939] T 69fafef17e784f91b9ed9b2fc5d7d491 P 556e63d7d86b4fc5ad9c71e74c0bffbb: Deleting consensus metadata
I20260809 09:23:44.424978 23653 ts_tablet_manager.cc:1918] T 69fafef17e784f91b9ed9b2fc5d7d491 P 6cffa6d465aa4354bd4e66ee25fcb908: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:23:44.425074 23653 log.cc:1196] T 69fafef17e784f91b9ed9b2fc5d7d491 P 6cffa6d465aa4354bd4e66ee25fcb908: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/69fafef17e784f91b9ed9b2fc5d7d491
I20260809 09:23:44.425088 23076 catalog_manager.cc:4841] TS 556e63d7d86b4fc5ad9c71e74c0bffbb (127.11.99.195:37265): tablet 69fafef17e784f91b9ed9b2fc5d7d491 (table test-table [id=d87f2a0109524ac8adc304dd57a7a942]) successfully deleted
I20260809 09:23:44.425397 23653 ts_tablet_manager.cc:1939] T 69fafef17e784f91b9ed9b2fc5d7d491 P 6cffa6d465aa4354bd4e66ee25fcb908: Deleting consensus metadata
I20260809 09:23:44.426481 23076 catalog_manager.cc:4841] TS 6cffa6d465aa4354bd4e66ee25fcb908 (127.11.99.194:33619): tablet 69fafef17e784f91b9ed9b2fc5d7d491 (table test-table [id=d87f2a0109524ac8adc304dd57a7a942]) successfully deleted
I20260809 09:23:44.426765 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 23313
W20260809 09:23:44.426816 23074 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.99.193:39047 (error 108)
I20260809 09:23:44.428254 23620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:23:44.427900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:39047 (local address 127.0.0.1:48516)
0809 09:23:44.428052 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 09:23:44.428152 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.193:39047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 09:23:44.428421 23074 catalog_manager.cc:4584] TS 87aed8ccbee2480dbfe2a81638ac4015 (127.11.99.193:39047): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 69fafef17e784f91b9ed9b2fc5d7d491: Network error: Client connection negotiation failed: client connection to 127.11.99.193:39047: connect: Connection refused (error 111)
I20260809 09:23:44.434121 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 23459
I20260809 09:23:44.441339 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 23054
2026-08-09T09:23:44Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2380 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:23:44 dist-test-slave-pgkr krb5kdc[23657](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:23:44 dist-test-slave-pgkr krb5kdc[23657](info): set up 2 sockets
Aug 09 09:23:44 dist-test-slave-pgkr krb5kdc[23657](info): commencing operation
krb5kdc: starting...
W20260809 09:23:45.501993 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.037s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:23:45 dist-test-slave-pgkr krb5kdc[23657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267425, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:23:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:23:45Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.99.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.99.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.99.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/rangeradmin_127.11.99.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.99.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/rangeradmin_127.11.99.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.99.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.99.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.99.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/rangerlookup_127.11.99.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.99.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/rangerlookup_127.11.99.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.99.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.99.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.99.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/HTTP_127.11.99.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.99.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/HTTP_127.11.99.212@KRBTEST.COM.keytab.
I20260809 09:23:45.662786 11663 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskv_EQJC/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/postgres -l logfile start
2026-08-09 09:23:47.967 UTC [23690] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 09:23:47.967 UTC [23690] LOG: listening on IPv4 address "127.11.99.212", port 44279
2026-08-09 09:23:47.970 UTC [23690] LOG: listening on Unix socket "/tmp/.s.PGSQL.44279"
2026-08-09 09:23:47.990 UTC [23694] LOG: database system was shut down at 2026-08-09 09:23:46 UTC
2026-08-09 09:23:47.994 UTC [23690] LOG: database system is ready to accept connections
I20260809 09:23:48.967371 11663 mini_postgres.cc:96] Postgres bound to 44279
2026-08-09 09:23:48.975 UTC [23702] FATAL: database "slave" does not exist
127.11.99.212:44279 - accepting connections
I20260809 09:23:48.976171 11663 mini_ranger.cc:161] Starting Ranger...
I20260809 09:23:48.991500 11663 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 09:23:49.381058 11663 mini_ranger.cc:87] Created ranger Postgres database
I20260809 09:23:49.381173 11663 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ranger-admin
2026-08-09 09:23:49,752 [I] DB FLAVOR :POSTGRES
2026-08-09 09:23:49,753 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 09:23:49,753 [I] Checking connection..
2026-08-09 09:23:49,753 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:44279/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 09:23:50,013 [I] Checking connection passed.
2026-08-09 09:23:50,013 [I] --------- Verifying version history table ---------
2026-08-09 09:23:50,013 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:44279/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 09:23:50,265 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 09:23:50,265 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:44279/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 09:23:50,491 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 09:23:50,491 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 09:23:50,491 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:44279/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 09:23:50.724 UTC [23770] WARNING: there is no transaction in progress
2026-08-09 09:23:50,731 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 09:23:50,731 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:44279/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 09:23:50,977 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 09:23:50,977 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 09:23:50,978 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:44279/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 09:23:51,230 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:44279/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 09:23:51,486 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:44279/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-pgkr.c.gcp-upstream.internal','N') ;"
2026-08-09 09:23:51,752 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:44279/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 09:23:51,997 [I] Table x_portal_user does not exist in database ranger
2026-08-09 09:23:51,997 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:44279/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 09:23:52,252 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 09:23:52,252 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:44279/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 09:23:52,501 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:44279/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 09:23:52,747 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 09:23:52,747 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:44279/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 09:23:53.623 UTC [23886] WARNING: there is no transaction in progress
2026-08-09 09:23:53.638 UTC [23886] WARNING: there is no transaction in progress
2026-08-09 09:23:53.653 UTC [23886] WARNING: there is no transaction in progress
2026-08-09 09:23:53.666 UTC [23886] WARNING: there is no transaction in progress
2026-08-09 09:23:53.681 UTC [23886] WARNING: there is no transaction in progress
2026-08-09 09:23:53.698 UTC [23886] WARNING: there is no transaction in progress
2026-08-09 09:23:53.746 UTC [23886] WARNING: there is no transaction in progress
2026-08-09 09:23:53.752 UTC [23886] WARNING: there is no transaction in progress
2026-08-09 09:23:53.763 UTC [23886] WARNING: there is no transaction in progress
2026-08-09 09:23:53.773 UTC [23886] WARNING: there is no transaction in progress
2026-08-09 09:23:53.782 UTC [23886] WARNING: there is no transaction in progress
2026-08-09 09:23:53.795 UTC [23886] WARNING: there is no transaction in progress
2026-08-09 09:23:53.803 UTC [23886] WARNING: there is no transaction in progress
2026-08-09 09:23:53.809 UTC [23886] WARNING: there is no transaction in progress
2026-08-09 09:23:53.815 UTC [23886] WARNING: there is no transaction in progress
2026-08-09 09:23:53.821 UTC [23886] WARNING: there is no transaction in progress
2026-08-09 09:23:54,372 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 09:23:54,372 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:44279/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 09:23:54,604 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 09:23:54,604 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:44279/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 09:23:54,864 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 09:23:54,865 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:44279/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 09:23:55,101 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 09:23:55,101 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:44279/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 09:23:55,350 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:44279/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 09:23:55,607 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:44279/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-pgkr.c.gcp-upstream.internal';"
2026-08-09 09:23:55,851 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 09:23:55,852 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:44279/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 09:23:56,108 [I] DB_PATCHES have already been applied
I20260809 09:23:56.114526 11663 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ranger-admin:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskv_EQJC/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 09:23:56.114593 11663 mini_ranger.cc:193] Using host: 127.11.99.212
I20260809 09:23:56.118939 11663 mini_ranger.cc:227] Ranger admin URL: http://127.11.99.212:56465
Aug 09, 2026 9:23:56 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 9:23:56 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 9:23:56 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 9:23:56 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 9:23:56 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 9:23:57 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 9:23:57 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 09:23:57.253023 11663 mini_ranger.cc:160] Time spent starting Ranger: real 8.277s user 0.005s sys 0.007s
Aug 09, 2026 9:24:17 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 9:24:17 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 09, 2026 9:24:17 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 9:24:17 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 9:24:17 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 9:24:17 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 9:24:17 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 9:24:17 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 9:24:17 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 9:24:17 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 9:24:17 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 9:24:17 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 9:24:17 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 9:24:17 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 9:24:17 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 9:24:17 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 9:24:17 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 9:24:18 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 09:24:18.977033 11663 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.99.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.99.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.99.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/rangerkms_127.11.99.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.99.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/rangerkms_127.11.99.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.99.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.99.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.99.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/HTTP_127.11.99.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.99.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/HTTP_127.11.99.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 09:24:19 dist-test-slave-pgkr krb5kdc[23657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267459, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 09:24:19.074246 11663 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 09:24:19.083814 11663 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 09:24:19.803699 11663 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 09:24:19.803781 11663 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ranger-kms
I20260809 09:24:19.803872 11663 mini_ranger_kms.cc:227] Using postgres at 127.11.99.212:44279
2026-08-09 09:24:20,123 [I] DB FLAVOR :POSTGRES
2026-08-09 09:24:20,123 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 09:24:20,123 [I] Checking connection
2026-08-09 09:24:20,123 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:44279/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 09:24:20,374 [I] connection success
2026-08-09 09:24:20,374 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 09:24:20,374 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 09:24:20,374 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:44279/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 09:24:20,614 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 09:24:20,615 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 09:24:20,615 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 09:24:20,615 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:44279/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 09:24:20,888 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 09:24:21.375135 11663 mini_ranger_kms.cc:310] Created kms service
I20260809 09:24:21.593890 11663 mini_ranger_kms.cc:326] Created kudu user
I20260809 09:24:21.641090 11663 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 09:24:21 dist-test-slave-pgkr krb5kdc[23657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267459, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.99.212@KRBTEST.COM
I20260809 09:24:22.049742 11663 mini_ranger_kms.cc:384] Added ranger policy
I20260809 09:24:22.049898 11663 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ranger-kms:/tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 09:24:22.049923 11663 mini_ranger_kms.cc:240] Using host: 127.11.99.212
I20260809 09:24:22.054589 11663 mini_ranger_kms.cc:276] Ranger KMS PID: 24078
I20260809 09:24:22.054766 11663 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.99.212:49827
Aug 09, 2026 9:24:23 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 9:24:23 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 9:24:24 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 9:24:24 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 9:24:24 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 9:24:24 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260809 09:24:25.379544 11663 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.305s user 0.002s sys 0.302s
I20260809 09:24:25.379700 11663 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 09:24:25.379840 11663 mini_ranger_kms.cc:401] 127.11.99.212:49827/kms/v1/keys
Aug 09 09:24:25 dist-test-slave-pgkr krb5kdc[23657](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786267465, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.99.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 09 09:24:25 dist-test-slave-pgkr krb5kdc[23657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267465, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.99.212@KRBTEST.COM for HTTP/127.11.99.212@KRBTEST.COM
Aug 09 09:24:26 dist-test-slave-pgkr krb5kdc[23657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267465, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.99.212@KRBTEST.COM for HTTP/127.11.99.212@KRBTEST.COM
Aug 09 09:24:28 dist-test-slave-pgkr krb5kdc[23657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267468, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:24:28.587597 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:35473
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:34723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:35473
--ranger_config_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.99.212:49827/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:24:28.728492 24134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:24:28.728710 24134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:24:28.728744 24134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:24:28.732326 24134 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:24:28.732375 24134 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:24:28.732393 24134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:24:28.732406 24134 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:24:28.732419 24134 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:24:28.737409 24134 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:34723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.99.212:49827/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:35473
--ranger_config_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:35473
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24134
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:24:28.738329 24134 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:24:28.739327 24134 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:24:28.748895 24139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:24:28.749156 24134 server_base.cc:1034] running on GCE node
W20260809 09:24:28.748907 24143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:24:28.749392 24140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:24:28.749926 24134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:24:28.751150 24134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:24:28.752352 24134 hybrid_clock.cc:648] HybridClock initialized: now 1786267468752322 us; error 57 us; skew 500 ppm
Aug 09 09:24:28 dist-test-slave-pgkr krb5kdc[23657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:24:28.759660 24134 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:24:28.760640 24134 webserver.cc:460] Webserver started at http://127.11.99.254:40963/ using document root <none> and password file <none>
I20260809 09:24:28.761175 24134 fs_manager.cc:359] Metadata directory not provided
I20260809 09:24:28.761260 24134 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:24:28.761511 24134 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 09:24:28 dist-test-slave-pgkr krb5kdc[23657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for HTTP/127.11.99.212@KRBTEST.COM
I20260809 09:24:28.825604 24134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "d243bb4bf5b14c86971e1f6979d01db6"
format_stamp: "Formatted at 2026-08-09 09:24:28 on dist-test-slave-pgkr"
server_key: "dac31ca15d46b262c2c0b03ad084be58"
server_key_iv: "804ef9b8dd8def65d33be56d824846cc"
server_key_version: "kuduclusterkey@0"
I20260809 09:24:28.826224 24134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "d243bb4bf5b14c86971e1f6979d01db6"
format_stamp: "Formatted at 2026-08-09 09:24:28 on dist-test-slave-pgkr"
server_key: "dac31ca15d46b262c2c0b03ad084be58"
server_key_iv: "804ef9b8dd8def65d33be56d824846cc"
server_key_version: "kuduclusterkey@0"
I20260809 09:24:28.830119 24134 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 09:24:28.848927 24151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:24:28.850222 24134 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 09:24:28.850322 24134 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "d243bb4bf5b14c86971e1f6979d01db6"
format_stamp: "Formatted at 2026-08-09 09:24:28 on dist-test-slave-pgkr"
server_key: "dac31ca15d46b262c2c0b03ad084be58"
server_key_iv: "804ef9b8dd8def65d33be56d824846cc"
server_key_version: "kuduclusterkey@0"
I20260809 09:24:28.850461 24134 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:24:28.891011 24134 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:24:28.894176 24134 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:24:28.894423 24134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:24:28.903930 24134 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:35473
I20260809 09:24:28.904024 24208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:35473 every 8 connection(s)
I20260809 09:24:28.904893 24134 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:24:28.905997 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 24134
I20260809 09:24:28.906126 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:24:28.906436 11663 external_mini_cluster.cc:1428] Setting key f0e9368b776c9848e8ea9a10faae9472
I20260809 09:24:28.908200 24209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:24:28.914918 24209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d243bb4bf5b14c86971e1f6979d01db6: Bootstrap starting.
I20260809 09:24:28.917269 24209 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d243bb4bf5b14c86971e1f6979d01db6: Neither blocks nor log segments found. Creating new log.
Aug 09 09:24:28 dist-test-slave-pgkr krb5kdc[23657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267468, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:24:28.918406 24209 log.cc:824] T 00000000000000000000000000000000 P d243bb4bf5b14c86971e1f6979d01db6: Log is configured to *not* fsync() on all Append() calls
I20260809 09:24:28.920379 24209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d243bb4bf5b14c86971e1f6979d01db6: No bootstrap required, opened a new log
I20260809 09:24:28.923996 24209 raft_consensus.cc:348] T 00000000000000000000000000000000 P d243bb4bf5b14c86971e1f6979d01db6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d243bb4bf5b14c86971e1f6979d01db6" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35473 } }
I20260809 09:24:28.924229 24212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:24:28.908015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35774 (local address 127.11.99.254:35473)
0809 09:24:28.908483 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0809 09:24:28.908501 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 09:24:28.908542 (+ 41us) server_negotiation.cc:407] Connection header received
0809 09:24:28.909386 (+ 844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:24:28.909407 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:24:28.909804 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:24:28.910789 (+ 985us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:24:28.911340 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:24:28.913052 (+ 1712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:24:28.914256 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:24:28.914955 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:24:28.915497 (+ 542us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:24:28.918211 (+ 2714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:24:28.918217 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:24:28.918231 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:24:28.918262 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:24:28.920961 (+ 2699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:24:28.921477 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:24:28.921483 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:24:28.921489 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:24:28.921629 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:24:28.921927 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:24:28.921930 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:24:28.921932 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:24:28.922435 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:24:28.922655 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0809 09:24:28.923028 (+ 373us) server_negotiation.cc:299] Negotiation successful
0809 09:24:28.923291 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":147,"threads_started":1}
I20260809 09:24:28.924252 24209 raft_consensus.cc:374] T 00000000000000000000000000000000 P d243bb4bf5b14c86971e1f6979d01db6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:24:28.924484 24209 raft_consensus.cc:729] T 00000000000000000000000000000000 P d243bb4bf5b14c86971e1f6979d01db6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d243bb4bf5b14c86971e1f6979d01db6, State: Initialized, Role: FOLLOWER
I20260809 09:24:28.924962 24209 consensus_queue.cc:260] T 00000000000000000000000000000000 P d243bb4bf5b14c86971e1f6979d01db6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d243bb4bf5b14c86971e1f6979d01db6" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35473 } }
I20260809 09:24:28.925117 24209 raft_consensus.cc:388] T 00000000000000000000000000000000 P d243bb4bf5b14c86971e1f6979d01db6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:24:28.925199 24209 raft_consensus.cc:482] T 00000000000000000000000000000000 P d243bb4bf5b14c86971e1f6979d01db6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:24:28.925333 24209 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d243bb4bf5b14c86971e1f6979d01db6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:24:28.926210 24209 raft_consensus.cc:504] T 00000000000000000000000000000000 P d243bb4bf5b14c86971e1f6979d01db6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d243bb4bf5b14c86971e1f6979d01db6" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35473 } }
I20260809 09:24:28.926573 24209 leader_election.cc:302] T 00000000000000000000000000000000 P d243bb4bf5b14c86971e1f6979d01db6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d243bb4bf5b14c86971e1f6979d01db6; no voters:
I20260809 09:24:28.927002 24209 leader_election.cc:288] T 00000000000000000000000000000000 P d243bb4bf5b14c86971e1f6979d01db6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:24:28.927073 24215 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d243bb4bf5b14c86971e1f6979d01db6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:24:28.927299 24215 raft_consensus.cc:686] T 00000000000000000000000000000000 P d243bb4bf5b14c86971e1f6979d01db6 [term 1 LEADER]: Becoming Leader. State: Replica: d243bb4bf5b14c86971e1f6979d01db6, State: Running, Role: LEADER
I20260809 09:24:28.927626 24215 consensus_queue.cc:237] T 00000000000000000000000000000000 P d243bb4bf5b14c86971e1f6979d01db6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d243bb4bf5b14c86971e1f6979d01db6" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35473 } }
I20260809 09:24:28.928267 24209 sys_catalog.cc:564] T 00000000000000000000000000000000 P d243bb4bf5b14c86971e1f6979d01db6 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:24:28.928745 24215 sys_catalog.cc:455] T 00000000000000000000000000000000 P d243bb4bf5b14c86971e1f6979d01db6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d243bb4bf5b14c86971e1f6979d01db6. Latest consensus state: current_term: 1 leader_uuid: "d243bb4bf5b14c86971e1f6979d01db6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d243bb4bf5b14c86971e1f6979d01db6" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35473 } } }
I20260809 09:24:28.928855 24215 sys_catalog.cc:458] T 00000000000000000000000000000000 P d243bb4bf5b14c86971e1f6979d01db6 [sys.catalog]: This master's current role is: LEADER
I20260809 09:24:28.929296 24217 sys_catalog.cc:455] T 00000000000000000000000000000000 P d243bb4bf5b14c86971e1f6979d01db6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d243bb4bf5b14c86971e1f6979d01db6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d243bb4bf5b14c86971e1f6979d01db6" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35473 } } }
I20260809 09:24:28.929445 24217 sys_catalog.cc:458] T 00000000000000000000000000000000 P d243bb4bf5b14c86971e1f6979d01db6 [sys.catalog]: This master's current role is: LEADER
I20260809 09:24:28.929742 24221 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:24:28.932806 24221 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:24:28.933281 24209 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 09:24:28.944983 24221 catalog_manager.cc:1347] Generated new cluster ID: 23512459705c48ba9ab9c85d9874758f
I20260809 09:24:28.945063 24221 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:24:28.961915 24221 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:24:28.963227 24221 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:24:28.973470 24221 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d243bb4bf5b14c86971e1f6979d01db6: Generated new TSK 0
I20260809 09:24:28.974226 24221 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.99.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
I20260809 09:24:29.721494 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.99.212:49827/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:0
--local_ip_for_outbound_sockets=127.11.99.193
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:35473
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:34723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:24:29.871981 24256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:24:29.872232 24256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:24:29.872326 24256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:24:29.876389 24256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:24:29.876444 24256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:24:29.876533 24256 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:24:29.883522 24256 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:34723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.99.212:49827/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:35473
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:24:29.884718 24256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:24:29.886020 24256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:24:29.898814 24267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:24:29.899222 24265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:24:29.899248 24256 server_base.cc:1034] running on GCE node
W20260809 09:24:29.899540 24264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:24:29.899950 24256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:24:29.900701 24256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:24:29.901881 24256 hybrid_clock.cc:648] HybridClock initialized: now 1786267469901859 us; error 43 us; skew 500 ppm
Aug 09 09:24:29 dist-test-slave-pgkr krb5kdc[23657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267469, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:24:29.905489 24256 init.cc:377] Logged in from keytab as kudu/127.11.99.193@KRBTEST.COM (short username kudu)
I20260809 09:24:29.906564 24256 webserver.cc:460] Webserver started at http://127.11.99.193:45095/ using document root <none> and password file <none>
I20260809 09:24:29.907399 24256 fs_manager.cc:359] Metadata directory not provided
I20260809 09:24:29.907538 24256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:24:29.907811 24256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 09:24:29 dist-test-slave-pgkr krb5kdc[23657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267469, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for HTTP/127.11.99.212@KRBTEST.COM
I20260809 09:24:29.924176 24256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-0/data/instance:
uuid: "29f54ee51bf4422da9ec41115f3cb15c"
format_stamp: "Formatted at 2026-08-09 09:24:29 on dist-test-slave-pgkr"
server_key: "d882f9597c70f56f8cc0876a85119582"
server_key_iv: "c693aca7f5a52187f416967738a56bd1"
server_key_version: "kuduclusterkey@0"
I20260809 09:24:29.924902 24256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance:
uuid: "29f54ee51bf4422da9ec41115f3cb15c"
format_stamp: "Formatted at 2026-08-09 09:24:29 on dist-test-slave-pgkr"
server_key: "d882f9597c70f56f8cc0876a85119582"
server_key_iv: "c693aca7f5a52187f416967738a56bd1"
server_key_version: "kuduclusterkey@0"
I20260809 09:24:29.929941 24256 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 09:24:29.956241 24274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:24:29.957571 24256 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.003s sys 0.000s
I20260809 09:24:29.957705 24256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "29f54ee51bf4422da9ec41115f3cb15c"
format_stamp: "Formatted at 2026-08-09 09:24:29 on dist-test-slave-pgkr"
server_key: "d882f9597c70f56f8cc0876a85119582"
server_key_iv: "c693aca7f5a52187f416967738a56bd1"
server_key_version: "kuduclusterkey@0"
I20260809 09:24:29.957837 24256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:24:29.975597 24256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:24:29.979238 24256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:24:29.979483 24256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:24:29.980211 24256 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:24:29.981238 24256 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:24:29.981343 24256 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:24:29.981464 24256 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:24:29.981556 24256 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:24:29.993155 24256 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:34171
I20260809 09:24:29.994273 24256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:24:30.000370 24396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:34171 every 8 connection(s)
I20260809 09:24:30.000954 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 24256
I20260809 09:24:30.001099 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance
I20260809 09:24:30.001430 11663 external_mini_cluster.cc:1428] Setting key f2a8d373565adf45a6eaad40af3bbfa8
WARNING: no policy specified for kudu/127.11.99.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.194@KRBTEST.COM" created.
Aug 09 09:24:30 dist-test-slave-pgkr krb5kdc[23657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267469, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:24:30.024394 24402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:24:30.004982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:41189 (local address 127.11.99.254:35473)
0809 09:24:30.005280 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0809 09:24:30.005287 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 09:24:30.005836 (+ 549us) server_negotiation.cc:407] Connection header received
0809 09:24:30.007016 (+ 1180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:24:30.007021 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:24:30.007086 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:24:30.007154 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:24:30.009294 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:24:30.010241 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:24:30.012269 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:24:30.012604 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:24:30.012729 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:24:30.020021 (+ 7292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:24:30.020025 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:24:30.020028 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:24:30.020058 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:24:30.021877 (+ 1819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:24:30.022505 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:24:30.022508 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:24:30.022510 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:24:30.022636 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:24:30.023064 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:24:30.023069 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:24:30.023071 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:24:30.023340 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:24:30.023424 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 09:24:30.024100 (+ 676us) server_negotiation.cc:299] Negotiation successful
0809 09:24:30.024227 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":69,"threads_started":1}
I20260809 09:24:30.025969 24401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:24:30.003778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:35473 (local address 127.11.99.193:41189)
0809 09:24:30.005664 (+ 1886us) negotiation.cc:107] Waiting for socket to connect
0809 09:24:30.005731 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0809 09:24:30.006732 (+ 1001us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:24:30.007680 (+ 948us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:24:30.007690 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:24:30.008253 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:24:30.009021 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:24:30.009045 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:24:30.010433 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:24:30.010439 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:24:30.012061 (+ 1622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:24:30.012075 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:24:30.012796 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:24:30.012800 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:24:30.013144 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:24:30.017746 (+ 4602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:24:30.017779 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:24:30.019807 (+ 2028us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:24:30.022010 (+ 2203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:24:30.022016 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:24:30.022033 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:24:30.022372 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:24:30.022746 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:24:30.022749 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:24:30.022751 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:24:30.022925 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:24:30.023494 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:24:30.023500 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:24:30.023832 (+ 332us) client_negotiation.cc:769] Sending connection context
0809 09:24:30.024639 (+ 807us) client_negotiation.cc:240] Negotiation successful
0809 09:24:30.024948 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1588,"thread_start_us":224,"threads_started":1}
I20260809 09:24:30.027379 24397 heartbeater.cc:347] Connected to a master server at 127.11.99.254:35473
I20260809 09:24:30.027733 24397 heartbeater.cc:464] Registering TS with master...
I20260809 09:24:30.028347 24397 heartbeater.cc:511] Master 127.11.99.254:35473 requested a full tablet report, sending...
I20260809 09:24:30.030115 24169 ts_manager.cc:194] Registered new tserver with Master: 29f54ee51bf4422da9ec41115f3cb15c (127.11.99.193:34171)
I20260809 09:24:30.031687 24169 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.193@KRBTEST.COM'} at 127.11.99.193:41189
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
I20260809 09:24:30.044024 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.99.212:49827/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:0
--local_ip_for_outbound_sockets=127.11.99.194
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:35473
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:34723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 09:24:30 dist-test-slave-pgkr krb5kdc[23657](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786267470, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 09:24:30.176019 24405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:24:30.176331 24405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:24:30.176397 24405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:24:30.181977 24405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:24:30.182065 24405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:24:30.182154 24405 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:24:30.189487 24405 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:34723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.99.212:49827/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:35473
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24405
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:24:30.190575 24405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:24:30.191589 24405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:24:30.202476 24412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:24:30.202968 24416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:24:30.204294 24414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:24:30.205307 24405 server_base.cc:1034] running on GCE node
I20260809 09:24:30.205828 24405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:24:30.206676 24405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:24:30.207894 24405 hybrid_clock.cc:648] HybridClock initialized: now 1786267470207869 us; error 38 us; skew 500 ppm
Aug 09 09:24:30 dist-test-slave-pgkr krb5kdc[23657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267470, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:24:30.211264 24405 init.cc:377] Logged in from keytab as kudu/127.11.99.194@KRBTEST.COM (short username kudu)
I20260809 09:24:30.212147 24405 webserver.cc:460] Webserver started at http://127.11.99.194:46509/ using document root <none> and password file <none>
I20260809 09:24:30.212669 24405 fs_manager.cc:359] Metadata directory not provided
I20260809 09:24:30.212749 24405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:24:30.212939 24405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 09:24:30 dist-test-slave-pgkr krb5kdc[23657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267470, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for HTTP/127.11.99.212@KRBTEST.COM
I20260809 09:24:30.227928 24405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-1/data/instance:
uuid: "8b7f84ee7d5341e9a67858be75d3e47d"
format_stamp: "Formatted at 2026-08-09 09:24:30 on dist-test-slave-pgkr"
server_key: "88dbcf590baf725c332df95e0f5fb5b3"
server_key_iv: "018a1a0be6d2024ff1a6573a9e590fb5"
server_key_version: "kuduclusterkey@0"
I20260809 09:24:30.228716 24405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance:
uuid: "8b7f84ee7d5341e9a67858be75d3e47d"
format_stamp: "Formatted at 2026-08-09 09:24:30 on dist-test-slave-pgkr"
server_key: "88dbcf590baf725c332df95e0f5fb5b3"
server_key_iv: "018a1a0be6d2024ff1a6573a9e590fb5"
server_key_version: "kuduclusterkey@0"
I20260809 09:24:30.236125 24405 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260809 09:24:30.259110 24425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:24:30.260792 24405 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260809 09:24:30.260922 24405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "8b7f84ee7d5341e9a67858be75d3e47d"
format_stamp: "Formatted at 2026-08-09 09:24:30 on dist-test-slave-pgkr"
server_key: "88dbcf590baf725c332df95e0f5fb5b3"
server_key_iv: "018a1a0be6d2024ff1a6573a9e590fb5"
server_key_version: "kuduclusterkey@0"
I20260809 09:24:30.261088 24405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:24:30.279068 24405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:24:30.282825 24405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:24:30.283042 24405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:24:30.283764 24405 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:24:30.284862 24405 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:24:30.284941 24405 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:24:30.285023 24405 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:24:30.285070 24405 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:24:30.298781 24405 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:35497
I20260809 09:24:30.299999 24405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:24:30.307560 24542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:35497 every 8 connection(s)
I20260809 09:24:30.308076 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 24405
I20260809 09:24:30.308210 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance
I20260809 09:24:30.308580 11663 external_mini_cluster.cc:1428] Setting key a2f1e573218558761907d37425759f99
WARNING: no policy specified for kudu/127.11.99.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.195@KRBTEST.COM" created.
Aug 09 09:24:30 dist-test-slave-pgkr krb5kdc[23657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267470, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:24:30.334863 24402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:24:30.315724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:55173 (local address 127.11.99.254:35473)
0809 09:24:30.315842 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 09:24:30.315847 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:24:30.318885 (+ 3038us) server_negotiation.cc:407] Connection header received
0809 09:24:30.320256 (+ 1371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:24:30.320259 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:24:30.320314 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:24:30.320367 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:24:30.322134 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:24:30.322899 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:24:30.324547 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:24:30.324877 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:24:30.324956 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:24:30.329819 (+ 4863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:24:30.329824 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:24:30.329829 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:24:30.329858 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:24:30.331603 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:24:30.332262 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:24:30.332266 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:24:30.332270 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:24:30.332357 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:24:30.332759 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:24:30.332765 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:24:30.332769 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:24:30.333009 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:24:30.333110 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 09:24:30.334368 (+ 1258us) server_negotiation.cc:299] Negotiation successful
0809 09:24:30.334526 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 09:24:30.336558 24546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:24:30.316247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:35473 (local address 127.11.99.194:55173)
0809 09:24:30.318731 (+ 2484us) negotiation.cc:107] Waiting for socket to connect
0809 09:24:30.318787 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 09:24:30.320024 (+ 1237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:24:30.320790 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:24:30.320800 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:24:30.321271 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:24:30.321955 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:24:30.321975 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:24:30.323067 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:24:30.323071 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:24:30.324404 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:24:30.324415 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:24:30.325178 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:24:30.325183 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:24:30.325383 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:24:30.327783 (+ 2400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:24:30.327807 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:24:30.329633 (+ 1826us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:24:30.331742 (+ 2109us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:24:30.331751 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:24:30.331767 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:24:30.332127 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:24:30.332471 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:24:30.332477 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:24:30.332478 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:24:30.332649 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:24:30.333199 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:24:30.333208 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:24:30.334044 (+ 836us) client_negotiation.cc:769] Sending connection context
0809 09:24:30.335109 (+ 1065us) client_negotiation.cc:240] Negotiation successful
0809 09:24:30.335450 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2218,"thread_start_us":229,"threads_started":1}
I20260809 09:24:30.337812 24543 heartbeater.cc:347] Connected to a master server at 127.11.99.254:35473
I20260809 09:24:30.338044 24543 heartbeater.cc:464] Registering TS with master...
I20260809 09:24:30.338531 24543 heartbeater.cc:511] Master 127.11.99.254:35473 requested a full tablet report, sending...
I20260809 09:24:30.339653 24169 ts_manager.cc:194] Registered new tserver with Master: 8b7f84ee7d5341e9a67858be75d3e47d (127.11.99.194:35497)
I20260809 09:24:30.340315 24169 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.194@KRBTEST.COM'} at 127.11.99.194:55173
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
I20260809 09:24:30.343809 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.99.212:49827/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:0
--local_ip_for_outbound_sockets=127.11.99.195
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:35473
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:34723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:24:30.495775 24548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:24:30.496124 24548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:24:30.496202 24548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:24:30.501942 24548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:24:30.502027 24548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:24:30.502115 24548 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:24:30.509845 24548 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:34723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.99.212:49827/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:35473
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24548
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:24:30.511220 24548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:24:30.512621 24548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:24:30.525206 24556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:24:30.525523 24554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:24:30.526795 24553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:24:30.526859 24548 server_base.cc:1034] running on GCE node
I20260809 09:24:30.527346 24548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:24:30.528187 24548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:24:30.529400 24548 hybrid_clock.cc:648] HybridClock initialized: now 1786267470529371 us; error 41 us; skew 500 ppm
Aug 09 09:24:30 dist-test-slave-pgkr krb5kdc[23657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267470, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:24:30.533349 24548 init.cc:377] Logged in from keytab as kudu/127.11.99.195@KRBTEST.COM (short username kudu)
I20260809 09:24:30.534588 24548 webserver.cc:460] Webserver started at http://127.11.99.195:35949/ using document root <none> and password file <none>
I20260809 09:24:30.535488 24548 fs_manager.cc:359] Metadata directory not provided
I20260809 09:24:30.535585 24548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:24:30.535842 24548 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 09:24:30 dist-test-slave-pgkr krb5kdc[23657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267470, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for HTTP/127.11.99.212@KRBTEST.COM
I20260809 09:24:30.553807 24548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-2/data/instance:
uuid: "8a0ef728a50b4d7488525b9cdc4aff9a"
format_stamp: "Formatted at 2026-08-09 09:24:30 on dist-test-slave-pgkr"
server_key: "a9f8e26a9fda18649a4290a9f81ab639"
server_key_iv: "41a860501de3c8051713a352decaef7b"
server_key_version: "kuduclusterkey@0"
I20260809 09:24:30.555162 24548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance:
uuid: "8a0ef728a50b4d7488525b9cdc4aff9a"
format_stamp: "Formatted at 2026-08-09 09:24:30 on dist-test-slave-pgkr"
server_key: "a9f8e26a9fda18649a4290a9f81ab639"
server_key_iv: "41a860501de3c8051713a352decaef7b"
server_key_version: "kuduclusterkey@0"
I20260809 09:24:30.562433 24548 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.001s
I20260809 09:24:30.595080 24563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:24:30.596891 24548 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.000s sys 0.003s
I20260809 09:24:30.597028 24548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "8a0ef728a50b4d7488525b9cdc4aff9a"
format_stamp: "Formatted at 2026-08-09 09:24:30 on dist-test-slave-pgkr"
server_key: "a9f8e26a9fda18649a4290a9f81ab639"
server_key_iv: "41a860501de3c8051713a352decaef7b"
server_key_version: "kuduclusterkey@0"
I20260809 09:24:30.597173 24548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:24:30.625590 24548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:24:30.633301 24548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:24:30.633530 24548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:24:30.634336 24548 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:24:30.635352 24548 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:24:30.635432 24548 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:24:30.635495 24548 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:24:30.635526 24548 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:24:30.652194 24548 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:42719
I20260809 09:24:30.653329 24548 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:24:30.658878 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 24548
I20260809 09:24:30.659016 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance
I20260809 09:24:30.659348 11663 external_mini_cluster.cc:1428] Setting key 83d2c840b5f0324eb068ba83d2309c13
I20260809 09:24:30.664016 24686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:42719 every 8 connection(s)
Aug 09 09:24:30 dist-test-slave-pgkr krb5kdc[23657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267470, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:24:30.689836 24402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:24:30.673895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:59285 (local address 127.11.99.254:35473)
0809 09:24:30.674029 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 09:24:30.674033 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:24:30.674338 (+ 305us) server_negotiation.cc:407] Connection header received
0809 09:24:30.675407 (+ 1069us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:24:30.675411 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:24:30.675464 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:24:30.675554 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:24:30.676795 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:24:30.677610 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:24:30.679177 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:24:30.679510 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:24:30.679577 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:24:30.682401 (+ 2824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:24:30.682404 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:24:30.682407 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:24:30.682431 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:24:30.687518 (+ 5087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:24:30.688125 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:24:30.688128 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:24:30.688130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:24:30.688215 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:24:30.688592 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:24:30.688595 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:24:30.688596 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:24:30.688822 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:24:30.688893 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 09:24:30.689556 (+ 663us) server_negotiation.cc:299] Negotiation successful
0809 09:24:30.689680 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 09:24:30.691356 24689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:24:30.672890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:35473 (local address 127.11.99.195:59285)
0809 09:24:30.674187 (+ 1297us) negotiation.cc:107] Waiting for socket to connect
0809 09:24:30.674240 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 09:24:30.675202 (+ 962us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:24:30.675721 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:24:30.675730 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:24:30.676053 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:24:30.676653 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:24:30.676670 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:24:30.677733 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:24:30.677737 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:24:30.679039 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:24:30.679051 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:24:30.679770 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:24:30.679773 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:24:30.679954 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:24:30.680634 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:24:30.680654 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:24:30.682232 (+ 1578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:24:30.687670 (+ 5438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:24:30.687676 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:24:30.687698 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:24:30.687994 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:24:30.688322 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:24:30.688324 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:24:30.688326 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:24:30.688486 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:24:30.688970 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:24:30.688976 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:24:30.689258 (+ 282us) client_negotiation.cc:769] Sending connection context
0809 09:24:30.690044 (+ 786us) client_negotiation.cc:240] Negotiation successful
0809 09:24:30.690362 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1080,"thread_start_us":124,"threads_started":1}
I20260809 09:24:30.696863 24687 heartbeater.cc:347] Connected to a master server at 127.11.99.254:35473
I20260809 09:24:30.697121 24687 heartbeater.cc:464] Registering TS with master...
I20260809 09:24:30.697733 24687 heartbeater.cc:511] Master 127.11.99.254:35473 requested a full tablet report, sending...
I20260809 09:24:30.698823 24169 ts_manager.cc:194] Registered new tserver with Master: 8a0ef728a50b4d7488525b9cdc4aff9a (127.11.99.195:42719)
I20260809 09:24:30.699489 24169 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.195@KRBTEST.COM'} at 127.11.99.195:59285
I20260809 09:24:30.707945 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 09:24:30.728046 24402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:24:30.715322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35776 (local address 127.11.99.254:35473)
0809 09:24:30.715427 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0809 09:24:30.715432 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:24:30.719305 (+ 3873us) server_negotiation.cc:407] Connection header received
0809 09:24:30.719475 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:24:30.719477 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:24:30.719522 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:24:30.719568 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:24:30.720530 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:24:30.721211 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:24:30.722295 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:24:30.722569 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:24:30.722689 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:24:30.724392 (+ 1703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:24:30.724396 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:24:30.724399 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:24:30.724429 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:24:30.726219 (+ 1790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:24:30.726733 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:24:30.726736 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:24:30.726738 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:24:30.726826 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:24:30.727125 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:24:30.727128 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:24:30.727129 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:24:30.727315 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:24:30.727407 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 09:24:30.727780 (+ 373us) server_negotiation.cc:299] Negotiation successful
0809 09:24:30.727890 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
Aug 09 09:24:30 dist-test-slave-pgkr krb5kdc[23657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267470, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for HTTP/127.11.99.212@KRBTEST.COM
I20260809 09:24:30.732120 24169 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35776:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 09:24:30.738116 24169 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:24:30.775110 24700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:24:30.756849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:34171 (local address 127.0.0.1:40746)
0809 09:24:30.769653 (+ 12804us) negotiation.cc:107] Waiting for socket to connect
0809 09:24:30.769667 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:24:30.769754 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:24:30.770453 (+ 699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:24:30.770457 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:24:30.770479 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:24:30.770573 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:24:30.770580 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:24:30.771896 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:24:30.771900 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:24:30.773185 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:24:30.773197 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:24:30.774475 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:24:30.774478 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:24:30.774639 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:24:30.774694 (+ 55us) client_negotiation.cc:769] Sending connection context
0809 09:24:30.774812 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 09:24:30.774938 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12735,"thread_start_us":89,"threads_started":1}
I20260809 09:24:30.775789 24706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:24:30.757013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40746 (local address 127.11.99.193:34171)
0809 09:24:30.760389 (+ 3376us) server_negotiation.cc:206] Beginning negotiation
0809 09:24:30.760396 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 09:24:30.769852 (+ 9456us) server_negotiation.cc:407] Connection header received
0809 09:24:30.769940 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:24:30.769945 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:24:30.770149 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:24:30.770296 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:24:30.770727 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:24:30.771741 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:24:30.773339 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:24:30.774162 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:24:30.774258 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:24:30.774418 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 09:24:30.775517 (+ 1099us) server_negotiation.cc:299] Negotiation successful
0809 09:24:30.775629 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3275,"thread_start_us":92,"threads_started":1}
I20260809 09:24:30.779003 24306 tablet_service.cc:1467] Processing CreateTablet for tablet 44e2259cc3ca49a6a0bb2a0f6ade5ca5 (DEFAULT_TABLE table=test-table [id=09724618fef24553961e737072fc0bc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:24:30.780213 24306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44e2259cc3ca49a6a0bb2a0f6ade5ca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:24:30.789338 24703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:24:30.756372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33606 (local address 127.11.99.194:35497)
0809 09:24:30.760192 (+ 3820us) server_negotiation.cc:206] Beginning negotiation
0809 09:24:30.760207 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 09:24:30.767341 (+ 7134us) server_negotiation.cc:407] Connection header received
0809 09:24:30.767425 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:24:30.767430 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:24:30.767675 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:24:30.767831 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:24:30.768309 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:24:30.769406 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:24:30.787460 (+ 18054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:24:30.788391 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:24:30.788483 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:24:30.788658 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 09:24:30.789052 (+ 394us) server_negotiation.cc:299] Negotiation successful
0809 09:24:30.789171 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1453,"thread_start_us":173,"threads_started":1}
I20260809 09:24:30.789873 24702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:24:30.756168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:35497 (local address 127.0.0.1:33606)
0809 09:24:30.767145 (+ 10977us) negotiation.cc:107] Waiting for socket to connect
0809 09:24:30.767159 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:24:30.767246 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:24:30.768012 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:24:30.768018 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:24:30.768041 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:24:30.768177 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:24:30.768184 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:24:30.769598 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:24:30.769602 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:24:30.787240 (+ 17638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:24:30.787256 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:24:30.788772 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:24:30.788776 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:24:30.788882 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:24:30.788905 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 09:24:30.789636 (+ 731us) client_negotiation.cc:240] Negotiation successful
0809 09:24:30.789730 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10903,"thread_start_us":88,"threads_started":1}
I20260809 09:24:30.793144 24468 tablet_service.cc:1467] Processing CreateTablet for tablet 44e2259cc3ca49a6a0bb2a0f6ade5ca5 (DEFAULT_TABLE table=test-table [id=09724618fef24553961e737072fc0bc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:24:30.794286 24468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44e2259cc3ca49a6a0bb2a0f6ade5ca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:24:30.798998 24708 tablet_bootstrap.cc:492] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 29f54ee51bf4422da9ec41115f3cb15c: Bootstrap starting.
I20260809 09:24:30.801388 24708 tablet_bootstrap.cc:654] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 29f54ee51bf4422da9ec41115f3cb15c: Neither blocks nor log segments found. Creating new log.
I20260809 09:24:30.802352 24708 log.cc:824] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 29f54ee51bf4422da9ec41115f3cb15c: Log is configured to *not* fsync() on all Append() calls
I20260809 09:24:30.805996 24705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:24:30.754518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:42719 (local address 127.0.0.1:52534)
0809 09:24:30.766663 (+ 12145us) negotiation.cc:107] Waiting for socket to connect
0809 09:24:30.766735 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0809 09:24:30.766875 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:24:30.777244 (+ 10369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:24:30.777248 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:24:30.777267 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:24:30.777358 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:24:30.777364 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:24:30.801670 (+ 24306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:24:30.801673 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:24:30.803080 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:24:30.803093 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:24:30.805570 (+ 2477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:24:30.805574 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:24:30.805692 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:24:30.805722 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 09:24:30.805775 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 09:24:30.805855 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2717,"thread_start_us":102,"threads_started":1}
I20260809 09:24:30.806979 24701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:24:30.755361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52534 (local address 127.11.99.195:42719)
0809 09:24:30.771729 (+ 16368us) server_negotiation.cc:206] Beginning negotiation
0809 09:24:30.772080 (+ 351us) server_negotiation.cc:399] Waiting for connection header
0809 09:24:30.772118 (+ 38us) server_negotiation.cc:407] Connection header received
0809 09:24:30.773357 (+ 1239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:24:30.773362 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:24:30.776725 (+ 3363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:24:30.777503 (+ 778us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:24:30.779978 (+ 2475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:24:30.782290 (+ 2312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:24:30.803292 (+ 21002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:24:30.804137 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:24:30.806491 (+ 2354us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:24:30.806683 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0809 09:24:30.806738 (+ 55us) server_negotiation.cc:299] Negotiation successful
0809 09:24:30.806832 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15995,"thread_start_us":115,"threads_started":1}
I20260809 09:24:30.810160 24617 tablet_service.cc:1467] Processing CreateTablet for tablet 44e2259cc3ca49a6a0bb2a0f6ade5ca5 (DEFAULT_TABLE table=test-table [id=09724618fef24553961e737072fc0bc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:24:30.811403 24617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44e2259cc3ca49a6a0bb2a0f6ade5ca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:24:30.820030 24710 tablet_bootstrap.cc:492] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8b7f84ee7d5341e9a67858be75d3e47d: Bootstrap starting.
I20260809 09:24:30.821028 24711 tablet_bootstrap.cc:492] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a: Bootstrap starting.
I20260809 09:24:30.822206 24708 tablet_bootstrap.cc:492] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 29f54ee51bf4422da9ec41115f3cb15c: No bootstrap required, opened a new log
I20260809 09:24:30.822423 24708 ts_tablet_manager.cc:1397] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 29f54ee51bf4422da9ec41115f3cb15c: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20260809 09:24:30.824110 24710 tablet_bootstrap.cc:654] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8b7f84ee7d5341e9a67858be75d3e47d: Neither blocks nor log segments found. Creating new log.
I20260809 09:24:30.824977 24710 log.cc:824] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8b7f84ee7d5341e9a67858be75d3e47d: Log is configured to *not* fsync() on all Append() calls
I20260809 09:24:30.826718 24708 raft_consensus.cc:348] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 29f54ee51bf4422da9ec41115f3cb15c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a0ef728a50b4d7488525b9cdc4aff9a" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 42719 } } peers { permanent_uuid: "8b7f84ee7d5341e9a67858be75d3e47d" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 35497 } } peers { permanent_uuid: "29f54ee51bf4422da9ec41115f3cb15c" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 34171 } }
I20260809 09:24:30.826996 24708 raft_consensus.cc:374] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 29f54ee51bf4422da9ec41115f3cb15c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:24:30.827030 24710 tablet_bootstrap.cc:492] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8b7f84ee7d5341e9a67858be75d3e47d: No bootstrap required, opened a new log
I20260809 09:24:30.827055 24708 raft_consensus.cc:729] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 29f54ee51bf4422da9ec41115f3cb15c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29f54ee51bf4422da9ec41115f3cb15c, State: Initialized, Role: FOLLOWER
I20260809 09:24:30.827255 24710 ts_tablet_manager.cc:1397] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8b7f84ee7d5341e9a67858be75d3e47d: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260809 09:24:30.827550 24711 tablet_bootstrap.cc:654] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a: Neither blocks nor log segments found. Creating new log.
I20260809 09:24:30.827595 24708 consensus_queue.cc:260] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 29f54ee51bf4422da9ec41115f3cb15c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a0ef728a50b4d7488525b9cdc4aff9a" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 42719 } } peers { permanent_uuid: "8b7f84ee7d5341e9a67858be75d3e47d" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 35497 } } peers { permanent_uuid: "29f54ee51bf4422da9ec41115f3cb15c" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 34171 } }
I20260809 09:24:30.828488 24711 log.cc:824] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a: Log is configured to *not* fsync() on all Append() calls
I20260809 09:24:30.828709 24708 ts_tablet_manager.cc:1428] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 29f54ee51bf4422da9ec41115f3cb15c: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260809 09:24:30.829048 24397 heartbeater.cc:503] Master 127.11.99.254:35473 was elected leader, sending a full tablet report...
I20260809 09:24:30.833796 24710 raft_consensus.cc:348] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8b7f84ee7d5341e9a67858be75d3e47d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a0ef728a50b4d7488525b9cdc4aff9a" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 42719 } } peers { permanent_uuid: "8b7f84ee7d5341e9a67858be75d3e47d" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 35497 } } peers { permanent_uuid: "29f54ee51bf4422da9ec41115f3cb15c" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 34171 } }
I20260809 09:24:30.834044 24710 raft_consensus.cc:374] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8b7f84ee7d5341e9a67858be75d3e47d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:24:30.834115 24710 raft_consensus.cc:729] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8b7f84ee7d5341e9a67858be75d3e47d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7f84ee7d5341e9a67858be75d3e47d, State: Initialized, Role: FOLLOWER
I20260809 09:24:30.834643 24710 consensus_queue.cc:260] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8b7f84ee7d5341e9a67858be75d3e47d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a0ef728a50b4d7488525b9cdc4aff9a" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 42719 } } peers { permanent_uuid: "8b7f84ee7d5341e9a67858be75d3e47d" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 35497 } } peers { permanent_uuid: "29f54ee51bf4422da9ec41115f3cb15c" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 34171 } }
I20260809 09:24:30.835624 24710 ts_tablet_manager.cc:1428] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8b7f84ee7d5341e9a67858be75d3e47d: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260809 09:24:30.835981 24543 heartbeater.cc:503] Master 127.11.99.254:35473 was elected leader, sending a full tablet report...
I20260809 09:24:30.844246 24711 tablet_bootstrap.cc:492] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a: No bootstrap required, opened a new log
I20260809 09:24:30.844470 24711 ts_tablet_manager.cc:1397] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20260809 09:24:30.848731 24711 raft_consensus.cc:348] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a0ef728a50b4d7488525b9cdc4aff9a" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 42719 } } peers { permanent_uuid: "8b7f84ee7d5341e9a67858be75d3e47d" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 35497 } } peers { permanent_uuid: "29f54ee51bf4422da9ec41115f3cb15c" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 34171 } }
I20260809 09:24:30.849011 24711 raft_consensus.cc:374] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:24:30.849076 24711 raft_consensus.cc:729] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a0ef728a50b4d7488525b9cdc4aff9a, State: Initialized, Role: FOLLOWER
I20260809 09:24:30.849632 24711 consensus_queue.cc:260] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a0ef728a50b4d7488525b9cdc4aff9a" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 42719 } } peers { permanent_uuid: "8b7f84ee7d5341e9a67858be75d3e47d" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 35497 } } peers { permanent_uuid: "29f54ee51bf4422da9ec41115f3cb15c" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 34171 } }
I20260809 09:24:30.850759 24711 ts_tablet_manager.cc:1428] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260809 09:24:30.851099 24687 heartbeater.cc:503] Master 127.11.99.254:35473 was elected leader, sending a full tablet report...
W20260809 09:24:30.922451 24688 tablet.cc:2369] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 09:24:31.003247 24398 tablet.cc:2369] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 29f54ee51bf4422da9ec41115f3cb15c: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 09:24:31 dist-test-slave-pgkr krb5kdc[23657](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267470, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for HTTP/127.11.99.212@KRBTEST.COM
W20260809 09:24:31.068216 24544 tablet.cc:2369] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8b7f84ee7d5341e9a67858be75d3e47d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:24:31.143651 24717 raft_consensus.cc:482] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:24:31.143896 24717 raft_consensus.cc:504] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a0ef728a50b4d7488525b9cdc4aff9a" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 42719 } } peers { permanent_uuid: "8b7f84ee7d5341e9a67858be75d3e47d" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 35497 } } peers { permanent_uuid: "29f54ee51bf4422da9ec41115f3cb15c" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 34171 } }
I20260809 09:24:31.145378 24717 leader_election.cc:288] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b7f84ee7d5341e9a67858be75d3e47d (127.11.99.194:35497), 29f54ee51bf4422da9ec41115f3cb15c (127.11.99.193:34171)
I20260809 09:24:31.150820 24689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:24:31.145663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:35497 (local address 127.11.99.195:41221)
0809 09:24:31.145991 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0809 09:24:31.146006 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:24:31.146100 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:24:31.147052 (+ 952us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:24:31.147055 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:24:31.147073 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:24:31.147210 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:24:31.147218 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:24:31.148298 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:24:31.148302 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:24:31.149501 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:24:31.149512 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:24:31.150401 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:24:31.150404 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:24:31.150498 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:24:31.150522 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 09:24:31.150592 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 09:24:31.150689 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244}
I20260809 09:24:31.151914 24703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:24:31.146272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:41221 (local address 127.11.99.194:35497)
0809 09:24:31.146567 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0809 09:24:31.146571 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:24:31.146584 (+ 13us) server_negotiation.cc:407] Connection header received
0809 09:24:31.146787 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:24:31.146791 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:24:31.146846 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:24:31.146925 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:24:31.147348 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:24:31.148164 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:24:31.149641 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:24:31.150177 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:24:31.150290 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:24:31.150343 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 09:24:31.151706 (+ 1363us) server_negotiation.cc:299] Negotiation successful
0809 09:24:31.151790 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222}
I20260809 09:24:31.152598 24486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44e2259cc3ca49a6a0bb2a0f6ade5ca5" candidate_uuid: "8a0ef728a50b4d7488525b9cdc4aff9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7f84ee7d5341e9a67858be75d3e47d" is_pre_election: true
I20260809 09:24:31.152930 24486 raft_consensus.cc:2454] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8b7f84ee7d5341e9a67858be75d3e47d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a0ef728a50b4d7488525b9cdc4aff9a in term 0.
I20260809 09:24:31.153541 24567 leader_election.cc:302] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a0ef728a50b4d7488525b9cdc4aff9a, 8b7f84ee7d5341e9a67858be75d3e47d; no voters:
I20260809 09:24:31.153842 24717 raft_consensus.cc:2781] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:24:31.153940 24717 raft_consensus.cc:482] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:24:31.153988 24717 raft_consensus.cc:3037] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:24:31.155520 24717 raft_consensus.cc:504] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a0ef728a50b4d7488525b9cdc4aff9a" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 42719 } } peers { permanent_uuid: "8b7f84ee7d5341e9a67858be75d3e47d" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 35497 } } peers { permanent_uuid: "29f54ee51bf4422da9ec41115f3cb15c" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 34171 } }
I20260809 09:24:31.155864 24717 leader_election.cc:288] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a [CANDIDATE]: Term 1 election: Requested vote from peers 8b7f84ee7d5341e9a67858be75d3e47d (127.11.99.194:35497), 29f54ee51bf4422da9ec41115f3cb15c (127.11.99.193:34171)
I20260809 09:24:31.156353 24486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44e2259cc3ca49a6a0bb2a0f6ade5ca5" candidate_uuid: "8a0ef728a50b4d7488525b9cdc4aff9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b7f84ee7d5341e9a67858be75d3e47d"
I20260809 09:24:31.156473 24486 raft_consensus.cc:3037] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8b7f84ee7d5341e9a67858be75d3e47d [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:24:31.157799 24486 raft_consensus.cc:2454] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8b7f84ee7d5341e9a67858be75d3e47d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a0ef728a50b4d7488525b9cdc4aff9a in term 1.
I20260809 09:24:31.158174 24567 leader_election.cc:302] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a0ef728a50b4d7488525b9cdc4aff9a, 8b7f84ee7d5341e9a67858be75d3e47d; no voters:
I20260809 09:24:31.158416 24717 raft_consensus.cc:2781] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:24:31.158671 24717 raft_consensus.cc:686] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a [term 1 LEADER]: Becoming Leader. State: Replica: 8a0ef728a50b4d7488525b9cdc4aff9a, State: Running, Role: LEADER
I20260809 09:24:31.159024 24717 consensus_queue.cc:237] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a0ef728a50b4d7488525b9cdc4aff9a" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 42719 } } peers { permanent_uuid: "8b7f84ee7d5341e9a67858be75d3e47d" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 35497 } } peers { permanent_uuid: "29f54ee51bf4422da9ec41115f3cb15c" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 34171 } }
I20260809 09:24:31.162477 24169 catalog_manager.cc:5495] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a0ef728a50b4d7488525b9cdc4aff9a (127.11.99.195). New cstate: current_term: 1 leader_uuid: "8a0ef728a50b4d7488525b9cdc4aff9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a0ef728a50b4d7488525b9cdc4aff9a" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 42719 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b7f84ee7d5341e9a67858be75d3e47d" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 35497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29f54ee51bf4422da9ec41115f3cb15c" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 34171 } health_report { overall_health: UNKNOWN } } }
I20260809 09:24:31.164763 24689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:24:31.145733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:34171 (local address 127.11.99.195:33813)
0809 09:24:31.150982 (+ 5249us) negotiation.cc:107] Waiting for socket to connect
0809 09:24:31.150995 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:24:31.151082 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:24:31.161060 (+ 9978us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:24:31.161063 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:24:31.161084 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:24:31.161171 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:24:31.161177 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:24:31.162296 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:24:31.162299 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:24:31.163398 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:24:31.163410 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:24:31.164373 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:24:31.164379 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:24:31.164471 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:24:31.164497 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 09:24:31.164557 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 09:24:31.164619 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5199,"thread_start_us":87,"threads_started":1}
I20260809 09:24:31.165148 24706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:24:31.146442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:33813 (local address 127.11.99.193:34171)
0809 09:24:31.146745 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0809 09:24:31.146749 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:24:31.151277 (+ 4528us) server_negotiation.cc:407] Connection header received
0809 09:24:31.151336 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:24:31.151340 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:24:31.151388 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:24:31.151459 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:24:31.161316 (+ 9857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:24:31.162125 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:24:31.163543 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:24:31.164134 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:24:31.164244 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:24:31.164290 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 09:24:31.164965 (+ 675us) server_negotiation.cc:299] Negotiation successful
0809 09:24:31.165041 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227}
I20260809 09:24:31.165891 24349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44e2259cc3ca49a6a0bb2a0f6ade5ca5" candidate_uuid: "8a0ef728a50b4d7488525b9cdc4aff9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29f54ee51bf4422da9ec41115f3cb15c" is_pre_election: true
I20260809 09:24:31.166173 24349 raft_consensus.cc:2454] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 29f54ee51bf4422da9ec41115f3cb15c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a0ef728a50b4d7488525b9cdc4aff9a in term 0.
I20260809 09:24:31.166501 24347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44e2259cc3ca49a6a0bb2a0f6ade5ca5" candidate_uuid: "8a0ef728a50b4d7488525b9cdc4aff9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29f54ee51bf4422da9ec41115f3cb15c"
I20260809 09:24:31.166636 24347 raft_consensus.cc:3037] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 29f54ee51bf4422da9ec41115f3cb15c [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:24:31.168020 24347 raft_consensus.cc:2454] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 29f54ee51bf4422da9ec41115f3cb15c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a0ef728a50b4d7488525b9cdc4aff9a in term 1.
I20260809 09:24:31.227726 24701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:24:31.222542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52548 (local address 127.11.99.195:42719)
0809 09:24:31.222699 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 09:24:31.222705 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:24:31.222725 (+ 20us) server_negotiation.cc:407] Connection header received
0809 09:24:31.222948 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:24:31.222952 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:24:31.223036 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:24:31.223137 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:24:31.223551 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:24:31.224264 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:24:31.225404 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:24:31.225729 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:24:31.225825 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:24:31.226283 (+ 458us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:24:31.226871 (+ 588us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:24:31.227025 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 09:24:31.227478 (+ 453us) server_negotiation.cc:299] Negotiation successful
0809 09:24:31.227543 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 09:24:31.234714 24347 raft_consensus.cc:1261] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 29f54ee51bf4422da9ec41115f3cb15c [term 1 FOLLOWER]: Refusing update from remote peer 8a0ef728a50b4d7488525b9cdc4aff9a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:24:31.235513 24721 consensus_queue.cc:1035] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "29f54ee51bf4422da9ec41115f3cb15c" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 34171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:24:31.242000 24486 raft_consensus.cc:1261] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8b7f84ee7d5341e9a67858be75d3e47d [term 1 FOLLOWER]: Refusing update from remote peer 8a0ef728a50b4d7488525b9cdc4aff9a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:24:31.242821 24721 consensus_queue.cc:1035] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b7f84ee7d5341e9a67858be75d3e47d" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:24:31.265861 24724 mvcc.cc:205] Tried to move back new op lower bound from 7316551562169683968 to 7316551561870663680. Current Snapshot: MvccSnapshot[applied={T|T < 7316551562169683968}]
I20260809 09:24:31.266074 24727 mvcc.cc:205] Tried to move back new op lower bound from 7316551562169683968 to 7316551561870663680. Current Snapshot: MvccSnapshot[applied={T|T < 7316551562169683968}]
I20260809 09:24:31.266458 24725 mvcc.cc:205] Tried to move back new op lower bound from 7316551562169683968 to 7316551561870663680. Current Snapshot: MvccSnapshot[applied={T|T < 7316551562169683968}]
I20260809 09:24:31.280805 24169 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35776:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:24:31.281028 24169 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35776:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:24:31.284094 24169 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d243bb4bf5b14c86971e1f6979d01db6: Sending DeleteTablet for 3 replicas of tablet 44e2259cc3ca49a6a0bb2a0f6ade5ca5
I20260809 09:24:31.284997 24468 tablet_service.cc:1514] Processing DeleteTablet for tablet 44e2259cc3ca49a6a0bb2a0f6ade5ca5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:24:31 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:33606
I20260809 09:24:31.285338 24617 tablet_service.cc:1514] Processing DeleteTablet for tablet 44e2259cc3ca49a6a0bb2a0f6ade5ca5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:24:31 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:52534
I20260809 09:24:31.285579 24306 tablet_service.cc:1514] Processing DeleteTablet for tablet 44e2259cc3ca49a6a0bb2a0f6ade5ca5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:24:31 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:40746
I20260809 09:24:31.286773 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 24256
I20260809 09:24:31.299088 24736 tablet_replica.cc:330] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8b7f84ee7d5341e9a67858be75d3e47d: stopping tablet replica
I20260809 09:24:31.299403 24737 tablet_replica.cc:330] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a: stopping tablet replica
I20260809 09:24:31.299878 24737 raft_consensus.cc:2229] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a [term 1 LEADER]: Raft consensus shutting down.
I20260809 09:24:31.300282 24736 raft_consensus.cc:2229] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8b7f84ee7d5341e9a67858be75d3e47d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:24:31.300839 24737 raft_consensus.cc:2258] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:24:31.301278 24736 raft_consensus.cc:2258] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8b7f84ee7d5341e9a67858be75d3e47d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:24:31.306967 24737 ts_tablet_manager.cc:1905] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:24:31.307718 24736 ts_tablet_manager.cc:1905] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8b7f84ee7d5341e9a67858be75d3e47d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:24:31.314131 24737 ts_tablet_manager.cc:1918] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:24:31.314790 24736 ts_tablet_manager.cc:1918] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8b7f84ee7d5341e9a67858be75d3e47d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260809 09:24:31.315237 24155 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.99.193:34171 (error 108)
I20260809 09:24:31.316180 24737 log.cc:1196] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/44e2259cc3ca49a6a0bb2a0f6ade5ca5
I20260809 09:24:31.316584 24736 log.cc:1196] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8b7f84ee7d5341e9a67858be75d3e47d: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/44e2259cc3ca49a6a0bb2a0f6ade5ca5
I20260809 09:24:31.317025 24737 ts_tablet_manager.cc:1939] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8a0ef728a50b4d7488525b9cdc4aff9a: Deleting consensus metadata
I20260809 09:24:31.317418 24736 ts_tablet_manager.cc:1939] T 44e2259cc3ca49a6a0bb2a0f6ade5ca5 P 8b7f84ee7d5341e9a67858be75d3e47d: Deleting consensus metadata
I20260809 09:24:31.317674 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 24405
I20260809 09:24:31.321549 24155 catalog_manager.cc:4841] TS 8a0ef728a50b4d7488525b9cdc4aff9a (127.11.99.195:42719): tablet 44e2259cc3ca49a6a0bb2a0f6ade5ca5 (table test-table [id=09724618fef24553961e737072fc0bc0]) successfully deleted
I20260809 09:24:31.331568 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 24548
I20260809 09:24:31.332762 24744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:24:31.327500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:34171 (local address 127.0.0.1:40754)
0809 09:24:31.332534 (+ 5034us) negotiation.cc:107] Waiting for socket to connect
0809 09:24:31.332630 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.193:34171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4924,"thread_start_us":86,"threads_started":1}
W20260809 09:24:31.332922 24155 catalog_manager.cc:4584] TS 29f54ee51bf4422da9ec41115f3cb15c (127.11.99.193:34171): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 44e2259cc3ca49a6a0bb2a0f6ade5ca5: Network error: Client connection negotiation failed: client connection to 127.11.99.193:34171: connect: Connection refused (error 111)
W20260809 09:24:31.333288 24746 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:24:31.330898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:35497 (local address 127.0.0.1:33618)
0809 09:24:31.333147 (+ 2249us) negotiation.cc:107] Waiting for socket to connect
0809 09:24:31.333200 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.194:35497: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":2114,"thread_start_us":65,"threads_started":1}
I20260809 09:24:31.342887 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 24134
I20260809 09:24:31.354324 11663 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 09:24:31.699288 11663 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 09:24:31.699412 11663 mini_ranger.cc:66] Stopping Ranger...
I20260809 09:24:32.043273 11663 mini_ranger.cc:68] Stopped Ranger
2026-08-09 09:24:32.043 UTC [23690] LOG: received smart shutdown request
2026-08-09 09:24:32.047 UTC [23690] LOG: background worker "logical replication launcher" (PID 23700) exited with exit code 1
2026-08-09 09:24:32.047 UTC [23695] LOG: shutting down
2026-08-09 09:24:32.186 UTC [23690] LOG: database system is shut down
2026-08-09T09:24:32Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (47869 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:24:32 dist-test-slave-pgkr krb5kdc[24755](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:24:32 dist-test-slave-pgkr krb5kdc[24755](info): set up 2 sockets
Aug 09 09:24:32 dist-test-slave-pgkr krb5kdc[24755](info): commencing operation
krb5kdc: starting...
W20260809 09:24:33.401962 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.067s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:24:33 dist-test-slave-pgkr krb5kdc[24755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267473, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:24:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:24:33Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.99.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.99.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.99.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/rangeradmin_127.11.99.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.99.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/rangeradmin_127.11.99.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.99.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.99.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.99.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/rangerlookup_127.11.99.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.99.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/rangerlookup_127.11.99.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.99.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.99.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.99.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/HTTP_127.11.99.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.99.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/HTTP_127.11.99.212@KRBTEST.COM.keytab.
I20260809 09:24:33.560804 11663 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskv_EQJC/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/postgres -l logfile start
2026-08-09 09:24:35.750 UTC [24785] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 09:24:35.750 UTC [24785] LOG: listening on IPv4 address "127.11.99.212", port 33965
2026-08-09 09:24:35.753 UTC [24785] LOG: listening on Unix socket "/tmp/.s.PGSQL.33965"
2026-08-09 09:24:35.773 UTC [24788] LOG: database system was shut down at 2026-08-09 09:24:34 UTC
2026-08-09 09:24:35.776 UTC [24785] LOG: database system is ready to accept connections
I20260809 09:24:36.728600 11663 mini_postgres.cc:96] Postgres bound to 33965
2026-08-09 09:24:36.735 UTC [24797] FATAL: database "slave" does not exist
127.11.99.212:33965 - accepting connections
I20260809 09:24:36.736251 11663 mini_ranger.cc:161] Starting Ranger...
I20260809 09:24:36.751085 11663 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 09:24:37.164659 11663 mini_ranger.cc:87] Created ranger Postgres database
I20260809 09:24:37.164758 11663 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ranger-admin
2026-08-09 09:24:37,446 [I] DB FLAVOR :POSTGRES
2026-08-09 09:24:37,446 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 09:24:37,446 [I] Checking connection..
2026-08-09 09:24:37,446 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:33965/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 09:24:37,676 [I] Checking connection passed.
2026-08-09 09:24:37,676 [I] --------- Verifying version history table ---------
2026-08-09 09:24:37,676 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:33965/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 09:24:37,939 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 09:24:37,939 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:33965/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 09:24:38,185 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 09:24:38,185 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 09:24:38,186 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:33965/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 09:24:38.413 UTC [24864] WARNING: there is no transaction in progress
2026-08-09 09:24:38,419 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 09:24:38,420 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:33965/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 09:24:38,665 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 09:24:38,665 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 09:24:38,665 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:33965/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 09:24:38,900 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:33965/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 09:24:39,134 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:33965/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-pgkr.c.gcp-upstream.internal','N') ;"
2026-08-09 09:24:39,377 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:33965/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 09:24:39,635 [I] Table x_portal_user does not exist in database ranger
2026-08-09 09:24:39,636 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:33965/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 09:24:39,884 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 09:24:39,884 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:33965/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 09:24:40,111 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:33965/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 09:24:40,354 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 09:24:40,354 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:33965/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 09:24:41.235 UTC [24983] WARNING: there is no transaction in progress
2026-08-09 09:24:41.252 UTC [24983] WARNING: there is no transaction in progress
2026-08-09 09:24:41.266 UTC [24983] WARNING: there is no transaction in progress
2026-08-09 09:24:41.280 UTC [24983] WARNING: there is no transaction in progress
2026-08-09 09:24:41.294 UTC [24983] WARNING: there is no transaction in progress
2026-08-09 09:24:41.310 UTC [24983] WARNING: there is no transaction in progress
2026-08-09 09:24:41.367 UTC [24983] WARNING: there is no transaction in progress
2026-08-09 09:24:41.374 UTC [24983] WARNING: there is no transaction in progress
2026-08-09 09:24:41.388 UTC [24983] WARNING: there is no transaction in progress
2026-08-09 09:24:41.397 UTC [24983] WARNING: there is no transaction in progress
2026-08-09 09:24:41.407 UTC [24983] WARNING: there is no transaction in progress
2026-08-09 09:24:41.419 UTC [24983] WARNING: there is no transaction in progress
2026-08-09 09:24:41.428 UTC [24983] WARNING: there is no transaction in progress
2026-08-09 09:24:41.433 UTC [24983] WARNING: there is no transaction in progress
2026-08-09 09:24:41.439 UTC [24983] WARNING: there is no transaction in progress
2026-08-09 09:24:41.445 UTC [24983] WARNING: there is no transaction in progress
2026-08-09 09:24:42,009 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 09:24:42,009 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:33965/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 09:24:42,259 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 09:24:42,259 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:33965/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 09:24:42,493 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 09:24:42,494 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:33965/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 09:24:42,732 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 09:24:42,733 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:33965/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 09:24:42,985 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:33965/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 09:24:43,220 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:33965/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-pgkr.c.gcp-upstream.internal';"
2026-08-09 09:24:43,434 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 09:24:43,435 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:33965/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 09:24:43,667 [I] DB_PATCHES have already been applied
I20260809 09:24:43.672940 11663 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ranger-admin:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskv_EQJC/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 09:24:43.673015 11663 mini_ranger.cc:193] Using host: 127.11.99.212
I20260809 09:24:43.677071 11663 mini_ranger.cc:227] Ranger admin URL: http://127.11.99.212:39855
Aug 09, 2026 9:24:43 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 9:24:43 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 9:24:44 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 9:24:44 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 9:24:44 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 9:24:44 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 9:24:44 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 09:24:44.814431 11663 mini_ranger.cc:160] Time spent starting Ranger: real 8.078s user 0.000s sys 0.010s
Aug 09, 2026 9:25:04 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 9:25:04 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 09, 2026 9:25:04 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 9:25:04 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 9:25:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 9:25:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 9:25:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 9:25:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 9:25:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 9:25:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 9:25:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 9:25:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 9:25:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 9:25:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 9:25:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 9:25:04 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 9:25:04 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 9:25:05 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 09:25:06.289361 11663 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.99.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.99.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.99.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/rangerkms_127.11.99.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.99.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/rangerkms_127.11.99.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.99.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.99.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.99.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/HTTP_127.11.99.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.99.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/HTTP_127.11.99.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 09:25:06 dist-test-slave-pgkr krb5kdc[24755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267506, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 09:25:06.374897 11663 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 09:25:06.383827 11663 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 09:25:07.119117 11663 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 09:25:07.119216 11663 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ranger-kms
I20260809 09:25:07.119235 11663 mini_ranger_kms.cc:227] Using postgres at 127.11.99.212:33965
2026-08-09 09:25:07,308 [I] DB FLAVOR :POSTGRES
2026-08-09 09:25:07,308 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 09:25:07,308 [I] Checking connection
2026-08-09 09:25:07,308 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:33965/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 09:25:07,528 [I] connection success
2026-08-09 09:25:07,528 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 09:25:07,528 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 09:25:07,529 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:33965/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 09:25:07,763 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 09:25:07,763 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 09:25:07,763 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 09:25:07,763 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.99.212:33965/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 09:25:08,024 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 09:25:08.459244 11663 mini_ranger_kms.cc:310] Created kms service
I20260809 09:25:08.653571 11663 mini_ranger_kms.cc:326] Created kudu user
I20260809 09:25:08.696610 11663 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 09:25:08 dist-test-slave-pgkr krb5kdc[24755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267506, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.99.212@KRBTEST.COM
I20260809 09:25:09.081153 11663 mini_ranger_kms.cc:384] Added ranger policy
I20260809 09:25:09.081333 11663 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ranger-kms:/tmp/dist-test-taskv_EQJC/build/debug/bin/postgresql.jar:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskv_EQJC/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 09:25:09.081353 11663 mini_ranger_kms.cc:240] Using host: 127.11.99.212
I20260809 09:25:09.085610 11663 mini_ranger_kms.cc:276] Ranger KMS PID: 25177
I20260809 09:25:09.085695 11663 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.99.212:33031
Aug 09, 2026 9:25:09 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 9:25:09 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 9:25:10 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 9:25:10 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 9:25:10 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 9:25:10 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 09:25:11 dist-test-slave-pgkr krb5kdc[24755](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786267511, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.99.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:11.344403 11663 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 4.970s user 0.000s sys 0.173s
I20260809 09:25:11.344547 11663 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 09:25:11.344625 11663 mini_ranger_kms.cc:401] 127.11.99.212:33031/kms/v1/keys
Aug 09 09:25:11 dist-test-slave-pgkr krb5kdc[24755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267511, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.99.212@KRBTEST.COM for HTTP/127.11.99.212@KRBTEST.COM
Aug 09 09:25:11 dist-test-slave-pgkr krb5kdc[24755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267511, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.99.212@KRBTEST.COM for HTTP/127.11.99.212@KRBTEST.COM
Aug 09 09:25:14 dist-test-slave-pgkr krb5kdc[24755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267514, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:25:14.251534 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:46659
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:42055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:46659
--ranger_config_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.99.212:33031/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:25:14.358846 25233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:14.359107 25233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:14.359145 25233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:14.363063 25233 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:25:14.363116 25233 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:14.363134 25233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:14.363149 25233 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:25:14.363206 25233 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:25:14.368461 25233 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:42055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.99.212:33031/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:46659
--ranger_config_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:46659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25233
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:14.369438 25233 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:14.370404 25233 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 09:25:14.378866 25233 server_base.cc:1034] running on GCE node
W20260809 09:25:14.378825 25238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:14.378825 25239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:14.379076 25241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:14.379612 25233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:14.380769 25233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:14.381946 25233 hybrid_clock.cc:648] HybridClock initialized: now 1786267514381923 us; error 41 us; skew 500 ppm
Aug 09 09:25:14 dist-test-slave-pgkr krb5kdc[24755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267514, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:14.384786 25233 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:25:14.385651 25233 webserver.cc:460] Webserver started at http://127.11.99.254:41707/ using document root <none> and password file <none>
I20260809 09:25:14.386152 25233 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:14.386210 25233 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:25:14.386417 25233 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 09:25:14 dist-test-slave-pgkr krb5kdc[24755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267514, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for HTTP/127.11.99.212@KRBTEST.COM
I20260809 09:25:14.433508 25233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "0e99e65fdea24000b94200f253300ad7"
format_stamp: "Formatted at 2026-08-09 09:25:14 on dist-test-slave-pgkr"
server_key: "349f56728e6d629ed837b4a98e1f429d"
server_key_iv: "ef4558672b88893e64bb9a01f1089b7e"
server_key_version: "kuduclusterkey@0"
I20260809 09:25:14.434252 25233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "0e99e65fdea24000b94200f253300ad7"
format_stamp: "Formatted at 2026-08-09 09:25:14 on dist-test-slave-pgkr"
server_key: "349f56728e6d629ed837b4a98e1f429d"
server_key_iv: "ef4558672b88893e64bb9a01f1089b7e"
server_key_version: "kuduclusterkey@0"
I20260809 09:25:14.438333 25233 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 09:25:14.452297 25248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:14.453749 25233 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 09:25:14.453917 25233 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "0e99e65fdea24000b94200f253300ad7"
format_stamp: "Formatted at 2026-08-09 09:25:14 on dist-test-slave-pgkr"
server_key: "349f56728e6d629ed837b4a98e1f429d"
server_key_iv: "ef4558672b88893e64bb9a01f1089b7e"
server_key_version: "kuduclusterkey@0"
I20260809 09:25:14.454067 25233 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:14.474488 25233 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:14.477543 25233 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:14.478055 25233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:14.485594 25233 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:46659
I20260809 09:25:14.485595 25302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:46659 every 8 connection(s)
I20260809 09:25:14.486584 25233 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:25:14.488267 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 25233
I20260809 09:25:14.488407 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:25:14.488723 11663 external_mini_cluster.cc:1428] Setting key 1eb57c58a44748b4f21d9e83a43568b7
I20260809 09:25:14.489816 25303 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:25:14.496133 25303 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7: Bootstrap starting.
I20260809 09:25:14.498842 25303 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7: Neither blocks nor log segments found. Creating new log.
Aug 09 09:25:14 dist-test-slave-pgkr krb5kdc[24755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267514, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:25:14.499629 25303 log.cc:824] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7: Log is configured to *not* fsync() on all Append() calls
I20260809 09:25:14.501933 25303 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7: No bootstrap required, opened a new log
I20260809 09:25:14.504879 25306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:14.490079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45994 (local address 127.11.99.254:46659)
0809 09:25:14.490541 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:14.490559 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:14.490601 (+ 42us) server_negotiation.cc:407] Connection header received
0809 09:25:14.491451 (+ 850us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:14.491471 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:14.491851 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:14.492182 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:14.493209 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:14.494686 (+ 1477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:14.495825 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:14.496446 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:14.496608 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:14.499683 (+ 3075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:14.499689 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:14.499704 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:14.499739 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:14.502144 (+ 2405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:14.502605 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:14.502640 (+ 35us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:14.502649 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:14.502764 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:14.503056 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:14.503060 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:14.503062 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:14.503437 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:14.503637 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:14.503937 (+ 300us) server_negotiation.cc:299] Negotiation successful
0809 09:25:14.504213 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":155,"threads_started":1}
I20260809 09:25:14.505736 25303 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e99e65fdea24000b94200f253300ad7" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46659 } }
I20260809 09:25:14.506036 25303 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:25:14.506098 25303 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e99e65fdea24000b94200f253300ad7, State: Initialized, Role: FOLLOWER
I20260809 09:25:14.506565 25303 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e99e65fdea24000b94200f253300ad7" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46659 } }
I20260809 09:25:14.506745 25303 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:25:14.506846 25303 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:25:14.506963 25303 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:25:14.508028 25303 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e99e65fdea24000b94200f253300ad7" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46659 } }
I20260809 09:25:14.508358 25303 leader_election.cc:302] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e99e65fdea24000b94200f253300ad7; no voters:
I20260809 09:25:14.508648 25303 leader_election.cc:288] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:25:14.508754 25308 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:25:14.509013 25308 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [term 1 LEADER]: Becoming Leader. State: Replica: 0e99e65fdea24000b94200f253300ad7, State: Running, Role: LEADER
I20260809 09:25:14.509344 25308 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e99e65fdea24000b94200f253300ad7" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46659 } }
I20260809 09:25:14.509781 25303 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:25:14.510936 25309 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e99e65fdea24000b94200f253300ad7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e99e65fdea24000b94200f253300ad7" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46659 } } }
I20260809 09:25:14.511065 25309 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [sys.catalog]: This master's current role is: LEADER
I20260809 09:25:14.511432 25310 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e99e65fdea24000b94200f253300ad7. Latest consensus state: current_term: 1 leader_uuid: "0e99e65fdea24000b94200f253300ad7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e99e65fdea24000b94200f253300ad7" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46659 } } }
I20260809 09:25:14.511569 25310 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [sys.catalog]: This master's current role is: LEADER
I20260809 09:25:14.512151 25303 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 09:25:14.512280 25317 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:25:14.518146 25317 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:25:14.527951 25317 catalog_manager.cc:1347] Generated new cluster ID: 61aeb5a75af1430092544d1b08e0856f
I20260809 09:25:14.528088 25317 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:25:14.541046 25317 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:25:14.542320 25317 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:25:14.559057 25317 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7: Generated new TSK 0
I20260809 09:25:14.559928 25317 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.99.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
I20260809 09:25:15.255573 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.99.212:33031/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:0
--local_ip_for_outbound_sockets=127.11.99.193
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:46659
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:42055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:25:15.363735 25350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:15.363971 25350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:15.364095 25350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:15.367997 25350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:15.368049 25350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:15.368099 25350 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:25:15.372749 25350 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:42055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.99.212:33031/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:46659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25350
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:15.373642 25350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:15.374516 25350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:25:15.385157 25356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:15.385321 25355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:15.385167 25358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:15.386336 25350 server_base.cc:1034] running on GCE node
I20260809 09:25:15.386813 25350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:15.387526 25350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:15.390847 25350 hybrid_clock.cc:648] HybridClock initialized: now 1786267515390244 us; error 612 us; skew 500 ppm
Aug 09 09:25:15 dist-test-slave-pgkr krb5kdc[24755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267515, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:15.394371 25350 init.cc:377] Logged in from keytab as kudu/127.11.99.193@KRBTEST.COM (short username kudu)
I20260809 09:25:15.395445 25350 webserver.cc:460] Webserver started at http://127.11.99.193:37159/ using document root <none> and password file <none>
I20260809 09:25:15.396086 25350 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:15.396217 25350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:25:15.396466 25350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 09:25:15 dist-test-slave-pgkr krb5kdc[24755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267515, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for HTTP/127.11.99.212@KRBTEST.COM
I20260809 09:25:15.412398 25350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/data/instance:
uuid: "f70cd227498043828cbcc109275225fe"
format_stamp: "Formatted at 2026-08-09 09:25:15 on dist-test-slave-pgkr"
server_key: "e4ff6eed8184f9c12168d584716c8cb2"
server_key_iv: "93cb477a57e51e91d39edcdb94f86faf"
server_key_version: "kuduclusterkey@0"
I20260809 09:25:15.412978 25350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance:
uuid: "f70cd227498043828cbcc109275225fe"
format_stamp: "Formatted at 2026-08-09 09:25:15 on dist-test-slave-pgkr"
server_key: "e4ff6eed8184f9c12168d584716c8cb2"
server_key_iv: "93cb477a57e51e91d39edcdb94f86faf"
server_key_version: "kuduclusterkey@0"
I20260809 09:25:15.416771 25350 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 09:25:15.435710 25367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:15.437384 25350 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 09:25:15.437511 25350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "f70cd227498043828cbcc109275225fe"
format_stamp: "Formatted at 2026-08-09 09:25:15 on dist-test-slave-pgkr"
server_key: "e4ff6eed8184f9c12168d584716c8cb2"
server_key_iv: "93cb477a57e51e91d39edcdb94f86faf"
server_key_version: "kuduclusterkey@0"
I20260809 09:25:15.437635 25350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:15.473035 25350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:15.476645 25350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:15.476845 25350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:15.477524 25350 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:25:15.478516 25350 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:25:15.478590 25350 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:15.478713 25350 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:25:15.478757 25350 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:15.494377 25350 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:46513
I20260809 09:25:15.495492 25350 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:25:15.499408 25491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:46513 every 8 connection(s)
I20260809 09:25:15.501127 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 25350
I20260809 09:25:15.501238 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance
I20260809 09:25:15.501531 11663 external_mini_cluster.cc:1428] Setting key ced544c7abaed3eb0b42ffae5b46a698
WARNING: no policy specified for kudu/127.11.99.194@KRBTEST.COM; defaulting to no policy
Aug 09 09:25:15 dist-test-slave-pgkr krb5kdc[24755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267515, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.194@KRBTEST.COM" created.
I20260809 09:25:15.524688 25496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:15.500928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:41707 (local address 127.11.99.254:46659)
0809 09:25:15.502900 (+ 1972us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:15.502913 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:15.505382 (+ 2469us) server_negotiation.cc:407] Connection header received
0809 09:25:15.506581 (+ 1199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:15.506584 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:15.506667 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:15.506757 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:15.508399 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:15.509287 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:15.511193 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:15.511580 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:15.511668 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:15.517748 (+ 6080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:15.517753 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:15.517756 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:15.517787 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:15.519739 (+ 1952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:15.520393 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:15.520397 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:15.520399 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:15.520492 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:15.520947 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:15.520951 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:15.520953 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:15.521194 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:15.521285 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:15.524343 (+ 3058us) server_negotiation.cc:299] Negotiation successful
0809 09:25:15.524492 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1123,"thread_start_us":103,"threads_started":1}
I20260809 09:25:15.526473 25497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:15.501414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46659 (local address 127.11.99.193:41707)
0809 09:25:15.505231 (+ 3817us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:15.505289 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:15.506368 (+ 1079us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:15.507092 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:15.507103 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:15.507485 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:15.508183 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:15.508209 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:15.509466 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:15.509471 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:15.511039 (+ 1568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:15.511053 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:15.511966 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:15.511971 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:15.512187 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:15.512941 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:15.512962 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:15.517500 (+ 4538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:15.519886 (+ 2386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:15.519891 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:15.519908 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:15.520267 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:15.520604 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:15.520608 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:15.520610 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:15.520827 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:15.521357 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:15.521363 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:15.521677 (+ 314us) client_negotiation.cc:769] Sending connection context
0809 09:25:15.525143 (+ 3466us) client_negotiation.cc:240] Negotiation successful
0809 09:25:15.525485 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3587,"thread_start_us":136,"threads_started":1}
I20260809 09:25:15.528206 25492 heartbeater.cc:347] Connected to a master server at 127.11.99.254:46659
I20260809 09:25:15.528462 25492 heartbeater.cc:464] Registering TS with master...
I20260809 09:25:15.529080 25492 heartbeater.cc:511] Master 127.11.99.254:46659 requested a full tablet report, sending...
I20260809 09:25:15.530854 25265 ts_manager.cc:194] Registered new tserver with Master: f70cd227498043828cbcc109275225fe (127.11.99.193:46513)
I20260809 09:25:15.532404 25265 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.193@KRBTEST.COM'} at 127.11.99.193:41707
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
I20260809 09:25:15.549582 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.99.212:33031/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:0
--local_ip_for_outbound_sockets=127.11.99.194
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:46659
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:42055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 09:25:15 dist-test-slave-pgkr krb5kdc[24755](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786267515, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 09:25:15.681149 25500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:15.681473 25500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:15.681535 25500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:15.687443 25500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:15.687546 25500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:15.687646 25500 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:25:15.695012 25500 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:42055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.99.212:33031/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:46659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:15.696283 25500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:15.697645 25500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:25:15.709301 25506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:15.709475 25507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:15.709613 25509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:15.710249 25500 server_base.cc:1034] running on GCE node
I20260809 09:25:15.710705 25500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:15.711432 25500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:15.712644 25500 hybrid_clock.cc:648] HybridClock initialized: now 1786267515712591 us; error 65 us; skew 500 ppm
Aug 09 09:25:15 dist-test-slave-pgkr krb5kdc[24755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267515, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:15.716241 25500 init.cc:377] Logged in from keytab as kudu/127.11.99.194@KRBTEST.COM (short username kudu)
I20260809 09:25:15.717290 25500 webserver.cc:460] Webserver started at http://127.11.99.194:45623/ using document root <none> and password file <none>
I20260809 09:25:15.718047 25500 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:15.718138 25500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:25:15.718420 25500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 09:25:15 dist-test-slave-pgkr krb5kdc[24755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267515, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for HTTP/127.11.99.212@KRBTEST.COM
I20260809 09:25:15.734198 25500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/data/instance:
uuid: "026bcfd9abbc4e7082c7c3066a9cb0d1"
format_stamp: "Formatted at 2026-08-09 09:25:15 on dist-test-slave-pgkr"
server_key: "5b52196483616a0cd5b685125d818af2"
server_key_iv: "b4a7e08a1350b26c573b79a327be736b"
server_key_version: "kuduclusterkey@0"
I20260809 09:25:15.735179 25500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance:
uuid: "026bcfd9abbc4e7082c7c3066a9cb0d1"
format_stamp: "Formatted at 2026-08-09 09:25:15 on dist-test-slave-pgkr"
server_key: "5b52196483616a0cd5b685125d818af2"
server_key_iv: "b4a7e08a1350b26c573b79a327be736b"
server_key_version: "kuduclusterkey@0"
I20260809 09:25:15.744153 25500 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.004s sys 0.000s
I20260809 09:25:15.762887 25516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:15.764554 25500 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.000s
I20260809 09:25:15.764670 25500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "026bcfd9abbc4e7082c7c3066a9cb0d1"
format_stamp: "Formatted at 2026-08-09 09:25:15 on dist-test-slave-pgkr"
server_key: "5b52196483616a0cd5b685125d818af2"
server_key_iv: "b4a7e08a1350b26c573b79a327be736b"
server_key_version: "kuduclusterkey@0"
I20260809 09:25:15.764792 25500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:15.800701 25500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:15.804548 25500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:15.804806 25500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:15.805513 25500 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:25:15.806634 25500 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:25:15.806742 25500 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:15.806854 25500 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:25:15.806931 25500 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:15.820379 25500 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:42581
I20260809 09:25:15.821472 25500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:25:15.822885 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 25500
I20260809 09:25:15.823019 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance
I20260809 09:25:15.823374 11663 external_mini_cluster.cc:1428] Setting key 7178334ea94b4026ff9caf3877aba0d8
I20260809 09:25:15.823184 25637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:42581 every 8 connection(s)
WARNING: no policy specified for kudu/127.11.99.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.195@KRBTEST.COM" created.
Aug 09 09:25:15 dist-test-slave-pgkr krb5kdc[24755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267515, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:25:15.843921 25496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:15.827490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:56323 (local address 127.11.99.254:46659)
0809 09:25:15.827636 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:15.827641 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:15.828450 (+ 809us) server_negotiation.cc:407] Connection header received
0809 09:25:15.829609 (+ 1159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:15.829612 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:15.829673 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:15.829723 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:15.831295 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:15.832137 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:15.833818 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:15.834163 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:15.834234 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:15.839715 (+ 5481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:15.839719 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:15.839721 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:15.839746 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:15.841493 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:15.842137 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:15.842140 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:15.842142 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:15.842229 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:15.842653 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:15.842657 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:15.842659 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:15.842888 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:15.842970 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:15.843621 (+ 651us) server_negotiation.cc:299] Negotiation successful
0809 09:25:15.843759 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 09:25:15.845274 25640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:15.826416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46659 (local address 127.11.99.194:56323)
0809 09:25:15.828311 (+ 1895us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:15.828361 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:15.829377 (+ 1016us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:15.830120 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:15.830128 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:15.830463 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:15.831120 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:15.831136 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:15.832314 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:15.832317 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:15.833682 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:15.833693 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:15.834416 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:15.834420 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:15.834666 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:15.837881 (+ 3215us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:15.837900 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:15.839530 (+ 1630us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:15.841614 (+ 2084us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:15.841619 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:15.841632 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:15.842022 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:15.842340 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:15.842343 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:15.842345 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:15.842510 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:15.843073 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:15.843079 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:15.843357 (+ 278us) client_negotiation.cc:769] Sending connection context
0809 09:25:15.844071 (+ 714us) client_negotiation.cc:240] Negotiation successful
0809 09:25:15.844370 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1694,"thread_start_us":178,"threads_started":1}
I20260809 09:25:15.846486 25638 heartbeater.cc:347] Connected to a master server at 127.11.99.254:46659
I20260809 09:25:15.846724 25638 heartbeater.cc:464] Registering TS with master...
I20260809 09:25:15.847227 25638 heartbeater.cc:511] Master 127.11.99.254:46659 requested a full tablet report, sending...
I20260809 09:25:15.848253 25265 ts_manager.cc:194] Registered new tserver with Master: 026bcfd9abbc4e7082c7c3066a9cb0d1 (127.11.99.194:42581)
I20260809 09:25:15.848999 25265 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.194@KRBTEST.COM'} at 127.11.99.194:56323
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
I20260809 09:25:15.859215 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.99.212:33031/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:0
--local_ip_for_outbound_sockets=127.11.99.195
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:46659
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:42055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:25:16.002772 25644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:16.003173 25644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:16.003322 25644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:16.009169 25644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:16.009258 25644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:16.009356 25644 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:25:16.017015 25644 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:42055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.99.212:33031/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:46659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25644
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:16.018293 25644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:16.019606 25644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
Aug 09 09:25:16 dist-test-slave-pgkr krb5kdc[24755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267515, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for HTTP/127.11.99.212@KRBTEST.COM
W20260809 09:25:16.032176 25652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:16.032581 25650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:16.034865 25644 server_base.cc:1034] running on GCE node
W20260809 09:25:16.035522 25649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:16.036113 25644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:16.036813 25644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:16.038007 25644 hybrid_clock.cc:648] HybridClock initialized: now 1786267516037966 us; error 117 us; skew 500 ppm
Aug 09 09:25:16 dist-test-slave-pgkr krb5kdc[24755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267516, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:16.041404 25644 init.cc:377] Logged in from keytab as kudu/127.11.99.195@KRBTEST.COM (short username kudu)
I20260809 09:25:16.042647 25644 webserver.cc:460] Webserver started at http://127.11.99.195:37609/ using document root <none> and password file <none>
I20260809 09:25:16.043529 25644 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:16.043648 25644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:25:16.043915 25644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 09:25:16 dist-test-slave-pgkr krb5kdc[24755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267516, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for HTTP/127.11.99.212@KRBTEST.COM
I20260809 09:25:16.058391 25644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/data/instance:
uuid: "82f9a8971aaf425abe6db6dc42a85eea"
format_stamp: "Formatted at 2026-08-09 09:25:16 on dist-test-slave-pgkr"
server_key: "6cc58e51664801a367077f7f350d5536"
server_key_iv: "f462592314c4d7f143b64d97eaaaa013"
server_key_version: "kuduclusterkey@0"
I20260809 09:25:16.059182 25644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance:
uuid: "82f9a8971aaf425abe6db6dc42a85eea"
format_stamp: "Formatted at 2026-08-09 09:25:16 on dist-test-slave-pgkr"
server_key: "6cc58e51664801a367077f7f350d5536"
server_key_iv: "f462592314c4d7f143b64d97eaaaa013"
server_key_version: "kuduclusterkey@0"
I20260809 09:25:16.068001 25644 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.004s sys 0.000s
I20260809 09:25:16.102996 25660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:16.104924 25644 fs_manager.cc:725] Time spent opening block manager: real 0.014s user 0.002s sys 0.000s
I20260809 09:25:16.105062 25644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "82f9a8971aaf425abe6db6dc42a85eea"
format_stamp: "Formatted at 2026-08-09 09:25:16 on dist-test-slave-pgkr"
server_key: "6cc58e51664801a367077f7f350d5536"
server_key_iv: "f462592314c4d7f143b64d97eaaaa013"
server_key_version: "kuduclusterkey@0"
I20260809 09:25:16.105227 25644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:16.139909 25644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:16.143465 25644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:16.143671 25644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:16.144318 25644 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:25:16.145453 25644 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:25:16.145534 25644 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:16.145602 25644 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:25:16.145632 25644 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:16.156690 25644 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:35961
I20260809 09:25:16.156852 25782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:35961 every 8 connection(s)
I20260809 09:25:16.157783 25644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:25:16.166931 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 25644
I20260809 09:25:16.167052 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance
I20260809 09:25:16.167356 11663 external_mini_cluster.cc:1428] Setting key 46efa47b4c622b894d2d55551f277f1c
Aug 09 09:25:16 dist-test-slave-pgkr krb5kdc[24755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267516, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:25:16.173570 25496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:16.159870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:41813 (local address 127.11.99.254:46659)
0809 09:25:16.160001 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:16.160006 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:16.161072 (+ 1066us) server_negotiation.cc:407] Connection header received
0809 09:25:16.162353 (+ 1281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:16.162357 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:16.162412 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:16.162505 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:16.163912 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:16.164679 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:16.166232 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:16.166551 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:16.166729 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:16.169382 (+ 2653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:16.169386 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:16.169388 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:16.169413 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:16.171162 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:16.171743 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:16.171746 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:16.171748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:16.171845 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:16.172286 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:16.172289 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:16.172291 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:16.172564 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:16.172674 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:16.173262 (+ 588us) server_negotiation.cc:299] Negotiation successful
0809 09:25:16.173390 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 09:25:16.174454 25785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:16.160320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46659 (local address 127.11.99.195:41813)
0809 09:25:16.160884 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:16.160957 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:16.162096 (+ 1139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:16.162735 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:16.162745 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:16.163097 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:16.163731 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:16.163750 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:16.164808 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:16.164812 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:16.166100 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:16.166112 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:16.166913 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:16.166916 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:16.167102 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:16.167686 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:16.167704 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:16.169223 (+ 1519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:16.171305 (+ 2082us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:16.171310 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:16.171322 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:16.171641 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:16.171984 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:16.171987 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:16.171989 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:16.172172 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:16.172692 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:16.172697 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:16.172978 (+ 281us) client_negotiation.cc:769] Sending connection context
0809 09:25:16.173200 (+ 222us) client_negotiation.cc:240] Negotiation successful
0809 09:25:16.173492 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":161,"threads_started":1}
I20260809 09:25:16.175658 25783 heartbeater.cc:347] Connected to a master server at 127.11.99.254:46659
I20260809 09:25:16.175905 25783 heartbeater.cc:464] Registering TS with master...
I20260809 09:25:16.176422 25783 heartbeater.cc:511] Master 127.11.99.254:46659 requested a full tablet report, sending...
I20260809 09:25:16.177539 25265 ts_manager.cc:194] Registered new tserver with Master: 82f9a8971aaf425abe6db6dc42a85eea (127.11.99.195:35961)
I20260809 09:25:16.178282 25265 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.195@KRBTEST.COM'} at 127.11.99.195:41813
I20260809 09:25:16.181224 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 09:25:16.182061 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 25350
I20260809 09:25:16.193969 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 25500
I20260809 09:25:16.203451 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 25644
I20260809 09:25:16.212735 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 25233
I20260809 09:25:16.220288 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:46659
--webserver_interface=127.11.99.254
--webserver_port=41707
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:42055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:46659
--ranger_config_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.99.212:33031/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.99.212:33031/kms with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:25:16.325830 25787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:16.326053 25787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:16.326116 25787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:16.329870 25787 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:25:16.329921 25787 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:16.329939 25787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:16.329993 25787 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:25:16.330029 25787 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:25:16.335170 25787 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:42055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.99.212:33031/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:46659
--ranger_config_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:46659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=41707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25787
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:16.336022 25787 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:16.336896 25787 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:25:16.344705 25793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:16.344749 25795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:16.344763 25792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:16.344864 25787 server_base.cc:1034] running on GCE node
I20260809 09:25:16.345633 25787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:16.346546 25787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:16.347699 25787 hybrid_clock.cc:648] HybridClock initialized: now 1786267516347675 us; error 41 us; skew 500 ppm
Aug 09 09:25:16 dist-test-slave-pgkr krb5kdc[24755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267516, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:16.350296 25787 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:25:16.351150 25787 webserver.cc:460] Webserver started at http://127.11.99.254:41707/ using document root <none> and password file <none>
I20260809 09:25:16.351637 25787 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:16.351732 25787 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 09:25:16 dist-test-slave-pgkr krb5kdc[24755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267516, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for HTTP/127.11.99.212@KRBTEST.COM
I20260809 09:25:16.395092 25787 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 09:25:16.397377 25805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:16.398792 25787 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 09:25:16.398947 25787 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "0e99e65fdea24000b94200f253300ad7"
format_stamp: "Formatted at 2026-08-09 09:25:14 on dist-test-slave-pgkr"
server_key: "349f56728e6d629ed837b4a98e1f429d"
server_key_iv: "ef4558672b88893e64bb9a01f1089b7e"
server_key_version: "kuduclusterkey@0"
I20260809 09:25:16.399482 25787 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:16.418982 25787 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:16.421888 25787 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:16.422086 25787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:16.429605 25787 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:46659
I20260809 09:25:16.429628 25860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:46659 every 8 connection(s)
I20260809 09:25:16.430729 25787 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:25:16.436110 25861 sys_catalog.cc:263] Verifying existing consensus state
I20260809 09:25:16.437433 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 25787
I20260809 09:25:16.437966 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.99.212:33031/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:46513
--local_ip_for_outbound_sockets=127.11.99.193
--tserver_master_addrs=127.11.99.254:46659
--webserver_port=37159
--webserver_interface=127.11.99.193
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:42055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.99.212:33031/kms with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 09:25:16.438275 25861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7: Bootstrap starting.
I20260809 09:25:16.459631 25861 log.cc:824] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7: Log is configured to *not* fsync() on all Append() calls
I20260809 09:25:16.467785 25861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 09:25:16.468225 25861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7: Bootstrap complete.
I20260809 09:25:16.473747 25861 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e99e65fdea24000b94200f253300ad7" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46659 } }
I20260809 09:25:16.474227 25861 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e99e65fdea24000b94200f253300ad7, State: Initialized, Role: FOLLOWER
I20260809 09:25:16.474776 25861 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e99e65fdea24000b94200f253300ad7" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46659 } }
I20260809 09:25:16.474915 25861 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:25:16.474975 25861 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:25:16.475054 25861 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [term 1 FOLLOWER]: Advancing to term 2
I20260809 09:25:16.477399 25861 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e99e65fdea24000b94200f253300ad7" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46659 } }
I20260809 09:25:16.477739 25861 leader_election.cc:302] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e99e65fdea24000b94200f253300ad7; no voters:
I20260809 09:25:16.478049 25861 leader_election.cc:288] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 09:25:16.478286 25865 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 09:25:16.478566 25865 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [term 2 LEADER]: Becoming Leader. State: Replica: 0e99e65fdea24000b94200f253300ad7, State: Running, Role: LEADER
I20260809 09:25:16.478942 25865 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e99e65fdea24000b94200f253300ad7" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46659 } }
I20260809 09:25:16.479395 25861 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:25:16.479951 25865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "0e99e65fdea24000b94200f253300ad7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e99e65fdea24000b94200f253300ad7" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46659 } } }
I20260809 09:25:16.480123 25865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [sys.catalog]: This master's current role is: LEADER
I20260809 09:25:16.480376 25865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e99e65fdea24000b94200f253300ad7. Latest consensus state: current_term: 2 leader_uuid: "0e99e65fdea24000b94200f253300ad7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e99e65fdea24000b94200f253300ad7" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46659 } } }
I20260809 09:25:16.480525 25865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7 [sys.catalog]: This master's current role is: LEADER
I20260809 09:25:16.480810 25873 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:25:16.484196 25873 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:25:16.484696 25861 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 09:25:16.484937 25873 catalog_manager.cc:1259] Loaded cluster ID: 61aeb5a75af1430092544d1b08e0856f
I20260809 09:25:16.485029 25873 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:25:16.487236 25873 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:25:16.487877 25873 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7: Loaded TSK: 0
I20260809 09:25:16.489006 25873 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 09:25:16.575171 25863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:16.575484 25863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:16.575546 25863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:16.581046 25863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:16.581113 25863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:16.581197 25863 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:25:16.588285 25863 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:42055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.99.212:33031/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:46513
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=37159
--tserver_master_addrs=127.11.99.254:46659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25863
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:16.589387 25863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:16.590583 25863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:25:16.602097 25903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:16.602104 25905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:16.602105 25902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:16.603477 25863 server_base.cc:1034] running on GCE node
I20260809 09:25:16.603879 25863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:16.604525 25863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:16.605695 25863 hybrid_clock.cc:648] HybridClock initialized: now 1786267516605613 us; error 98 us; skew 500 ppm
Aug 09 09:25:16 dist-test-slave-pgkr krb5kdc[24755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267516, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:16.608994 25863 init.cc:377] Logged in from keytab as kudu/127.11.99.193@KRBTEST.COM (short username kudu)
I20260809 09:25:16.609918 25863 webserver.cc:460] Webserver started at http://127.11.99.193:37159/ using document root <none> and password file <none>
I20260809 09:25:16.610544 25863 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:16.610662 25863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 09:25:16 dist-test-slave-pgkr krb5kdc[24755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267516, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for HTTP/127.11.99.212@KRBTEST.COM
I20260809 09:25:16.641193 25863 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.003s sys 0.000s
I20260809 09:25:16.644609 25914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:16.646095 25863 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 09:25:16.646220 25863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "f70cd227498043828cbcc109275225fe"
format_stamp: "Formatted at 2026-08-09 09:25:15 on dist-test-slave-pgkr"
server_key: "e4ff6eed8184f9c12168d584716c8cb2"
server_key_iv: "93cb477a57e51e91d39edcdb94f86faf"
server_key_version: "kuduclusterkey@0"
I20260809 09:25:16.646982 25863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:16.671586 25863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:16.675850 25863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:16.676030 25863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:16.676677 25863 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:25:16.677578 25863 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:25:16.677639 25863 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:16.677692 25863 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:25:16.677717 25863 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:16.687479 25863 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:46513
I20260809 09:25:16.688629 25863 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:25:16.693054 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 25863
I20260809 09:25:16.693531 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.99.212:33031/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:42581
--local_ip_for_outbound_sockets=127.11.99.194
--tserver_master_addrs=127.11.99.254:46659
--webserver_port=45623
--webserver_interface=127.11.99.194
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:42055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.99.212:33031/kms with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 09:25:16.699353 26035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:46513 every 8 connection(s)
Aug 09 09:25:16 dist-test-slave-pgkr krb5kdc[24755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267516, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:25:16.722303 26040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:16.702894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:41085 (local address 127.11.99.254:46659)
0809 09:25:16.703385 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:16.703405 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:16.703453 (+ 48us) server_negotiation.cc:407] Connection header received
0809 09:25:16.704460 (+ 1007us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:16.704477 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:16.704864 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:16.705190 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:16.707126 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:16.708830 (+ 1704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:16.710759 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:16.711541 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:16.711739 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:16.715719 (+ 3980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:16.715739 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:16.715754 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:16.715782 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:16.717824 (+ 2042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:16.718410 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:16.718416 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:16.718421 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:16.718550 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:16.718953 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:16.718956 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:16.718958 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:16.719375 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:16.719494 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:16.721176 (+ 1682us) server_negotiation.cc:299] Negotiation successful
0809 09:25:16.721428 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":146,"threads_started":1}
I20260809 09:25:16.723011 26039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:16.701425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46659 (local address 127.11.99.193:41085)
0809 09:25:16.702870 (+ 1445us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:16.702927 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:16.703961 (+ 1034us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:16.705755 (+ 1794us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:16.705765 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:16.706142 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:16.706903 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:16.706927 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:16.709007 (+ 2080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:16.709013 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:16.710563 (+ 1550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:16.710578 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:16.711990 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:16.711997 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:16.712262 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:16.713718 (+ 1456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:16.713758 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:16.715521 (+ 1763us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:16.717956 (+ 2435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:16.717961 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:16.717973 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:16.718283 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:16.718676 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:16.718679 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:16.718681 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:16.718851 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:16.719548 (+ 697us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:16.719554 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:16.719848 (+ 294us) client_negotiation.cc:769] Sending connection context
0809 09:25:16.720060 (+ 212us) client_negotiation.cc:240] Negotiation successful
0809 09:25:16.720361 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1219,"thread_start_us":161,"threads_started":1}
I20260809 09:25:16.725839 26036 heartbeater.cc:347] Connected to a master server at 127.11.99.254:46659
I20260809 09:25:16.726063 26036 heartbeater.cc:464] Registering TS with master...
I20260809 09:25:16.726572 26036 heartbeater.cc:511] Master 127.11.99.254:46659 requested a full tablet report, sending...
W20260809 09:25:16.728739 26036 heartbeater.cc:644] Failed to heartbeat to 127.11.99.254:46659 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 09:25:16.728858 26036 heartbeater.cc:464] Registering TS with master...
I20260809 09:25:16.729012 26036 heartbeater.cc:511] Master 127.11.99.254:46659 requested a full tablet report, sending...
I20260809 09:25:16.729779 26036 heartbeater.cc:464] Registering TS with master...
I20260809 09:25:16.729939 26036 heartbeater.cc:511] Master 127.11.99.254:46659 requested a full tablet report, sending...
W20260809 09:25:16.730674 26036 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 09:25:16.840078 26038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:16.840355 26038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:16.840396 26038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:16.844934 26038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:16.845002 26038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:16.845082 26038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:25:16.851246 26038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:42055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.99.212:33031/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:42581
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=45623
--tserver_master_addrs=127.11.99.254:46659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26038
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:16.852363 26038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:16.853492 26038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:25:16.863699 26048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:16.863925 26045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:16.864195 26046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:16.864974 26038 server_base.cc:1034] running on GCE node
I20260809 09:25:16.865506 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:16.866246 26038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:16.867530 26038 hybrid_clock.cc:648] HybridClock initialized: now 1786267516867504 us; error 43 us; skew 500 ppm
Aug 09 09:25:16 dist-test-slave-pgkr krb5kdc[24755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267516, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:16.871039 26038 init.cc:377] Logged in from keytab as kudu/127.11.99.194@KRBTEST.COM (short username kudu)
I20260809 09:25:16.872078 26038 webserver.cc:460] Webserver started at http://127.11.99.194:45623/ using document root <none> and password file <none>
I20260809 09:25:16.872787 26038 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:16.872887 26038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 09:25:16 dist-test-slave-pgkr krb5kdc[24755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267516, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for HTTP/127.11.99.212@KRBTEST.COM
I20260809 09:25:16.900418 26038 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.001s
I20260809 09:25:16.906560 26057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:16.911417 26038 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.002s sys 0.001s
I20260809 09:25:16.911562 26038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "026bcfd9abbc4e7082c7c3066a9cb0d1"
format_stamp: "Formatted at 2026-08-09 09:25:15 on dist-test-slave-pgkr"
server_key: "5b52196483616a0cd5b685125d818af2"
server_key_iv: "b4a7e08a1350b26c573b79a327be736b"
server_key_version: "kuduclusterkey@0"
I20260809 09:25:16.912345 26038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:16.949069 26038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:16.953052 26038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:16.953286 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:16.954022 26038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:25:16.955108 26038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:25:16.955181 26038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:16.955260 26038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:25:16.955293 26038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:16.970438 26038 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:42581
I20260809 09:25:16.970916 26180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:42581 every 8 connection(s)
I20260809 09:25:16.971771 26038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:25:16.979737 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 26038
I20260809 09:25:16.980278 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.99.212:33031/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:35961
--local_ip_for_outbound_sockets=127.11.99.195
--tserver_master_addrs=127.11.99.254:46659
--webserver_port=37609
--webserver_interface=127.11.99.195
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:42055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.99.212:33031/kms with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 09:25:16 dist-test-slave-pgkr krb5kdc[24755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267516, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:25:16.993129 26040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:16.974844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:40459 (local address 127.11.99.254:46659)
0809 09:25:16.974998 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:16.975004 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:16.976634 (+ 1630us) server_negotiation.cc:407] Connection header received
0809 09:25:16.977781 (+ 1147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:16.977784 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:16.977864 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:16.977927 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:16.980311 (+ 2384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:16.981070 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:16.982760 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:16.983094 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:16.983194 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:16.988412 (+ 5218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:16.988415 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:16.988418 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:16.988445 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:16.990231 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:16.990984 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:16.990988 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:16.990989 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:16.991090 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:16.991572 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:16.991576 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:16.991577 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:16.991806 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:16.991964 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:16.992747 (+ 783us) server_negotiation.cc:299] Negotiation successful
0809 09:25:16.992900 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 09:25:16.995399 26183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:16.975365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46659 (local address 127.11.99.194:40459)
0809 09:25:16.976473 (+ 1108us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:16.976531 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:16.977551 (+ 1020us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:16.978354 (+ 803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:16.979073 (+ 719us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:16.979435 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:16.980130 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:16.980150 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:16.981233 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:16.981236 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:16.982587 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:16.982599 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:16.983506 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:16.983510 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:16.983957 (+ 447us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:16.984574 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:16.984598 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:16.988216 (+ 3618us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:16.990391 (+ 2175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:16.990400 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:16.990417 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:16.990849 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:16.991200 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:16.991205 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:16.991208 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:16.991406 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:16.991966 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:16.991976 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:16.992376 (+ 400us) client_negotiation.cc:769] Sending connection context
0809 09:25:16.992640 (+ 264us) client_negotiation.cc:240] Negotiation successful
0809 09:25:16.993013 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":912,"thread_start_us":136,"threads_started":1}
I20260809 09:25:16.996671 26181 heartbeater.cc:347] Connected to a master server at 127.11.99.254:46659
I20260809 09:25:16.996897 26181 heartbeater.cc:464] Registering TS with master...
I20260809 09:25:16.997442 26181 heartbeater.cc:511] Master 127.11.99.254:46659 requested a full tablet report, sending...
W20260809 09:25:16.998952 26181 heartbeater.cc:644] Failed to heartbeat to 127.11.99.254:46659 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 09:25:16.999076 26181 heartbeater.cc:464] Registering TS with master...
I20260809 09:25:16.999236 26181 heartbeater.cc:511] Master 127.11.99.254:46659 requested a full tablet report, sending...
I20260809 09:25:16.999965 26181 heartbeater.cc:464] Registering TS with master...
I20260809 09:25:17.000136 26181 heartbeater.cc:511] Master 127.11.99.254:46659 requested a full tablet report, sending...
W20260809 09:25:17.000972 26181 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 09:25:17.116011 26184 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:17.116325 26184 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:17.116425 26184 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:17.120916 26184 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:17.121007 26184 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:17.121109 26184 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:25:17.126350 26184 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:42055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.99.212:33031/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:35961
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=37609
--tserver_master_addrs=127.11.99.254:46659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26184
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:17.127522 26184 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:17.128579 26184 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:25:17.139247 26190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:17.139163 26189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:17.139382 26192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:17.140100 26184 server_base.cc:1034] running on GCE node
I20260809 09:25:17.140538 26184 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:17.141335 26184 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:17.142524 26184 hybrid_clock.cc:648] HybridClock initialized: now 1786267517142503 us; error 34 us; skew 500 ppm
Aug 09 09:25:17 dist-test-slave-pgkr krb5kdc[24755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267517, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:17.148427 26184 init.cc:377] Logged in from keytab as kudu/127.11.99.195@KRBTEST.COM (short username kudu)
I20260809 09:25:17.149354 26184 webserver.cc:460] Webserver started at http://127.11.99.195:37609/ using document root <none> and password file <none>
I20260809 09:25:17.150080 26184 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:17.150209 26184 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 09:25:17 dist-test-slave-pgkr krb5kdc[24755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267517, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for HTTP/127.11.99.212@KRBTEST.COM
I20260809 09:25:17.167965 26184 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260809 09:25:17.170470 26200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:17.172119 26184 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 09:25:17.172254 26184 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "82f9a8971aaf425abe6db6dc42a85eea"
format_stamp: "Formatted at 2026-08-09 09:25:16 on dist-test-slave-pgkr"
server_key: "6cc58e51664801a367077f7f350d5536"
server_key_iv: "f462592314c4d7f143b64d97eaaaa013"
server_key_version: "kuduclusterkey@0"
I20260809 09:25:17.172935 26184 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:17.189397 26184 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:17.193037 26184 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:17.193238 26184 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:17.193920 26184 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:25:17.194940 26184 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:25:17.195004 26184 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:17.195067 26184 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:25:17.195101 26184 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:17.206646 26184 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:35961
I20260809 09:25:17.207137 26319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:35961 every 8 connection(s)
I20260809 09:25:17.208279 26184 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:25:17.217654 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 26184
Aug 09 09:25:17 dist-test-slave-pgkr krb5kdc[24755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267517, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:25:17.222886 26040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:17.210481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:53569 (local address 127.11.99.254:46659)
0809 09:25:17.210679 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:17.210684 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:17.211576 (+ 892us) server_negotiation.cc:407] Connection header received
0809 09:25:17.212511 (+ 935us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:17.212515 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:17.212570 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:17.212673 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:17.213763 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:17.214541 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:17.215658 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:17.215996 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:17.216120 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:17.218744 (+ 2624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:17.218749 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:17.218752 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:17.218778 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:17.220524 (+ 1746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:17.221174 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:17.221179 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:17.221181 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:17.221285 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:17.221682 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:17.221685 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:17.221686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:17.221881 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:17.221975 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:17.222571 (+ 596us) server_negotiation.cc:299] Negotiation successful
0809 09:25:17.222725 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 09:25:17.224030 26322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:17.210928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:46659 (local address 127.11.99.195:53569)
0809 09:25:17.211401 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:17.211452 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:17.212301 (+ 849us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:17.212826 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:17.212832 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:17.213104 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:17.213596 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:17.213618 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:17.214709 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:17.214712 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:17.215524 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:17.215534 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:17.216151 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:17.216154 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:17.216290 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:17.216897 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:17.216913 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:17.218511 (+ 1598us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:17.220676 (+ 2165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:17.220682 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:17.220695 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:17.221061 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:17.221391 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:17.221395 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:17.221396 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:17.221575 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:17.222000 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:17.222006 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:17.222308 (+ 302us) client_negotiation.cc:769] Sending connection context
0809 09:25:17.222507 (+ 199us) client_negotiation.cc:240] Negotiation successful
0809 09:25:17.222833 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":136,"threads_started":1}
I20260809 09:25:17.225286 26320 heartbeater.cc:347] Connected to a master server at 127.11.99.254:46659
I20260809 09:25:17.225509 26320 heartbeater.cc:464] Registering TS with master...
I20260809 09:25:17.226042 26320 heartbeater.cc:511] Master 127.11.99.254:46659 requested a full tablet report, sending...
W20260809 09:25:17.227687 26320 heartbeater.cc:644] Failed to heartbeat to 127.11.99.254:46659 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 09:25:17.227808 26320 heartbeater.cc:464] Registering TS with master...
I20260809 09:25:17.227979 26320 heartbeater.cc:511] Master 127.11.99.254:46659 requested a full tablet report, sending...
I20260809 09:25:17.228956 26320 heartbeater.cc:464] Registering TS with master...
I20260809 09:25:17.229125 26320 heartbeater.cc:511] Master 127.11.99.254:46659 requested a full tablet report, sending...
W20260809 09:25:17.229986 26320 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 09:25:17.233809 26323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:17.218353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53174 (local address 127.11.99.254:46659)
0809 09:25:17.218678 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:17.218687 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:17.218946 (+ 259us) server_negotiation.cc:407] Connection header received
0809 09:25:17.219346 (+ 400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:17.219349 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:17.219402 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:17.219497 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:17.221497 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:17.222201 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:17.223992 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:17.224362 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:17.224494 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:17.226074 (+ 1580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:17.226078 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:17.226080 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:17.226104 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:17.228602 (+ 2498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:17.232401 (+ 3799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:17.232407 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:17.232409 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:17.232517 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:17.232834 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:17.232838 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:17.232840 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:17.233032 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:17.233248 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:17.233440 (+ 192us) server_negotiation.cc:299] Negotiation successful
0809 09:25:17.233611 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":94,"threads_started":1}
Aug 09 09:25:17 dist-test-slave-pgkr krb5kdc[24755](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786267517, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:17.730908 26036 heartbeater.cc:464] Registering TS with master...
I20260809 09:25:17.731237 26036 heartbeater.cc:511] Master 127.11.99.254:46659 requested a full tablet report, sending...
I20260809 09:25:17.732299 25823 ts_manager.cc:194] Registered new tserver with Master: f70cd227498043828cbcc109275225fe (127.11.99.193:46513)
I20260809 09:25:17.733567 25823 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.193@KRBTEST.COM'} at 127.11.99.193:41085
I20260809 09:25:18.001247 26181 heartbeater.cc:464] Registering TS with master...
I20260809 09:25:18.001569 26181 heartbeater.cc:511] Master 127.11.99.254:46659 requested a full tablet report, sending...
I20260809 09:25:18.002451 25823 ts_manager.cc:194] Registered new tserver with Master: 026bcfd9abbc4e7082c7c3066a9cb0d1 (127.11.99.194:42581)
I20260809 09:25:18.003417 25823 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.194@KRBTEST.COM'} at 127.11.99.194:40459
Aug 09 09:25:18 dist-test-slave-pgkr krb5kdc[24755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267517, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for HTTP/127.11.99.212@KRBTEST.COM
I20260809 09:25:18.230201 26320 heartbeater.cc:464] Registering TS with master...
I20260809 09:25:18.230507 26320 heartbeater.cc:511] Master 127.11.99.254:46659 requested a full tablet report, sending...
I20260809 09:25:18.231236 25822 ts_manager.cc:194] Registered new tserver with Master: 82f9a8971aaf425abe6db6dc42a85eea (127.11.99.195:35961)
I20260809 09:25:18.232023 25822 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.195@KRBTEST.COM'} at 127.11.99.195:53569
I20260809 09:25:18.234790 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 09:25:18.244858 26343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:18.236717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53180 (local address 127.11.99.254:46659)
0809 09:25:18.237387 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:18.237390 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:18.237401 (+ 11us) server_negotiation.cc:407] Connection header received
0809 09:25:18.237430 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:18.237432 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:18.237465 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:18.237566 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:18.238232 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:18.238826 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:18.239663 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:18.239893 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:18.240002 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:18.241456 (+ 1454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:18.241460 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:18.241462 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:18.241491 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:18.243080 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:18.243522 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:18.243527 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:18.243529 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:18.243612 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:18.243886 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:18.243891 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:18.243892 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:18.244061 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:18.244199 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:18.244509 (+ 310us) server_negotiation.cc:299] Negotiation successful
0809 09:25:18.244643 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":591,"thread_start_us":95,"threads_started":1}
I20260809 09:25:18.248172 25823 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53180:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 09:25:18.251628 25823 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:25:18.271967 26348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:18.261756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:35961 (local address 127.0.0.1:42458)
0809 09:25:18.265066 (+ 3310us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:18.265115 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:18.265250 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:18.267275 (+ 2025us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:18.267278 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:18.267295 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:25:18.267372 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:18.267378 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:18.268714 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:18.268719 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:18.270074 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:18.270085 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:18.271447 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:18.271454 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:18.271549 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:18.271586 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 09:25:18.271689 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 09:25:18.271815 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3132,"thread_start_us":94,"threads_started":1}
I20260809 09:25:18.273819 26352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:18.264493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:46513 (local address 127.0.0.1:40926)
0809 09:25:18.265959 (+ 1466us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:18.265972 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:18.266041 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:18.268123 (+ 2082us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:18.268126 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:18.268144 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:25:18.268232 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:18.268237 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:18.270265 (+ 2028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:18.270268 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:18.271343 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:18.271353 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:18.273410 (+ 2057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:18.273414 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:18.273512 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:18.273565 (+ 53us) client_negotiation.cc:769] Sending connection context
0809 09:25:18.273614 (+ 49us) client_negotiation.cc:240] Negotiation successful
0809 09:25:18.273679 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1396,"thread_start_us":167,"threads_started":1}
I20260809 09:25:18.273867 26349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:18.262841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42458 (local address 127.11.99.195:35961)
0809 09:25:18.266862 (+ 4021us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:18.266868 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:18.266889 (+ 21us) server_negotiation.cc:407] Connection header received
0809 09:25:18.266960 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:18.266964 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:18.267146 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:18.267292 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:25:18.267500 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:18.268599 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:18.270240 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:18.271115 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:18.271224 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:18.271371 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:18.273632 (+ 2261us) server_negotiation.cc:299] Negotiation successful
0809 09:25:18.273733 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3912,"thread_start_us":105,"threads_started":1}
I20260809 09:25:18.274875 26353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:18.264732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40926 (local address 127.11.99.193:46513)
0809 09:25:18.267567 (+ 2835us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:18.267573 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:18.267594 (+ 21us) server_negotiation.cc:407] Connection header received
0809 09:25:18.267660 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:18.267664 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:18.267851 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:18.267974 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:25:18.268355 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:18.270145 (+ 1790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:18.271506 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:18.273281 (+ 1775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:18.274348 (+ 1067us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:18.274487 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:18.274536 (+ 49us) server_negotiation.cc:299] Negotiation successful
0809 09:25:18.274681 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2724,"thread_start_us":99,"threads_started":1}
I20260809 09:25:18.277171 26252 tablet_service.cc:1467] Processing CreateTablet for tablet a06b5ee7d0f24d9685376a82f5b2cf90 (DEFAULT_TABLE table=test-table [id=1444c1f168264ed4a8ded7f8ba4c8c17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:25:18.277604 25954 tablet_service.cc:1467] Processing CreateTablet for tablet a06b5ee7d0f24d9685376a82f5b2cf90 (DEFAULT_TABLE table=test-table [id=1444c1f168264ed4a8ded7f8ba4c8c17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:25:18.278313 26252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a06b5ee7d0f24d9685376a82f5b2cf90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:25:18.278762 25954 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a06b5ee7d0f24d9685376a82f5b2cf90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:25:18.288470 26355 tablet_bootstrap.cc:492] T a06b5ee7d0f24d9685376a82f5b2cf90 P f70cd227498043828cbcc109275225fe: Bootstrap starting.
I20260809 09:25:18.289564 26350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:18.263369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:42581 (local address 127.0.0.1:57802)
0809 09:25:18.265513 (+ 2144us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:18.265523 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:18.265636 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:18.266806 (+ 1170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:18.266812 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:18.266838 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:25:18.266982 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:18.266989 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:18.275006 (+ 8017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:18.275010 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:18.287988 (+ 12978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:18.288003 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:18.289128 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:18.289132 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:18.289240 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:18.289264 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 09:25:18.289333 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 09:25:18.289424 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2093,"thread_start_us":163,"threads_started":1}
I20260809 09:25:18.289705 26351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:18.263872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57802 (local address 127.11.99.194:42581)
0809 09:25:18.266301 (+ 2429us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:18.266309 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:18.266336 (+ 27us) server_negotiation.cc:407] Connection header received
0809 09:25:18.266408 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:18.266415 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:18.266596 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:18.267137 (+ 541us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:25:18.272418 (+ 5281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:18.273482 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:18.288190 (+ 14708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:18.288969 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:18.289127 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:18.289318 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:18.289372 (+ 54us) server_negotiation.cc:299] Negotiation successful
0809 09:25:18.289459 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2310,"thread_start_us":88,"threads_started":1}
I20260809 09:25:18.290808 26355 tablet_bootstrap.cc:654] T a06b5ee7d0f24d9685376a82f5b2cf90 P f70cd227498043828cbcc109275225fe: Neither blocks nor log segments found. Creating new log.
I20260809 09:25:18.291595 26355 log.cc:824] T a06b5ee7d0f24d9685376a82f5b2cf90 P f70cd227498043828cbcc109275225fe: Log is configured to *not* fsync() on all Append() calls
I20260809 09:25:18.292822 26108 tablet_service.cc:1467] Processing CreateTablet for tablet a06b5ee7d0f24d9685376a82f5b2cf90 (DEFAULT_TABLE table=test-table [id=1444c1f168264ed4a8ded7f8ba4c8c17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:25:18.293917 26108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a06b5ee7d0f24d9685376a82f5b2cf90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:25:18.294122 26355 tablet_bootstrap.cc:492] T a06b5ee7d0f24d9685376a82f5b2cf90 P f70cd227498043828cbcc109275225fe: No bootstrap required, opened a new log
I20260809 09:25:18.294329 26355 ts_tablet_manager.cc:1397] T a06b5ee7d0f24d9685376a82f5b2cf90 P f70cd227498043828cbcc109275225fe: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260809 09:25:18.298169 26355 raft_consensus.cc:348] T a06b5ee7d0f24d9685376a82f5b2cf90 P f70cd227498043828cbcc109275225fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026bcfd9abbc4e7082c7c3066a9cb0d1" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 42581 } } peers { permanent_uuid: "82f9a8971aaf425abe6db6dc42a85eea" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35961 } } peers { permanent_uuid: "f70cd227498043828cbcc109275225fe" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46513 } }
I20260809 09:25:18.298418 26355 raft_consensus.cc:374] T a06b5ee7d0f24d9685376a82f5b2cf90 P f70cd227498043828cbcc109275225fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:25:18.298475 26355 raft_consensus.cc:729] T a06b5ee7d0f24d9685376a82f5b2cf90 P f70cd227498043828cbcc109275225fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f70cd227498043828cbcc109275225fe, State: Initialized, Role: FOLLOWER
I20260809 09:25:18.299017 26355 consensus_queue.cc:260] T a06b5ee7d0f24d9685376a82f5b2cf90 P f70cd227498043828cbcc109275225fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026bcfd9abbc4e7082c7c3066a9cb0d1" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 42581 } } peers { permanent_uuid: "82f9a8971aaf425abe6db6dc42a85eea" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35961 } } peers { permanent_uuid: "f70cd227498043828cbcc109275225fe" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46513 } }
I20260809 09:25:18.299800 26354 tablet_bootstrap.cc:492] T a06b5ee7d0f24d9685376a82f5b2cf90 P 82f9a8971aaf425abe6db6dc42a85eea: Bootstrap starting.
I20260809 09:25:18.300156 26355 ts_tablet_manager.cc:1428] T a06b5ee7d0f24d9685376a82f5b2cf90 P f70cd227498043828cbcc109275225fe: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260809 09:25:18.300493 26036 heartbeater.cc:503] Master 127.11.99.254:46659 was elected leader, sending a full tablet report...
I20260809 09:25:18.303531 26354 tablet_bootstrap.cc:654] T a06b5ee7d0f24d9685376a82f5b2cf90 P 82f9a8971aaf425abe6db6dc42a85eea: Neither blocks nor log segments found. Creating new log.
I20260809 09:25:18.304544 26354 log.cc:824] T a06b5ee7d0f24d9685376a82f5b2cf90 P 82f9a8971aaf425abe6db6dc42a85eea: Log is configured to *not* fsync() on all Append() calls
I20260809 09:25:18.304888 26358 tablet_bootstrap.cc:492] T a06b5ee7d0f24d9685376a82f5b2cf90 P 026bcfd9abbc4e7082c7c3066a9cb0d1: Bootstrap starting.
I20260809 09:25:18.306805 26358 tablet_bootstrap.cc:654] T a06b5ee7d0f24d9685376a82f5b2cf90 P 026bcfd9abbc4e7082c7c3066a9cb0d1: Neither blocks nor log segments found. Creating new log.
I20260809 09:25:18.307915 26358 log.cc:824] T a06b5ee7d0f24d9685376a82f5b2cf90 P 026bcfd9abbc4e7082c7c3066a9cb0d1: Log is configured to *not* fsync() on all Append() calls
I20260809 09:25:18.309897 26358 tablet_bootstrap.cc:492] T a06b5ee7d0f24d9685376a82f5b2cf90 P 026bcfd9abbc4e7082c7c3066a9cb0d1: No bootstrap required, opened a new log
I20260809 09:25:18.310086 26358 ts_tablet_manager.cc:1397] T a06b5ee7d0f24d9685376a82f5b2cf90 P 026bcfd9abbc4e7082c7c3066a9cb0d1: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 09:25:18.313822 26358 raft_consensus.cc:348] T a06b5ee7d0f24d9685376a82f5b2cf90 P 026bcfd9abbc4e7082c7c3066a9cb0d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026bcfd9abbc4e7082c7c3066a9cb0d1" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 42581 } } peers { permanent_uuid: "82f9a8971aaf425abe6db6dc42a85eea" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35961 } } peers { permanent_uuid: "f70cd227498043828cbcc109275225fe" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46513 } }
I20260809 09:25:18.314074 26358 raft_consensus.cc:374] T a06b5ee7d0f24d9685376a82f5b2cf90 P 026bcfd9abbc4e7082c7c3066a9cb0d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:25:18.314129 26358 raft_consensus.cc:729] T a06b5ee7d0f24d9685376a82f5b2cf90 P 026bcfd9abbc4e7082c7c3066a9cb0d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 026bcfd9abbc4e7082c7c3066a9cb0d1, State: Initialized, Role: FOLLOWER
I20260809 09:25:18.314546 26354 tablet_bootstrap.cc:492] T a06b5ee7d0f24d9685376a82f5b2cf90 P 82f9a8971aaf425abe6db6dc42a85eea: No bootstrap required, opened a new log
I20260809 09:25:18.314597 26358 consensus_queue.cc:260] T a06b5ee7d0f24d9685376a82f5b2cf90 P 026bcfd9abbc4e7082c7c3066a9cb0d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026bcfd9abbc4e7082c7c3066a9cb0d1" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 42581 } } peers { permanent_uuid: "82f9a8971aaf425abe6db6dc42a85eea" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35961 } } peers { permanent_uuid: "f70cd227498043828cbcc109275225fe" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46513 } }
I20260809 09:25:18.314775 26354 ts_tablet_manager.cc:1397] T a06b5ee7d0f24d9685376a82f5b2cf90 P 82f9a8971aaf425abe6db6dc42a85eea: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.000s
I20260809 09:25:18.315599 26358 ts_tablet_manager.cc:1428] T a06b5ee7d0f24d9685376a82f5b2cf90 P 026bcfd9abbc4e7082c7c3066a9cb0d1: Time spent starting tablet: real 0.005s user 0.003s sys 0.003s
I20260809 09:25:18.315927 26181 heartbeater.cc:503] Master 127.11.99.254:46659 was elected leader, sending a full tablet report...
I20260809 09:25:18.319167 26354 raft_consensus.cc:348] T a06b5ee7d0f24d9685376a82f5b2cf90 P 82f9a8971aaf425abe6db6dc42a85eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026bcfd9abbc4e7082c7c3066a9cb0d1" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 42581 } } peers { permanent_uuid: "82f9a8971aaf425abe6db6dc42a85eea" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35961 } } peers { permanent_uuid: "f70cd227498043828cbcc109275225fe" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46513 } }
I20260809 09:25:18.319450 26354 raft_consensus.cc:374] T a06b5ee7d0f24d9685376a82f5b2cf90 P 82f9a8971aaf425abe6db6dc42a85eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:25:18.319501 26354 raft_consensus.cc:729] T a06b5ee7d0f24d9685376a82f5b2cf90 P 82f9a8971aaf425abe6db6dc42a85eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f9a8971aaf425abe6db6dc42a85eea, State: Initialized, Role: FOLLOWER
I20260809 09:25:18.319970 26354 consensus_queue.cc:260] T a06b5ee7d0f24d9685376a82f5b2cf90 P 82f9a8971aaf425abe6db6dc42a85eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026bcfd9abbc4e7082c7c3066a9cb0d1" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 42581 } } peers { permanent_uuid: "82f9a8971aaf425abe6db6dc42a85eea" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35961 } } peers { permanent_uuid: "f70cd227498043828cbcc109275225fe" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46513 } }
I20260809 09:25:18.321249 26354 ts_tablet_manager.cc:1428] T a06b5ee7d0f24d9685376a82f5b2cf90 P 82f9a8971aaf425abe6db6dc42a85eea: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 09:25:18.321559 26320 heartbeater.cc:503] Master 127.11.99.254:46659 was elected leader, sending a full tablet report...
Aug 09 09:25:18 dist-test-slave-pgkr krb5kdc[24755](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267517, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for HTTP/127.11.99.212@KRBTEST.COM
I20260809 09:25:18.361685 26357 raft_consensus.cc:482] T a06b5ee7d0f24d9685376a82f5b2cf90 P f70cd227498043828cbcc109275225fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:25:18.361974 26357 raft_consensus.cc:504] T a06b5ee7d0f24d9685376a82f5b2cf90 P f70cd227498043828cbcc109275225fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026bcfd9abbc4e7082c7c3066a9cb0d1" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 42581 } } peers { permanent_uuid: "82f9a8971aaf425abe6db6dc42a85eea" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35961 } } peers { permanent_uuid: "f70cd227498043828cbcc109275225fe" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46513 } }
I20260809 09:25:18.363554 26357 leader_election.cc:288] T a06b5ee7d0f24d9685376a82f5b2cf90 P f70cd227498043828cbcc109275225fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 026bcfd9abbc4e7082c7c3066a9cb0d1 (127.11.99.194:42581), 82f9a8971aaf425abe6db6dc42a85eea (127.11.99.195:35961)
I20260809 09:25:18.369204 26351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:18.364524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:46055 (local address 127.11.99.194:42581)
0809 09:25:18.364762 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:18.364767 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:18.364781 (+ 14us) server_negotiation.cc:407] Connection header received
0809 09:25:18.364835 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:18.364837 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:18.364887 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:18.364954 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:25:18.365458 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:18.366194 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:18.367823 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:18.368423 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:18.368530 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:18.368584 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:18.368987 (+ 403us) server_negotiation.cc:299] Negotiation successful
0809 09:25:18.369074 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149}
I20260809 09:25:18.369653 26367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:18.363772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:42581 (local address 127.11.99.193:46055)
0809 09:25:18.364093 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:18.364108 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:18.364205 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:18.365081 (+ 876us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:18.365084 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:18.365101 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:25:18.365317 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:18.365325 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:18.366368 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:18.366371 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:18.367671 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:18.367682 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:18.368701 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:18.368704 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:18.368804 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:18.368829 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 09:25:18.369431 (+ 602us) client_negotiation.cc:240] Negotiation successful
0809 09:25:18.369512 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"mutex_wait_us":38,"thread_start_us":149,"threads_started":1}
I20260809 09:25:18.370258 26114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a06b5ee7d0f24d9685376a82f5b2cf90" candidate_uuid: "f70cd227498043828cbcc109275225fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "026bcfd9abbc4e7082c7c3066a9cb0d1" is_pre_election: true
I20260809 09:25:18.370563 26114 raft_consensus.cc:2454] T a06b5ee7d0f24d9685376a82f5b2cf90 P 026bcfd9abbc4e7082c7c3066a9cb0d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f70cd227498043828cbcc109275225fe in term 0.
I20260809 09:25:18.371119 25915 leader_election.cc:302] T a06b5ee7d0f24d9685376a82f5b2cf90 P f70cd227498043828cbcc109275225fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 026bcfd9abbc4e7082c7c3066a9cb0d1, f70cd227498043828cbcc109275225fe; no voters:
I20260809 09:25:18.371438 26357 raft_consensus.cc:2781] T a06b5ee7d0f24d9685376a82f5b2cf90 P f70cd227498043828cbcc109275225fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:25:18.371528 26357 raft_consensus.cc:482] T a06b5ee7d0f24d9685376a82f5b2cf90 P f70cd227498043828cbcc109275225fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:25:18.371588 26357 raft_consensus.cc:3037] T a06b5ee7d0f24d9685376a82f5b2cf90 P f70cd227498043828cbcc109275225fe [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:25:18.372931 26357 raft_consensus.cc:504] T a06b5ee7d0f24d9685376a82f5b2cf90 P f70cd227498043828cbcc109275225fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026bcfd9abbc4e7082c7c3066a9cb0d1" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 42581 } } peers { permanent_uuid: "82f9a8971aaf425abe6db6dc42a85eea" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35961 } } peers { permanent_uuid: "f70cd227498043828cbcc109275225fe" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46513 } }
I20260809 09:25:18.373335 26357 leader_election.cc:288] T a06b5ee7d0f24d9685376a82f5b2cf90 P f70cd227498043828cbcc109275225fe [CANDIDATE]: Term 1 election: Requested vote from peers 026bcfd9abbc4e7082c7c3066a9cb0d1 (127.11.99.194:42581), 82f9a8971aaf425abe6db6dc42a85eea (127.11.99.195:35961)
I20260809 09:25:18.373772 26114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a06b5ee7d0f24d9685376a82f5b2cf90" candidate_uuid: "f70cd227498043828cbcc109275225fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "026bcfd9abbc4e7082c7c3066a9cb0d1"
I20260809 09:25:18.373893 26114 raft_consensus.cc:3037] T a06b5ee7d0f24d9685376a82f5b2cf90 P 026bcfd9abbc4e7082c7c3066a9cb0d1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:25:18.375264 26114 raft_consensus.cc:2454] T a06b5ee7d0f24d9685376a82f5b2cf90 P 026bcfd9abbc4e7082c7c3066a9cb0d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f70cd227498043828cbcc109275225fe in term 1.
I20260809 09:25:18.375545 25915 leader_election.cc:302] T a06b5ee7d0f24d9685376a82f5b2cf90 P f70cd227498043828cbcc109275225fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 026bcfd9abbc4e7082c7c3066a9cb0d1, f70cd227498043828cbcc109275225fe; no voters:
I20260809 09:25:18.375771 26357 raft_consensus.cc:2781] T a06b5ee7d0f24d9685376a82f5b2cf90 P f70cd227498043828cbcc109275225fe [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:25:18.376063 26357 raft_consensus.cc:686] T a06b5ee7d0f24d9685376a82f5b2cf90 P f70cd227498043828cbcc109275225fe [term 1 LEADER]: Becoming Leader. State: Replica: f70cd227498043828cbcc109275225fe, State: Running, Role: LEADER
I20260809 09:25:18.376417 26357 consensus_queue.cc:237] T a06b5ee7d0f24d9685376a82f5b2cf90 P f70cd227498043828cbcc109275225fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026bcfd9abbc4e7082c7c3066a9cb0d1" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 42581 } } peers { permanent_uuid: "82f9a8971aaf425abe6db6dc42a85eea" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35961 } } peers { permanent_uuid: "f70cd227498043828cbcc109275225fe" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46513 } }
I20260809 09:25:18.379468 26349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:18.364741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:58441 (local address 127.11.99.195:35961)
0809 09:25:18.364849 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:18.364853 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:18.364864 (+ 11us) server_negotiation.cc:407] Connection header received
0809 09:25:18.364908 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:18.364913 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:18.364960 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:18.365016 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:25:18.376067 (+ 11051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:18.376781 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:18.378156 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:18.378697 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:18.378799 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:18.378888 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:18.379243 (+ 355us) server_negotiation.cc:299] Negotiation successful
0809 09:25:18.379354 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 09:25:18.379988 26368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:18.364204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:35961 (local address 127.11.99.193:58441)
0809 09:25:18.364452 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:18.364465 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:18.364547 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:18.365100 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:18.365103 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:18.365130 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:25:18.375856 (+ 10726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:18.375868 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:18.376932 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:18.376935 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:18.377994 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:18.378004 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:18.378989 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:18.378992 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:18.379093 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:18.379118 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 09:25:18.379683 (+ 565us) client_negotiation.cc:240] Negotiation successful
0809 09:25:18.379845 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":4,"spinlock_wait_cycles":384,"thread_start_us":104,"threads_started":1}
I20260809 09:25:18.380012 25823 catalog_manager.cc:5495] T a06b5ee7d0f24d9685376a82f5b2cf90 P f70cd227498043828cbcc109275225fe reported cstate change: term changed from 0 to 1, leader changed from <none> to f70cd227498043828cbcc109275225fe (127.11.99.193). New cstate: current_term: 1 leader_uuid: "f70cd227498043828cbcc109275225fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "026bcfd9abbc4e7082c7c3066a9cb0d1" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 42581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82f9a8971aaf425abe6db6dc42a85eea" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f70cd227498043828cbcc109275225fe" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46513 } health_report { overall_health: HEALTHY } } }
I20260809 09:25:18.380805 26272 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a06b5ee7d0f24d9685376a82f5b2cf90" candidate_uuid: "f70cd227498043828cbcc109275225fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f9a8971aaf425abe6db6dc42a85eea" is_pre_election: true
I20260809 09:25:18.381079 26272 raft_consensus.cc:2454] T a06b5ee7d0f24d9685376a82f5b2cf90 P 82f9a8971aaf425abe6db6dc42a85eea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f70cd227498043828cbcc109275225fe in term 0.
I20260809 09:25:18.381364 26271 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a06b5ee7d0f24d9685376a82f5b2cf90" candidate_uuid: "f70cd227498043828cbcc109275225fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82f9a8971aaf425abe6db6dc42a85eea"
I20260809 09:25:18.381455 26271 raft_consensus.cc:3037] T a06b5ee7d0f24d9685376a82f5b2cf90 P 82f9a8971aaf425abe6db6dc42a85eea [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:25:18.382896 26271 raft_consensus.cc:2454] T a06b5ee7d0f24d9685376a82f5b2cf90 P 82f9a8971aaf425abe6db6dc42a85eea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f70cd227498043828cbcc109275225fe in term 1.
I20260809 09:25:18.399976 26353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:18.395138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40930 (local address 127.11.99.193:46513)
0809 09:25:18.395279 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:18.395283 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:18.395329 (+ 46us) server_negotiation.cc:407] Connection header received
0809 09:25:18.395526 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:18.395529 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:18.395592 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:18.395695 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:25:18.396053 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:18.396733 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:18.397917 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:18.398185 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:18.398269 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:18.398677 (+ 408us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:25:18.399221 (+ 544us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:25:18.399360 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:18.399753 (+ 393us) server_negotiation.cc:299] Negotiation successful
0809 09:25:18.399824 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 09:25:18.410034 26271 raft_consensus.cc:1261] T a06b5ee7d0f24d9685376a82f5b2cf90 P 82f9a8971aaf425abe6db6dc42a85eea [term 1 FOLLOWER]: Refusing update from remote peer f70cd227498043828cbcc109275225fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:25:18.410060 26114 raft_consensus.cc:1261] T a06b5ee7d0f24d9685376a82f5b2cf90 P 026bcfd9abbc4e7082c7c3066a9cb0d1 [term 1 FOLLOWER]: Refusing update from remote peer f70cd227498043828cbcc109275225fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:25:18.410799 26369 consensus_queue.cc:1035] T a06b5ee7d0f24d9685376a82f5b2cf90 P f70cd227498043828cbcc109275225fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "026bcfd9abbc4e7082c7c3066a9cb0d1" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 42581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:25:18.411765 26357 consensus_queue.cc:1035] T a06b5ee7d0f24d9685376a82f5b2cf90 P f70cd227498043828cbcc109275225fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "82f9a8971aaf425abe6db6dc42a85eea" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:25:18.427089 26374 mvcc.cc:205] Tried to move back new op lower bound from 7316551755399073792 to 7316551755273158656. Current Snapshot: MvccSnapshot[applied={T|T < 7316551755399073792}]
I20260809 09:25:18.430539 26375 mvcc.cc:205] Tried to move back new op lower bound from 7316551755399073792 to 7316551755273158656. Current Snapshot: MvccSnapshot[applied={T|T < 7316551755399073792}]
I20260809 09:25:18.442703 25823 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53180:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:25:18.442890 25823 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53180:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:25:18.443602 26373 mvcc.cc:205] Tried to move back new op lower bound from 7316551755399073792 to 7316551755273158656. Current Snapshot: MvccSnapshot[applied={T|T < 7316551755399073792 or (T in {7316551755399073792})}]
I20260809 09:25:18.445719 25823 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0e99e65fdea24000b94200f253300ad7: Sending DeleteTablet for 3 replicas of tablet a06b5ee7d0f24d9685376a82f5b2cf90
I20260809 09:25:18.446429 26108 tablet_service.cc:1514] Processing DeleteTablet for tablet a06b5ee7d0f24d9685376a82f5b2cf90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:25:18 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:57802
I20260809 09:25:18.447404 26252 tablet_service.cc:1514] Processing DeleteTablet for tablet a06b5ee7d0f24d9685376a82f5b2cf90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:25:18 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:42458
I20260809 09:25:18.448264 25954 tablet_service.cc:1514] Processing DeleteTablet for tablet a06b5ee7d0f24d9685376a82f5b2cf90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:25:18 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:40926
I20260809 09:25:18.449692 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 25863
I20260809 09:25:18.456085 26383 tablet_replica.cc:330] T a06b5ee7d0f24d9685376a82f5b2cf90 P 026bcfd9abbc4e7082c7c3066a9cb0d1: stopping tablet replica
I20260809 09:25:18.456441 26383 raft_consensus.cc:2229] T a06b5ee7d0f24d9685376a82f5b2cf90 P 026bcfd9abbc4e7082c7c3066a9cb0d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:25:18.456554 26384 tablet_replica.cc:330] T a06b5ee7d0f24d9685376a82f5b2cf90 P 82f9a8971aaf425abe6db6dc42a85eea: stopping tablet replica
I20260809 09:25:18.456791 26383 raft_consensus.cc:2258] T a06b5ee7d0f24d9685376a82f5b2cf90 P 026bcfd9abbc4e7082c7c3066a9cb0d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:25:18.456856 26384 raft_consensus.cc:2229] T a06b5ee7d0f24d9685376a82f5b2cf90 P 82f9a8971aaf425abe6db6dc42a85eea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:25:18.457628 26384 raft_consensus.cc:2258] T a06b5ee7d0f24d9685376a82f5b2cf90 P 82f9a8971aaf425abe6db6dc42a85eea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:25:18.459215 26383 ts_tablet_manager.cc:1905] T a06b5ee7d0f24d9685376a82f5b2cf90 P 026bcfd9abbc4e7082c7c3066a9cb0d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:25:18.462581 26383 ts_tablet_manager.cc:1918] T a06b5ee7d0f24d9685376a82f5b2cf90 P 026bcfd9abbc4e7082c7c3066a9cb0d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:25:18.462898 26383 log.cc:1196] T a06b5ee7d0f24d9685376a82f5b2cf90 P 026bcfd9abbc4e7082c7c3066a9cb0d1: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/a06b5ee7d0f24d9685376a82f5b2cf90
I20260809 09:25:18.463312 26383 ts_tablet_manager.cc:1939] T a06b5ee7d0f24d9685376a82f5b2cf90 P 026bcfd9abbc4e7082c7c3066a9cb0d1: Deleting consensus metadata
I20260809 09:25:18.464598 25806 catalog_manager.cc:4841] TS 026bcfd9abbc4e7082c7c3066a9cb0d1 (127.11.99.194:42581): tablet a06b5ee7d0f24d9685376a82f5b2cf90 (table test-table [id=1444c1f168264ed4a8ded7f8ba4c8c17]) successfully deleted
I20260809 09:25:18.466163 26384 ts_tablet_manager.cc:1905] T a06b5ee7d0f24d9685376a82f5b2cf90 P 82f9a8971aaf425abe6db6dc42a85eea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:25:18.468910 26384 ts_tablet_manager.cc:1918] T a06b5ee7d0f24d9685376a82f5b2cf90 P 82f9a8971aaf425abe6db6dc42a85eea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:25:18.469023 26384 log.cc:1196] T a06b5ee7d0f24d9685376a82f5b2cf90 P 82f9a8971aaf425abe6db6dc42a85eea: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/a06b5ee7d0f24d9685376a82f5b2cf90
I20260809 09:25:18.469357 26384 ts_tablet_manager.cc:1939] T a06b5ee7d0f24d9685376a82f5b2cf90 P 82f9a8971aaf425abe6db6dc42a85eea: Deleting consensus metadata
I20260809 09:25:18.470558 25808 catalog_manager.cc:4841] TS 82f9a8971aaf425abe6db6dc42a85eea (127.11.99.195:35961): tablet a06b5ee7d0f24d9685376a82f5b2cf90 (table test-table [id=1444c1f168264ed4a8ded7f8ba4c8c17]) successfully deleted
W20260809 09:25:18.471221 25808 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.99.193:46513 (error 108)
I20260809 09:25:18.472393 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 26038
I20260809 09:25:18.472816 26350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:18.472434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:46513 (local address 127.0.0.1:40940)
0809 09:25:18.472553 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:18.472716 (+ 163us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.193:46513: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260809 09:25:18.474115 25808 catalog_manager.cc:4584] TS f70cd227498043828cbcc109275225fe (127.11.99.193:46513): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a06b5ee7d0f24d9685376a82f5b2cf90: Network error: Client connection negotiation failed: client connection to 127.11.99.193:46513: connect: Connection refused (error 111)
I20260809 09:25:18.484819 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 26184
I20260809 09:25:18.495476 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 25787
I20260809 09:25:18.504278 11663 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 09:25:18.848366 11663 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 09:25:18.848482 11663 mini_ranger.cc:66] Stopping Ranger...
I20260809 09:25:19.192729 11663 mini_ranger.cc:68] Stopped Ranger
2026-08-09 09:25:19.192 UTC [24785] LOG: received smart shutdown request
2026-08-09 09:25:19.196 UTC [24785] LOG: background worker "logical replication launcher" (PID 24795) exited with exit code 1
2026-08-09 09:25:19.197 UTC [24790] LOG: shutting down
2026-08-09 09:25:19.345 UTC [24785] LOG: database system is shut down
2026-08-09T09:25:19Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (47151 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:25:19 dist-test-slave-pgkr krb5kdc[26397](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:25:19 dist-test-slave-pgkr krb5kdc[26397](info): set up 2 sockets
Aug 09 09:25:19 dist-test-slave-pgkr krb5kdc[26397](info): commencing operation
krb5kdc: starting...
W20260809 09:25:20.499588 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.013s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:25:20 dist-test-slave-pgkr krb5kdc[26397](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:25:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:25:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:25:20.615224 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:42711
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:41341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:42711,127.11.99.253:39297,127.11.99.252:40129
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:25:20.722301 26412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:20.722613 26412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:20.722713 26412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:20.726176 26412 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:25:20.726244 26412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:20.726277 26412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:20.726334 26412 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:25:20.726372 26412 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:25:20.731247 26412 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:41341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:42711,127.11.99.253:39297,127.11.99.252:40129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:42711
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26412
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:20.732115 26412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:20.733055 26412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:25:20.740927 26421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:20.740986 26419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:20.740971 26418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:20.741091 26412 server_base.cc:1034] running on GCE node
I20260809 09:25:20.741766 26412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:20.742815 26412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:20.744000 26412 hybrid_clock.cc:648] HybridClock initialized: now 1786267520743983 us; error 28 us; skew 500 ppm
Aug 09 09:25:20 dist-test-slave-pgkr krb5kdc[26397](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267520, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:20.746819 26412 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:25:20.747612 26412 webserver.cc:460] Webserver started at http://127.11.99.254:46549/ using document root <none> and password file <none>
I20260809 09:25:20.748127 26412 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:20.748214 26412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:25:20.748435 26412 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:25:20.750450 26412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "a1b0f2894c3043be9fa5401a9d1e3bdd"
format_stamp: "Formatted at 2026-08-09 09:25:20 on dist-test-slave-pgkr"
server_key: "b014511a3e73c272987f9ee3b63ff403"
server_key_iv: "4af201ace20b4800bbb80ed3d0c02882"
server_key_version: "encryptionkey@0"
I20260809 09:25:20.751063 26412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "a1b0f2894c3043be9fa5401a9d1e3bdd"
format_stamp: "Formatted at 2026-08-09 09:25:20 on dist-test-slave-pgkr"
server_key: "b014511a3e73c272987f9ee3b63ff403"
server_key_iv: "4af201ace20b4800bbb80ed3d0c02882"
server_key_version: "encryptionkey@0"
I20260809 09:25:20.754443 26412 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 09:25:20.756682 26428 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:20.757740 26412 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:25:20.757869 26412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "a1b0f2894c3043be9fa5401a9d1e3bdd"
format_stamp: "Formatted at 2026-08-09 09:25:20 on dist-test-slave-pgkr"
server_key: "b014511a3e73c272987f9ee3b63ff403"
server_key_iv: "4af201ace20b4800bbb80ed3d0c02882"
server_key_version: "encryptionkey@0"
I20260809 09:25:20.757966 26412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:20.774050 26412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:20.777017 26412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:20.777202 26412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:20.783617 26412 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:42711
I20260809 09:25:20.783643 26481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:42711 every 8 connection(s)
I20260809 09:25:20.784459 26412 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:25:20.786966 26482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:25:20.790277 26482 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42711 } has no permanent_uuid. Determining permanent_uuid...
I20260809 09:25:20.790999 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 26412
I20260809 09:25:20.791142 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:25:20.791429 11663 external_mini_cluster.cc:1428] Setting key 9a3e7b301459e858b255b4c99c15de29
Aug 09 09:25:20 dist-test-slave-pgkr krb5kdc[26397](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267520, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.99.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.253@KRBTEST.COM" created.
I20260809 09:25:20.806252 26485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:20.792711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:42711 (local address 127.0.0.1:55854)
0809 09:25:20.793649 (+ 938us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:20.793701 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:20.794454 (+ 753us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:20.795077 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:20.795081 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:20.795377 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:20.795603 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:20.795614 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:20.796711 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:20.796713 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:20.797801 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:20.797812 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:20.798996 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:20.799001 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:20.799150 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:20.799725 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:20.799746 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:20.801369 (+ 1623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:20.803130 (+ 1761us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:20.803138 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:20.803145 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:20.803462 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:20.803825 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:20.803827 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:20.803828 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:20.803969 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:20.804601 (+ 632us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:20.804607 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:20.804742 (+ 135us) client_negotiation.cc:769] Sending connection context
0809 09:25:20.804910 (+ 168us) client_negotiation.cc:240] Negotiation successful
0809 09:25:20.805261 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":754,"mutex_wait_us":5,"thread_start_us":118,"threads_started":1}
I20260809 09:25:20.806252 26486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:20.792711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55854 (local address 127.11.99.254:42711)
0809 09:25:20.793258 (+ 547us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:20.793277 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:20.793837 (+ 560us) server_negotiation.cc:407] Connection header received
0809 09:25:20.794746 (+ 909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:20.794750 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:20.794904 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:20.795050 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:20.795750 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:20.796571 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:20.797923 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:20.798570 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:20.798800 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:20.801518 (+ 2718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:20.801528 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:20.801543 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:20.801574 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:20.803033 (+ 1459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:20.803620 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:20.803624 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:20.803626 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:20.803730 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:20.804061 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:20.804068 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:20.804070 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:20.804477 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:20.804612 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:20.804970 (+ 358us) server_negotiation.cc:299] Negotiation successful
0809 09:25:20.805311 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":155,"server-negotiator.queue_time_us":405,"spinlock_wait_cycles":23808,"thread_start_us":139,"threads_started":1}
I20260809 09:25:20.808593 26482 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.253" port: 39297 } has no permanent_uuid. Determining permanent_uuid...
I20260809 09:25:20.809316 26485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:20.809058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:39297 (local address 127.0.0.1:51744)
0809 09:25:20.809175 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:20.809260 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.253:39297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 09:25:20.809573 26429 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.99.253:39297: connect: Connection refused (error 111)
I20260809 09:25:20.810458 26485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:20.810255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:39297 (local address 127.0.0.1:51758)
0809 09:25:20.810363 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:20.810407 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.253:39297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 09:25:20.810709 26482 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.253:39297: Network error: Client connection negotiation failed: client connection to 127.11.99.253:39297: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.253.keytab.
Entry for principal kudu/127.11.99.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.253.keytab.
I20260809 09:25:20.819896 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.253:39297
--webserver_interface=127.11.99.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.253.keytab
--principal=kudu/127.11.99.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:41341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:42711,127.11.99.253:39297,127.11.99.252:40129
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 09:25:20.859938 26482 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.253" port: 39297 } attempt: 1
I20260809 09:25:20.860780 26485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:20.860501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:39297 (local address 127.0.0.1:51774)
0809 09:25:20.860652 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:20.860708 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.253:39297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260809 09:25:20.861537 26485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:20.861278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:39297 (local address 127.0.0.1:51788)
0809 09:25:20.861398 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:20.861463 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.253:39297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 09:25:20.861661 26482 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.253:39297: Network error: Client connection negotiation failed: client connection to 127.11.99.253:39297: connect: Connection refused (error 111)
W20260809 09:25:20.925539 26490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:20.925788 26490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:20.925856 26490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:20.929596 26490 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:25:20.929677 26490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:20.929714 26490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:20.929773 26490 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:25:20.929811 26490 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:25:20.929832 26482 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.253" port: 39297 } attempt: 2
I20260809 09:25:20.930712 26485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:20.930360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:39297 (local address 127.0.0.1:51796)
0809 09:25:20.930511 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:20.930580 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.253:39297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 09:25:20.931414 26485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:20.931195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:39297 (local address 127.0.0.1:51798)
0809 09:25:20.931308 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:20.931355 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.253:39297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 09:25:20.931540 26482 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.253:39297: Network error: Client connection negotiation failed: client connection to 127.11.99.253:39297: connect: Connection refused (error 111)
I20260809 09:25:20.935086 26490 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:41341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:42711,127.11.99.253:39297,127.11.99.252:40129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.253.keytab
--principal=kudu/127.11.99.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.253:39297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.99.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26490
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:20.936025 26490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:20.936918 26490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:25:20.944998 26495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:20.945013 26496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:20.945079 26498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:20.945297 26490 server_base.cc:1034] running on GCE node
I20260809 09:25:20.945829 26490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:20.946856 26490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:20.948004 26490 hybrid_clock.cc:648] HybridClock initialized: now 1786267520947975 us; error 38 us; skew 500 ppm
Aug 09 09:25:20 dist-test-slave-pgkr krb5kdc[26397](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267520, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:20.950664 26490 init.cc:377] Logged in from keytab as kudu/127.11.99.253@KRBTEST.COM (short username kudu)
I20260809 09:25:20.951447 26490 webserver.cc:460] Webserver started at http://127.11.99.253:42023/ using document root <none> and password file <none>
I20260809 09:25:20.951956 26490 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:20.952044 26490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:25:20.952280 26490 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:25:20.954128 26490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-1/data/instance:
uuid: "9a0fb34e9d46484eb66ce095b0e153d1"
format_stamp: "Formatted at 2026-08-09 09:25:20 on dist-test-slave-pgkr"
server_key: "b2a6ccc9dd847870dc92dac9117509b8"
server_key_iv: "c278687f47ef178e4e34e916a1210eb6"
server_key_version: "encryptionkey@0"
I20260809 09:25:20.954734 26490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-1/wal/instance:
uuid: "9a0fb34e9d46484eb66ce095b0e153d1"
format_stamp: "Formatted at 2026-08-09 09:25:20 on dist-test-slave-pgkr"
server_key: "b2a6ccc9dd847870dc92dac9117509b8"
server_key_iv: "c278687f47ef178e4e34e916a1210eb6"
server_key_version: "encryptionkey@0"
I20260809 09:25:20.958036 26490 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 09:25:20.960317 26508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:20.961410 26490 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 09:25:20.961549 26490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-1/wal
uuid: "9a0fb34e9d46484eb66ce095b0e153d1"
format_stamp: "Formatted at 2026-08-09 09:25:20 on dist-test-slave-pgkr"
server_key: "b2a6ccc9dd847870dc92dac9117509b8"
server_key_iv: "c278687f47ef178e4e34e916a1210eb6"
server_key_version: "encryptionkey@0"
I20260809 09:25:20.961654 26490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:20.973064 26490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:20.975600 26490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:20.975777 26490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:20.982265 26490 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.253:39297
I20260809 09:25:20.982283 26563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.253:39297 every 8 connection(s)
I20260809 09:25:20.983160 26490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-1/data/info.pb
I20260809 09:25:20.985420 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 26490
I20260809 09:25:20.985551 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-1/wal/instance
I20260809 09:25:20.985862 11663 external_mini_cluster.cc:1428] Setting key 988ce6e3f7ae525af6b8f0e33b5f2392
I20260809 09:25:20.985903 26564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:25:20.989845 26564 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42711 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.99.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.252@KRBTEST.COM" created.
Aug 09 09:25:20 dist-test-slave-pgkr krb5kdc[26397](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267520, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.253@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:25:21.003975 26486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:20.991639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55858 (local address 127.11.99.254:42711)
0809 09:25:20.991798 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:20.991803 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:20.992583 (+ 780us) server_negotiation.cc:407] Connection header received
0809 09:25:20.993412 (+ 829us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:20.993418 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:20.993483 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:20.993601 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:20.994717 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:20.995305 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:20.996605 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:20.997008 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:20.997096 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:21.000032 (+ 2936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:21.000039 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:21.000045 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:21.000079 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:21.001786 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.002256 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.002262 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.002265 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.002367 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.002764 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.002770 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.002774 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.003016 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:21.003133 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:21.003623 (+ 490us) server_negotiation.cc:299] Negotiation successful
0809 09:25:21.003760 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 09:25:21.004487 26567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:20.991972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:42711 (local address 127.0.0.1:55858)
0809 09:25:20.992427 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:20.992474 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:20.993212 (+ 738us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:20.993740 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:20.993746 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:20.994056 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:20.994540 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:20.994553 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:20.995423 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:20.995426 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:20.996446 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:20.996461 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:20.997168 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:20.997175 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:20.997436 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:20.998040 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:20.998065 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:20.999868 (+ 1803us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:21.001903 (+ 2035us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:21.001907 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:21.001916 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:21.002154 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:21.002465 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:21.002467 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:21.002468 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:21.002602 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:21.003128 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:21.003132 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:21.003347 (+ 215us) client_negotiation.cc:769] Sending connection context
0809 09:25:21.003487 (+ 140us) client_negotiation.cc:240] Negotiation successful
0809 09:25:21.003705 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":123,"threads_started":1}
I20260809 09:25:21.005714 26564 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.253" port: 39297 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 09:25:21 dist-test-slave-pgkr krb5kdc[26397](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267520, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.253@KRBTEST.COM for kudu/127.11.99.253@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.252.keytab.
Entry for principal kudu/127.11.99.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.252.keytab.
I20260809 09:25:21.013073 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.252:40129
--webserver_interface=127.11.99.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.252.keytab
--principal=kudu/127.11.99.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:41341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:42711,127.11.99.253:39297,127.11.99.252:40129
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 09:25:21.015339 26567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.006153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:39297 (local address 127.0.0.1:51810)
0809 09:25:21.006550 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:21.006589 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:21.006709 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:21.007051 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:21.007053 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:21.007175 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:21.007266 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:21.007271 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.008256 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.008261 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:21.008846 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:21.008855 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.009742 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.009745 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:21.009828 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:21.010307 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:21.010319 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:21.011609 (+ 1290us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:21.013563 (+ 1954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:21.013570 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:21.013575 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:21.013855 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:21.014119 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:21.014125 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:21.014130 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:21.014238 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:21.014807 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:21.014809 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:21.014907 (+ 98us) client_negotiation.cc:769] Sending connection context
0809 09:25:21.015040 (+ 133us) client_negotiation.cc:240] Negotiation successful
0809 09:25:21.015162 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294}
I20260809 09:25:21.015388 26569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.006268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51810 (local address 127.11.99.253:39297)
0809 09:25:21.006505 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:21.006531 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:21.006667 (+ 136us) server_negotiation.cc:407] Connection header received
0809 09:25:21.006783 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:21.006786 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:21.006927 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:21.007069 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:21.007372 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.008113 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.008972 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.009582 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.009725 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:21.011745 (+ 2020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:21.011753 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:21.011761 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:21.011780 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:21.013454 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.013956 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.013961 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.013962 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.014032 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.014324 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.014326 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.014327 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.014695 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:21.014839 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:21.015122 (+ 283us) server_negotiation.cc:299] Negotiation successful
0809 09:25:21.015243 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":70,"threads_started":1}
I20260809 09:25:21.017087 26564 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } has no permanent_uuid. Determining permanent_uuid...
I20260809 09:25:21.017825 26567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.017590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40129 (local address 127.0.0.1:56098)
0809 09:25:21.017694 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:21.017764 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 09:25:21.018069 26512 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40129: connect: Connection refused (error 111)
I20260809 09:25:21.018957 26567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.018778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40129 (local address 127.0.0.1:56110)
0809 09:25:21.018873 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:21.018913 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 09:25:21.019127 26564 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.252:40129: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40129: connect: Connection refused (error 111)
I20260809 09:25:21.022675 26482 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.253" port: 39297 } attempt: 3
Aug 09 09:25:21 dist-test-slave-pgkr krb5kdc[26397](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267520, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for kudu/127.11.99.253@KRBTEST.COM
I20260809 09:25:21.031380 26569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.023163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51822 (local address 127.11.99.253:39297)
0809 09:25:21.023269 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:21.023279 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:21.023329 (+ 50us) server_negotiation.cc:407] Connection header received
0809 09:25:21.023478 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:21.023480 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:21.023512 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:21.023572 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:21.024124 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.024612 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.026183 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.026395 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.026472 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:21.028507 (+ 2035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:21.028510 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:21.028512 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:21.028533 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:21.029804 (+ 1271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.030220 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.030225 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.030227 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.030300 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.030567 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.030571 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.030573 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.030778 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:21.030896 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:21.031142 (+ 246us) server_negotiation.cc:299] Negotiation successful
0809 09:25:21.031239 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 09:25:21.031384 26485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.023089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:39297 (local address 127.0.0.1:51822)
0809 09:25:21.023267 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:21.023282 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:21.023388 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:21.023620 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:21.023625 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:21.023821 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:21.023973 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:21.023983 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.024722 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.024725 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:21.026056 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:21.026067 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.026499 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.026503 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:21.026606 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:21.027056 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:21.027070 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:21.028370 (+ 1300us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:21.029929 (+ 1559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:21.029934 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:21.029936 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:21.030126 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:21.030389 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:21.030393 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:21.030394 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:21.030476 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:21.030889 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:21.030892 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:21.030989 (+ 97us) client_negotiation.cc:769] Sending connection context
0809 09:25:21.031094 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 09:25:21.031226 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 09:25:21.032369 26482 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } has no permanent_uuid. Determining permanent_uuid...
I20260809 09:25:21.033017 26485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.032792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40129 (local address 127.0.0.1:56114)
0809 09:25:21.032904 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:21.032957 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 09:25:21.033674 26485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.033414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40129 (local address 127.0.0.1:56120)
0809 09:25:21.033553 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:21.033616 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260809 09:25:21.033794 26482 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.252:40129: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40129: connect: Connection refused (error 111)
I20260809 09:25:21.064949 26482 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } attempt: 1
I20260809 09:25:21.065685 26485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.065424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40129 (local address 127.0.0.1:56122)
0809 09:25:21.065563 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:21.065618 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260809 09:25:21.066390 26485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.066215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40129 (local address 127.0.0.1:56132)
0809 09:25:21.066311 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:21.066348 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 09:25:21.066548 26482 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.252:40129: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40129: connect: Connection refused (error 111)
I20260809 09:25:21.068346 26564 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } attempt: 1
I20260809 09:25:21.068921 26567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.068717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40129 (local address 127.0.0.1:56144)
0809 09:25:21.068823 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:21.068866 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 09:25:21.069526 26567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.069329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40129 (local address 127.0.0.1:56160)
0809 09:25:21.069428 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:21.069473 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 09:25:21.069653 26564 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.252:40129: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40129: connect: Connection refused (error 111)
W20260809 09:25:21.123258 26570 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:21.123546 26570 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:21.123615 26570 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:21.127547 26570 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:25:21.127619 26570 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:21.127673 26570 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:21.127744 26570 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:25:21.127779 26570 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:25:21.133360 26570 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:41341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:42711,127.11.99.253:39297,127.11.99.252:40129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.252.keytab
--principal=kudu/127.11.99.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.252:40129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.99.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26570
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:21.134298 26570 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:21.135306 26570 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 09:25:21.137881 26564 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } attempt: 2
I20260809 09:25:21.138764 26567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.138422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40129 (local address 127.0.0.1:56166)
0809 09:25:21.138592 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:21.138680 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 09:25:21.139477 26567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.139267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40129 (local address 127.0.0.1:56170)
0809 09:25:21.139373 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:21.139417 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 09:25:21.139621 26564 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.252:40129: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40129: connect: Connection refused (error 111)
I20260809 09:25:21.141702 26482 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } attempt: 2
I20260809 09:25:21.142398 26485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.142121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40129 (local address 127.0.0.1:56180)
0809 09:25:21.142258 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:21.142322 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 09:25:21.143146 26485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.142931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40129 (local address 127.0.0.1:56192)
0809 09:25:21.143037 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:21.143086 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 09:25:21.143281 26482 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.252:40129: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40129: connect: Connection refused (error 111)
W20260809 09:25:21.144505 26580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:21.144505 26578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:21.144510 26577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:21.144943 26570 server_base.cc:1034] running on GCE node
I20260809 09:25:21.145406 26570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:21.146407 26570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:21.147567 26570 hybrid_clock.cc:648] HybridClock initialized: now 1786267521147563 us; error 49 us; skew 500 ppm
Aug 09 09:25:21 dist-test-slave-pgkr krb5kdc[26397](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267521, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:21.150236 26570 init.cc:377] Logged in from keytab as kudu/127.11.99.252@KRBTEST.COM (short username kudu)
I20260809 09:25:21.151180 26570 webserver.cc:460] Webserver started at http://127.11.99.252:36073/ using document root <none> and password file <none>
I20260809 09:25:21.151773 26570 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:21.151844 26570 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:25:21.152060 26570 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:25:21.154035 26570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-2/data/instance:
uuid: "2aecead21fb946c5aba7f1c399a58627"
format_stamp: "Formatted at 2026-08-09 09:25:21 on dist-test-slave-pgkr"
server_key: "32631b25d879d627ff9f24df5a22a6ba"
server_key_iv: "e5da4924fdef730925a2ebd48365ce14"
server_key_version: "encryptionkey@0"
I20260809 09:25:21.154592 26570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-2/wal/instance:
uuid: "2aecead21fb946c5aba7f1c399a58627"
format_stamp: "Formatted at 2026-08-09 09:25:21 on dist-test-slave-pgkr"
server_key: "32631b25d879d627ff9f24df5a22a6ba"
server_key_iv: "e5da4924fdef730925a2ebd48365ce14"
server_key_version: "encryptionkey@0"
I20260809 09:25:21.158154 26570 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 09:25:21.160444 26587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:21.161623 26570 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 09:25:21.161772 26570 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-2/wal
uuid: "2aecead21fb946c5aba7f1c399a58627"
format_stamp: "Formatted at 2026-08-09 09:25:21 on dist-test-slave-pgkr"
server_key: "32631b25d879d627ff9f24df5a22a6ba"
server_key_iv: "e5da4924fdef730925a2ebd48365ce14"
server_key_version: "encryptionkey@0"
I20260809 09:25:21.161895 26570 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:21.173444 26570 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:21.176298 26570 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:21.176487 26570 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:21.184098 26570 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.252:40129
I20260809 09:25:21.184120 26641 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.252:40129 every 8 connection(s)
I20260809 09:25:21.184957 26570 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-2/data/info.pb
I20260809 09:25:21.187747 26642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:25:21.189895 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 26570
I20260809 09:25:21.189996 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786267363058776-11663-0/minicluster-data/master-2/wal/instance
I20260809 09:25:21.190253 11663 external_mini_cluster.cc:1428] Setting key 1849310ff253fc0dd5b50ef570088c90
I20260809 09:25:21.191958 26642 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42711 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 09:25:21 dist-test-slave-pgkr krb5kdc[26397](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267521, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.252@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
Aug 09 09:25:21 dist-test-slave-pgkr krb5kdc[26397](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.252@KRBTEST.COM
I20260809 09:25:21.204277 26486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.193889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55870 (local address 127.11.99.254:42711)
0809 09:25:21.194024 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:21.194029 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:21.194445 (+ 416us) server_negotiation.cc:407] Connection header received
0809 09:25:21.194703 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:21.194707 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:21.194757 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:21.194862 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:21.195573 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.196084 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.197098 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.197347 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.197477 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:21.200149 (+ 2672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:21.200152 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:21.200154 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:21.200179 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:21.202074 (+ 1895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.202733 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.202737 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.202739 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.202856 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.203256 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.203259 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.203260 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.203484 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:21.203586 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:21.203977 (+ 391us) server_negotiation.cc:299] Negotiation successful
0809 09:25:21.204116 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 09:25:21.205004 26647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.191595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56196 (local address 127.11.99.252:40129)
0809 09:25:21.192048 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:21.192069 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:21.192113 (+ 44us) server_negotiation.cc:407] Connection header received
0809 09:25:21.192930 (+ 817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:21.192951 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:21.193338 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:21.193633 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:21.194562 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.195555 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.196410 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.196896 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.197068 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:21.200615 (+ 3547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:21.200620 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:21.200629 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:21.200649 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:21.202245 (+ 1596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.202744 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.202750 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.202752 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.202891 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.203236 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.203241 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.203243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.203704 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:21.203851 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:21.204146 (+ 295us) server_negotiation.cc:299] Negotiation successful
0809 09:25:21.204284 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":294,"spinlock_wait_cycles":6528,"thread_start_us":115,"threads_started":1}
I20260809 09:25:21.205030 26648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.193828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:42711 (local address 127.0.0.1:55870)
0809 09:25:21.194295 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:21.194350 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:21.194552 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:21.194904 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:21.194910 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:21.195243 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:21.195398 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:21.195408 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.196227 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.196231 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:21.196957 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:21.196966 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.197521 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.197524 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:21.197643 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:21.198106 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:21.198132 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:21.199978 (+ 1846us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:21.202198 (+ 2220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:21.202210 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:21.202220 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:21.202591 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:21.202995 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:21.202999 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:21.203001 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:21.203150 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:21.203589 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:21.203594 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:21.203716 (+ 122us) client_negotiation.cc:769] Sending connection context
0809 09:25:21.203897 (+ 181us) client_negotiation.cc:240] Negotiation successful
0809 09:25:21.204221 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"mutex_wait_us":42,"thread_start_us":125,"threads_started":1}
I20260809 09:25:21.206342 26642 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.253" port: 39297 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 09:25:21 dist-test-slave-pgkr krb5kdc[26397](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267521, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.252@KRBTEST.COM for kudu/127.11.99.253@KRBTEST.COM
Aug 09 09:25:21 dist-test-slave-pgkr krb5kdc[26397](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:25:21.215662 26648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.206856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:39297 (local address 127.0.0.1:51834)
0809 09:25:21.207026 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:21.207042 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:21.207123 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:21.207387 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:21.207390 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:21.207584 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:21.207703 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:21.207710 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.208764 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.208767 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:21.209526 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:21.209534 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.210094 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.210096 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:21.210161 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:21.210691 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:21.210705 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:21.212003 (+ 1298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:21.214160 (+ 2157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:21.214163 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:21.214164 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:21.214347 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:21.214678 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:21.214685 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:21.214686 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:21.214766 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:21.215186 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:21.215189 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:21.215284 (+ 95us) client_negotiation.cc:769] Sending connection context
0809 09:25:21.215389 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 09:25:21.215509 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90}
I20260809 09:25:21.215683 26569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.206951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51834 (local address 127.11.99.253:39297)
0809 09:25:21.207114 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:21.207117 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:21.207132 (+ 15us) server_negotiation.cc:407] Connection header received
0809 09:25:21.207218 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:21.207220 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:21.207260 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:21.207355 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:21.207871 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.208656 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.209639 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.209982 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.210103 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:21.212145 (+ 2042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:21.212149 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:21.212152 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:21.212187 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:21.214040 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.214443 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.214447 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.214448 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.214550 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.214864 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.214868 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.214872 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.215087 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:21.215195 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:21.215444 (+ 249us) server_negotiation.cc:299] Negotiation successful
0809 09:25:21.215550 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 09:25:21.216574 26486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.207521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55886 (local address 127.11.99.254:42711)
0809 09:25:21.207657 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:21.207663 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:21.207678 (+ 15us) server_negotiation.cc:407] Connection header received
0809 09:25:21.207710 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:21.207714 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:21.207770 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:21.207863 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:21.208590 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.209265 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.210336 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.210706 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.210831 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:21.213252 (+ 2421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:21.213256 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:21.213258 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:21.213285 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:21.214785 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.215255 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.215259 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.215260 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.215342 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.215610 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.215613 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.215615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.215862 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:21.216122 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:21.216269 (+ 147us) server_negotiation.cc:299] Negotiation successful
0809 09:25:21.216410 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 09:25:21.216598 26642 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 09:25:21 dist-test-slave-pgkr krb5kdc[26397](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267521, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.252@KRBTEST.COM for kudu/127.11.99.252@KRBTEST.COM
Aug 09 09:25:21 dist-test-slave-pgkr krb5kdc[26397](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.253@KRBTEST.COM
I20260809 09:25:21.225204 26648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.217079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40129 (local address 127.0.0.1:56206)
0809 09:25:21.217159 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:21.217173 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:21.217241 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:21.217477 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:21.217479 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:21.217632 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:21.217711 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:21.217718 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.219123 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.219126 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:21.219675 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:21.219683 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.220221 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.220224 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:21.220316 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:21.220744 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:21.220755 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:21.221992 (+ 1237us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:21.223812 (+ 1820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:21.223816 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:21.223818 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:21.224012 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:21.224276 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:21.224282 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:21.224284 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:21.224364 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:21.224708 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:21.224710 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:21.224800 (+ 90us) client_negotiation.cc:769] Sending connection context
0809 09:25:21.224898 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 09:25:21.225025 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260809 09:25:21.225222 26647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.217207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56206 (local address 127.11.99.252:40129)
0809 09:25:21.217314 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:21.217318 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:21.217328 (+ 10us) server_negotiation.cc:407] Connection header received
0809 09:25:21.217353 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:21.217355 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:21.217390 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:21.217467 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:21.217873 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.219026 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.219777 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.220101 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.220183 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:21.222107 (+ 1924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:21.222111 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:21.222113 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:21.222140 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:21.223694 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.224103 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.224109 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.224111 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.224187 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.224449 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.224454 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.224456 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.224612 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:21.224707 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:21.224949 (+ 242us) server_negotiation.cc:299] Negotiation successful
0809 09:25:21.225078 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":47}
I20260809 09:25:21.225948 26569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.217650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51836 (local address 127.11.99.253:39297)
0809 09:25:21.217768 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:21.217774 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:21.217787 (+ 13us) server_negotiation.cc:407] Connection header received
0809 09:25:21.217910 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:21.217917 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:21.217949 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:21.218002 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:21.218761 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.219261 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.220000 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.220243 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.220334 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:21.222806 (+ 2472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:21.222809 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:21.222812 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:21.222834 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:21.224108 (+ 1274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.224541 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.224544 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.224545 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.224614 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.224956 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.224960 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.224961 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.225124 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:21.225717 (+ 593us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:21.225776 (+ 59us) server_negotiation.cc:299] Negotiation successful
0809 09:25:21.225854 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 09:25:21.228677 26642 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627: Bootstrap starting.
I20260809 09:25:21.229310 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 09:25:21.230782 26564 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } attempt: 3
I20260809 09:25:21.231416 26642 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627: Neither blocks nor log segments found. Creating new log.
I20260809 09:25:21.232276 26642 log.cc:824] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627: Log is configured to *not* fsync() on all Append() calls
I20260809 09:25:21.234193 26642 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627: No bootstrap required, opened a new log
I20260809 09:25:21.237704 26642 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1b0f2894c3043be9fa5401a9d1e3bdd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42711 } } peers { permanent_uuid: "9a0fb34e9d46484eb66ce095b0e153d1" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 39297 } } peers { permanent_uuid: "2aecead21fb946c5aba7f1c399a58627" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } }
I20260809 09:25:21.237970 26642 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:25:21.238036 26642 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2aecead21fb946c5aba7f1c399a58627, State: Initialized, Role: FOLLOWER
I20260809 09:25:21.241492 26569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.231742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51838 (local address 127.11.99.253:39297)
0809 09:25:21.231934 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:21.231939 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:21.231950 (+ 11us) server_negotiation.cc:407] Connection header received
0809 09:25:21.231979 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:21.231981 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:21.232045 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:21.232135 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:21.233049 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.233802 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.235180 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.235488 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.235593 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:21.237558 (+ 1965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:21.237561 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:21.237563 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:21.237591 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:21.239281 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.239749 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.239754 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.239756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.239870 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.240160 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.240165 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.240168 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.240401 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:21.240550 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:21.241202 (+ 652us) server_negotiation.cc:299] Negotiation successful
0809 09:25:21.241314 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":118}
I20260809 09:25:21.241729 26486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.232055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55890 (local address 127.11.99.254:42711)
0809 09:25:21.232176 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:21.232180 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:21.233110 (+ 930us) server_negotiation.cc:407] Connection header received
0809 09:25:21.233272 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:21.233275 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:21.233332 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:21.233378 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:21.234355 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.235115 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.236050 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.236270 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.236384 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:21.237775 (+ 1391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:21.237778 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:21.237780 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:21.237808 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:21.239293 (+ 1485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.240123 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.240127 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.240130 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.240231 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.240534 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.240537 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.240539 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.240751 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:21.240839 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:21.241469 (+ 630us) server_negotiation.cc:299] Negotiation successful
0809 09:25:21.241582 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
Aug 09 09:25:21 dist-test-slave-pgkr krb5kdc[26397](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267520, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.253@KRBTEST.COM for kudu/127.11.99.252@KRBTEST.COM
I20260809 09:25:21.242550 26482 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } attempt: 3
I20260809 09:25:21.243350 26642 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1b0f2894c3043be9fa5401a9d1e3bdd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42711 } } peers { permanent_uuid: "9a0fb34e9d46484eb66ce095b0e153d1" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 39297 } } peers { permanent_uuid: "2aecead21fb946c5aba7f1c399a58627" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } }
I20260809 09:25:21.245355 26660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1b0f2894c3043be9fa5401a9d1e3bdd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42711 } } peers { permanent_uuid: "9a0fb34e9d46484eb66ce095b0e153d1" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 39297 } } peers { permanent_uuid: "2aecead21fb946c5aba7f1c399a58627" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } } }
I20260809 09:25:21.246253 26567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.231125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40129 (local address 127.0.0.1:56216)
0809 09:25:21.231382 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:21.231405 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:21.231470 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:21.232898 (+ 1428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:21.232903 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:21.233073 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:21.233987 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:21.233992 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.239359 (+ 5367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.239363 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:21.240122 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:21.240131 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.240750 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.240753 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:21.240832 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:21.241256 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:21.241269 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:21.242721 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:21.244646 (+ 1925us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:21.244649 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:21.244651 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:21.244887 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:21.245226 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:21.245231 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:21.245232 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:21.245325 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:21.245813 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:21.245816 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:21.245904 (+ 88us) client_negotiation.cc:769] Sending connection context
0809 09:25:21.245985 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 09:25:21.246089 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":810}
I20260809 09:25:21.246781 26647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.231184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56216 (local address 127.11.99.252:40129)
0809 09:25:21.232651 (+ 1467us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:21.232655 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:21.232668 (+ 13us) server_negotiation.cc:407] Connection header received
0809 09:25:21.232702 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:21.232707 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:21.232748 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:21.238340 (+ 5592us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:21.238435 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.239216 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.240308 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.240631 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.241023 (+ 392us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:21.242863 (+ 1840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:21.242867 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:21.242869 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:21.242895 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:21.244527 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.245004 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.245007 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.245009 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.245112 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.245441 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.245447 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.245451 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.245709 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:21.246427 (+ 718us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:21.246490 (+ 63us) server_negotiation.cc:299] Negotiation successful
0809 09:25:21.246616 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":1411}
I20260809 09:25:21.249451 26642 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [sys.catalog]: configured and running, proceeding with master startup.
Aug 09 09:25:21 dist-test-slave-pgkr krb5kdc[26397](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267520, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for kudu/127.11.99.252@KRBTEST.COM
I20260809 09:25:21.249974 26564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a0fb34e9d46484eb66ce095b0e153d1: Bootstrap starting.
I20260809 09:25:21.253949 26485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.242924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40129 (local address 127.0.0.1:56232)
0809 09:25:21.243012 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:21.243026 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:21.243094 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:21.245820 (+ 2726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:21.245822 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:21.245996 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:21.246095 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:21.246101 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.247428 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.247431 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:21.247884 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:21.247891 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.248293 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.248296 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:21.248373 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:21.248805 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:21.248819 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:21.250132 (+ 1313us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:21.252265 (+ 2133us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:21.252268 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:21.252270 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:21.252554 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:21.252900 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:21.252904 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:21.252907 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:21.253005 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:21.253478 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:21.253482 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:21.253583 (+ 101us) client_negotiation.cc:769] Sending connection context
0809 09:25:21.253660 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 09:25:21.253783 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260809 09:25:21.254305 26564 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a0fb34e9d46484eb66ce095b0e153d1: Neither blocks nor log segments found. Creating new log.
I20260809 09:25:21.252377 26658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.232472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56218 (local address 127.11.99.252:40129)
0809 09:25:21.233095 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:21.233106 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:21.239594 (+ 6488us) server_negotiation.cc:407] Connection header received
0809 09:25:21.239706 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:21.239709 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:21.239757 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:21.239831 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:21.240594 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.241324 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.242454 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.242874 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.242964 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:21.244499 (+ 1535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:21.244502 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:21.244505 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:21.244530 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:21.246275 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.246935 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.246940 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.246943 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.247028 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.250686 (+ 3658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.250691 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.250694 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.250954 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:21.251094 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:21.251709 (+ 615us) server_negotiation.cc:299] Negotiation successful
0809 09:25:21.252147 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":93,"threads_started":1}
I20260809 09:25:21.252415 26665 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:25:21.254485 26661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:21.244019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56232 (local address 127.11.99.252:40129)
0809 09:25:21.245272 (+ 1253us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:21.245292 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:21.245303 (+ 11us) server_negotiation.cc:407] Connection header received
0809 09:25:21.245644 (+ 341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:21.245647 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:21.245690 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:21.246192 (+ 502us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:21.246271 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.247313 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.247992 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:21.248194 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:21.248291 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:21.250275 (+ 1984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:21.250278 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:21.250280 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:21.250302 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:21.252113 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.252693 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.252696 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.252698 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.252786 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:21.253142 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:21.253147 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:21.253149 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:21.253358 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:21.254119 (+ 761us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:21.254205 (+ 86us) server_negotiation.cc:299] Negotiation successful
0809 09:25:21.254325 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1187,"thread_start_us":94,"threads_started":1}
I20260809 09:25:21.255165 26665 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1b0f2894c3043be9fa5401a9d1e3bdd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42711 } } peers { permanent_uuid: "9a0fb34e9d46484eb66ce095b0e153d1" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 39297 } } peers { permanent_uuid: "2aecead21fb946c5aba7f1c399a58627" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } }
I20260809 09:25:21.257802 26482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1b0f2894c3043be9fa5401a9d1e3bdd: Bootstrap starting.
I20260809 09:25:21.257854 26665 leader_election.cc:288] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1b0f2894c3043be9fa5401a9d1e3bdd (127.11.99.254:42711), 9a0fb34e9d46484eb66ce095b0e153d1 (127.11.99.253:39297)
I20260809 09:25:21.256018 26570 master_runner.cc:186] Error getting master registration for 127.11.99.254:42711: OK, instance_id { permanent_uuid: "a1b0f2894c3043be9fa5401a9d1e3bdd" instance_seqno: 1786267520781710 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 09:25:21.259203 26570 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 09:25:21.259582 26564 log.cc:824] T 00000000000000000000000000000000 P 9a0fb34e9d46484eb66ce095b0e153d1: Log is configured to *not* fsync() on all Append() calls
I20260809 09:25:21.260056 26660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:25:21.260298 26482 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a1b0f2894c3043be9fa5401a9d1e3bdd: Neither blocks nor log segments found. Creating new log.
W20260809 09:25:21.260756 26674 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 09:25:21.260808 26674 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 09:25:21.261070 26482 log.cc:824] T 00000000000000000000000000000000 P a1b0f2894c3043be9fa5401a9d1e3bdd: Log is configured to *not* fsync() on all Append() calls
I20260809 09:25:21.261967 26564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a0fb34e9d46484eb66ce095b0e153d1: No bootstrap required, opened a new log
I20260809 09:25:21.262933 26482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1b0f2894c3043be9fa5401a9d1e3bdd: No bootstrap required, opened a new log
I20260809 09:25:21.265950 26564 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9a0fb34e9d46484eb66ce095b0e153d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1b0f2894c3043be9fa5401a9d1e3bdd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42711 } } peers { permanent_uuid: "9a0fb34e9d46484eb66ce095b0e153d1" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 39297 } } peers { permanent_uuid: "2aecead21fb946c5aba7f1c399a58627" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } }
I20260809 09:25:21.266155 26564 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9a0fb34e9d46484eb66ce095b0e153d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:25:21.266212 26564 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9a0fb34e9d46484eb66ce095b0e153d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a0fb34e9d46484eb66ce095b0e153d1, State: Initialized, Role: FOLLOWER
I20260809 09:25:21.266661 26564 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a0fb34e9d46484eb66ce095b0e153d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1b0f2894c3043be9fa5401a9d1e3bdd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42711 } } peers { permanent_uuid: "9a0fb34e9d46484eb66ce095b0e153d1" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 39297 } } peers { permanent_uuid: "2aecead21fb946c5aba7f1c399a58627" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } }
I20260809 09:25:21.266710 26482 raft_consensus.cc:348] T 00000000000000000000000000000000 P a1b0f2894c3043be9fa5401a9d1e3bdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1b0f2894c3043be9fa5401a9d1e3bdd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42711 } } peers { permanent_uuid: "9a0fb34e9d46484eb66ce095b0e153d1" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 39297 } } peers { permanent_uuid: "2aecead21fb946c5aba7f1c399a58627" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } }
I20260809 09:25:21.266933 26482 raft_consensus.cc:374] T 00000000000000000000000000000000 P a1b0f2894c3043be9fa5401a9d1e3bdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:25:21.266992 26482 raft_consensus.cc:729] T 00000000000000000000000000000000 P a1b0f2894c3043be9fa5401a9d1e3bdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1b0f2894c3043be9fa5401a9d1e3bdd, State: Initialized, Role: FOLLOWER
I20260809 09:25:21.267431 26482 consensus_queue.cc:260] T 00000000000000000000000000000000 P a1b0f2894c3043be9fa5401a9d1e3bdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1b0f2894c3043be9fa5401a9d1e3bdd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42711 } } peers { permanent_uuid: "9a0fb34e9d46484eb66ce095b0e153d1" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 39297 } } peers { permanent_uuid: "2aecead21fb946c5aba7f1c399a58627" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } }
I20260809 09:25:21.267977 26564 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9a0fb34e9d46484eb66ce095b0e153d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:25:21.268056 26535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2aecead21fb946c5aba7f1c399a58627" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a0fb34e9d46484eb66ce095b0e153d1" is_pre_election: true
I20260809 09:25:21.268321 26535 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9a0fb34e9d46484eb66ce095b0e153d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2aecead21fb946c5aba7f1c399a58627 in term 0.
I20260809 09:25:21.268671 26482 sys_catalog.cc:564] T 00000000000000000000000000000000 P a1b0f2894c3043be9fa5401a9d1e3bdd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:25:21.268785 26588 leader_election.cc:302] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aecead21fb946c5aba7f1c399a58627, 9a0fb34e9d46484eb66ce095b0e153d1; no voters:
I20260809 09:25:21.269075 26660 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:25:21.269164 26660 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:25:21.269204 26660 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:25:21.270601 26660 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1b0f2894c3043be9fa5401a9d1e3bdd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42711 } } peers { permanent_uuid: "9a0fb34e9d46484eb66ce095b0e153d1" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 39297 } } peers { permanent_uuid: "2aecead21fb946c5aba7f1c399a58627" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } }
I20260809 09:25:21.271040 26660 leader_election.cc:288] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [CANDIDATE]: Term 1 election: Requested vote from peers a1b0f2894c3043be9fa5401a9d1e3bdd (127.11.99.254:42711), 9a0fb34e9d46484eb66ce095b0e153d1 (127.11.99.253:39297)
I20260809 09:25:21.272594 26455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2aecead21fb946c5aba7f1c399a58627" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1b0f2894c3043be9fa5401a9d1e3bdd"
I20260809 09:25:21.272799 26455 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a1b0f2894c3043be9fa5401a9d1e3bdd [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:25:21.274173 26456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2aecead21fb946c5aba7f1c399a58627" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1b0f2894c3043be9fa5401a9d1e3bdd" is_pre_election: true
I20260809 09:25:21.274547 26455 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a1b0f2894c3043be9fa5401a9d1e3bdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aecead21fb946c5aba7f1c399a58627 in term 1.
I20260809 09:25:21.275556 26590 leader_election.cc:302] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aecead21fb946c5aba7f1c399a58627, a1b0f2894c3043be9fa5401a9d1e3bdd; no voters:
I20260809 09:25:21.275801 26535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2aecead21fb946c5aba7f1c399a58627" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a0fb34e9d46484eb66ce095b0e153d1"
I20260809 09:25:21.275915 26535 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9a0fb34e9d46484eb66ce095b0e153d1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:25:21.276974 26535 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9a0fb34e9d46484eb66ce095b0e153d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aecead21fb946c5aba7f1c399a58627 in term 1.
W20260809 09:25:21.277572 26702 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a1b0f2894c3043be9fa5401a9d1e3bdd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 09:25:21.277650 26702 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260809 09:25:21.278534 26434 tablet.cc:2369] T 00000000000000000000000000000000 P a1b0f2894c3043be9fa5401a9d1e3bdd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:25:21.279083 26678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a0fb34e9d46484eb66ce095b0e153d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1b0f2894c3043be9fa5401a9d1e3bdd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42711 } } peers { permanent_uuid: "9a0fb34e9d46484eb66ce095b0e153d1" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 39297 } } peers { permanent_uuid: "2aecead21fb946c5aba7f1c399a58627" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } } }
I20260809 09:25:21.279233 26678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a0fb34e9d46484eb66ce095b0e153d1 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:25:21.279443 26679 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1b0f2894c3043be9fa5401a9d1e3bdd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1b0f2894c3043be9fa5401a9d1e3bdd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42711 } } peers { permanent_uuid: "9a0fb34e9d46484eb66ce095b0e153d1" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 39297 } } peers { permanent_uuid: "2aecead21fb946c5aba7f1c399a58627" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } } }
I20260809 09:25:21.279546 26679 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1b0f2894c3043be9fa5401a9d1e3bdd [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:25:21.282532 26660 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:25:21.282696 26490 master_runner.cc:263] No leader master found from master 9a0fb34e9d46484eb66ce095b0e153d1
I20260809 09:25:21.282783 26490 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 09:25:21.282891 26660 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [term 1 LEADER]: Becoming Leader. State: Replica: 2aecead21fb946c5aba7f1c399a58627, State: Running, Role: LEADER
I20260809 09:25:21.283170 26660 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1b0f2894c3043be9fa5401a9d1e3bdd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42711 } } peers { permanent_uuid: "9a0fb34e9d46484eb66ce095b0e153d1" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 39297 } } peers { permanent_uuid: "2aecead21fb946c5aba7f1c399a58627" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } }
I20260809 09:25:21.284883 26665 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2aecead21fb946c5aba7f1c399a58627. Latest consensus state: current_term: 1 leader_uuid: "2aecead21fb946c5aba7f1c399a58627" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1b0f2894c3043be9fa5401a9d1e3bdd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42711 } } peers { permanent_uuid: "9a0fb34e9d46484eb66ce095b0e153d1" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 39297 } } peers { permanent_uuid: "2aecead21fb946c5aba7f1c399a58627" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } } }
I20260809 09:25:21.285032 26665 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [sys.catalog]: This master's current role is: LEADER
W20260809 09:25:21.285714 26696 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9a0fb34e9d46484eb66ce095b0e153d1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 09:25:21.285797 26696 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 09:25:21.286123 26412 master_runner.cc:263] No leader master found from master a1b0f2894c3043be9fa5401a9d1e3bdd
I20260809 09:25:21.286193 26412 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 09:25:21.288763 26707 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:25:21.289702 26707 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:25:21.298838 26535 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9a0fb34e9d46484eb66ce095b0e153d1 [term 1 FOLLOWER]: Refusing update from remote peer 2aecead21fb946c5aba7f1c399a58627: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:25:21.299079 26454 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a1b0f2894c3043be9fa5401a9d1e3bdd [term 1 FOLLOWER]: Refusing update from remote peer 2aecead21fb946c5aba7f1c399a58627: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:25:21.299441 26660 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a0fb34e9d46484eb66ce095b0e153d1" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 39297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:25:21.299604 26665 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b0f2894c3043be9fa5401a9d1e3bdd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:25:21.302811 26679 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1b0f2894c3043be9fa5401a9d1e3bdd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2aecead21fb946c5aba7f1c399a58627. Latest consensus state: current_term: 1 leader_uuid: "2aecead21fb946c5aba7f1c399a58627" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1b0f2894c3043be9fa5401a9d1e3bdd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42711 } } peers { permanent_uuid: "9a0fb34e9d46484eb66ce095b0e153d1" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 39297 } } peers { permanent_uuid: "2aecead21fb946c5aba7f1c399a58627" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } } }
I20260809 09:25:21.302946 26679 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1b0f2894c3043be9fa5401a9d1e3bdd [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:25:21.302929 26678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a0fb34e9d46484eb66ce095b0e153d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2aecead21fb946c5aba7f1c399a58627. Latest consensus state: current_term: 1 leader_uuid: "2aecead21fb946c5aba7f1c399a58627" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1b0f2894c3043be9fa5401a9d1e3bdd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42711 } } peers { permanent_uuid: "9a0fb34e9d46484eb66ce095b0e153d1" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 39297 } } peers { permanent_uuid: "2aecead21fb946c5aba7f1c399a58627" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } } }
I20260809 09:25:21.303054 26678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a0fb34e9d46484eb66ce095b0e153d1 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:25:21.312965 26665 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2aecead21fb946c5aba7f1c399a58627" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1b0f2894c3043be9fa5401a9d1e3bdd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42711 } } peers { permanent_uuid: "9a0fb34e9d46484eb66ce095b0e153d1" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 39297 } } peers { permanent_uuid: "2aecead21fb946c5aba7f1c399a58627" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } } }
I20260809 09:25:21.313102 26665 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [sys.catalog]: This master's current role is: LEADER
I20260809 09:25:21.313788 26660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2aecead21fb946c5aba7f1c399a58627" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1b0f2894c3043be9fa5401a9d1e3bdd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42711 } } peers { permanent_uuid: "9a0fb34e9d46484eb66ce095b0e153d1" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 39297 } } peers { permanent_uuid: "2aecead21fb946c5aba7f1c399a58627" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } } }
I20260809 09:25:21.313896 26660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627 [sys.catalog]: This master's current role is: LEADER
I20260809 09:25:21.314062 26679 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1b0f2894c3043be9fa5401a9d1e3bdd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2aecead21fb946c5aba7f1c399a58627" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1b0f2894c3043be9fa5401a9d1e3bdd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42711 } } peers { permanent_uuid: "9a0fb34e9d46484eb66ce095b0e153d1" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 39297 } } peers { permanent_uuid: "2aecead21fb946c5aba7f1c399a58627" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } } }
I20260809 09:25:21.314179 26679 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1b0f2894c3043be9fa5401a9d1e3bdd [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:25:21.316504 26678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a0fb34e9d46484eb66ce095b0e153d1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2aecead21fb946c5aba7f1c399a58627" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1b0f2894c3043be9fa5401a9d1e3bdd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42711 } } peers { permanent_uuid: "9a0fb34e9d46484eb66ce095b0e153d1" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 39297 } } peers { permanent_uuid: "2aecead21fb946c5aba7f1c399a58627" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40129 } } }
I20260809 09:25:21.316604 26678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a0fb34e9d46484eb66ce095b0e153d1 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:25:21.317822 26709 mvcc.cc:205] Tried to move back new op lower bound from 7316551767234019328 to 7316551767178686464. Current Snapshot: MvccSnapshot[applied={T|T < 7316551767234019328}]
I20260809 09:25:21.318027 26710 mvcc.cc:205] Tried to move back new op lower bound from 7316551767234019328 to 7316551767178686464. Current Snapshot: MvccSnapshot[applied={T|T < 7316551767234019328}]
I20260809 09:25:21.322341 26707 catalog_manager.cc:1347] Generated new cluster ID: bb0ab0d5e22e48d28e3e18675efbf5e9
I20260809 09:25:21.322397 26707 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:25:21.339165 26707 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:25:21.340348 26707 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:25:21.351799 26707 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2aecead21fb946c5aba7f1c399a58627: Generated new TSK 0
I20260809 09:25:21.352573 26707 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:25:22.279091 26702 catalog_manager.cc:1259] Loaded cluster ID: bb0ab0d5e22e48d28e3e18675efbf5e9
I20260809 09:25:22.279189 26702 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a1b0f2894c3043be9fa5401a9d1e3bdd: loading cluster ID for follower catalog manager: success
I20260809 09:25:22.280884 26702 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a1b0f2894c3043be9fa5401a9d1e3bdd: acquiring CA information for follower catalog manager: success
I20260809 09:25:22.281986 26702 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a1b0f2894c3043be9fa5401a9d1e3bdd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 09:25:22.287089 26696 catalog_manager.cc:1259] Loaded cluster ID: bb0ab0d5e22e48d28e3e18675efbf5e9
I20260809 09:25:22.287148 26696 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9a0fb34e9d46484eb66ce095b0e153d1: loading cluster ID for follower catalog manager: success
I20260809 09:25:22.288650 26696 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9a0fb34e9d46484eb66ce095b0e153d1: acquiring CA information for follower catalog manager: success
I20260809 09:25:22.289644 26696 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9a0fb34e9d46484eb66ce095b0e153d1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 09:25:22.423614 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 26412
I20260809 09:25:22.432291 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 26490
I20260809 09:25:22.439100 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 26570
2026-08-09T09:25:22Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (2974 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:25:22 dist-test-slave-pgkr krb5kdc[26725](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:25:22 dist-test-slave-pgkr krb5kdc[26725](info): set up 2 sockets
Aug 09 09:25:22 dist-test-slave-pgkr krb5kdc[26725](info): commencing operation
krb5kdc: starting...
W20260809 09:25:23.502926 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.042s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:25:23 dist-test-slave-pgkr krb5kdc[26725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267523, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:25:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:25:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:25:23.618413 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:42093
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:33731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:42093
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:25:23.723977 26740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:23.724244 26740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:23.724321 26740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:23.728287 26740 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:25:23.728364 26740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:23.728401 26740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:23.728456 26740 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:25:23.728492 26740 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:25:23.733521 26740 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:33731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:42093
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:42093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26740
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:23.734476 26740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:23.735477 26740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:25:23.743434 26745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:23.743418 26746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:23.743441 26748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:23.743628 26740 server_base.cc:1034] running on GCE node
I20260809 09:25:23.744253 26740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:23.745225 26740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:23.746402 26740 hybrid_clock.cc:648] HybridClock initialized: now 1786267523746390 us; error 29 us; skew 500 ppm
Aug 09 09:25:23 dist-test-slave-pgkr krb5kdc[26725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267523, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:23.749337 26740 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:25:23.750125 26740 webserver.cc:460] Webserver started at http://127.11.99.254:45601/ using document root <none> and password file <none>
I20260809 09:25:23.750715 26740 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:23.750802 26740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:25:23.751045 26740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:25:23.752987 26740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "cc0c4226cc6d48428cd8e6266bec5594"
format_stamp: "Formatted at 2026-08-09 09:25:23 on dist-test-slave-pgkr"
server_key: "091cff1cea94b738096a2416e60d210c"
server_key_iv: "26d9964663fa55d6fc59bd3a772b461d"
server_key_version: "encryptionkey@0"
I20260809 09:25:23.753523 26740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "cc0c4226cc6d48428cd8e6266bec5594"
format_stamp: "Formatted at 2026-08-09 09:25:23 on dist-test-slave-pgkr"
server_key: "091cff1cea94b738096a2416e60d210c"
server_key_iv: "26d9964663fa55d6fc59bd3a772b461d"
server_key_version: "encryptionkey@0"
I20260809 09:25:23.757053 26740 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 09:25:23.759152 26757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:23.760303 26740 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:25:23.760442 26740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "cc0c4226cc6d48428cd8e6266bec5594"
format_stamp: "Formatted at 2026-08-09 09:25:23 on dist-test-slave-pgkr"
server_key: "091cff1cea94b738096a2416e60d210c"
server_key_iv: "26d9964663fa55d6fc59bd3a772b461d"
server_key_version: "encryptionkey@0"
I20260809 09:25:23.760548 26740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:23.788944 26740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:23.792308 26740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:23.792528 26740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:23.799723 26740 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:42093
I20260809 09:25:23.799749 26813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:42093 every 8 connection(s)
I20260809 09:25:23.800611 26740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:25:23.803299 26814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:25:23.804616 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 26740
I20260809 09:25:23.804742 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:25:23.805063 11663 external_mini_cluster.cc:1428] Setting key 2336d536c0be9d1223400e3ccc270b26
I20260809 09:25:23.809974 26814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc0c4226cc6d48428cd8e6266bec5594: Bootstrap starting.
I20260809 09:25:23.812458 26814 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc0c4226cc6d48428cd8e6266bec5594: Neither blocks nor log segments found. Creating new log.
I20260809 09:25:23.813235 26814 log.cc:824] T 00000000000000000000000000000000 P cc0c4226cc6d48428cd8e6266bec5594: Log is configured to *not* fsync() on all Append() calls
Aug 09 09:25:23 dist-test-slave-pgkr krb5kdc[26725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267523, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:25:23.815397 26814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc0c4226cc6d48428cd8e6266bec5594: No bootstrap required, opened a new log
I20260809 09:25:23.820122 26817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:23.806324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41090 (local address 127.11.99.254:42093)
0809 09:25:23.806708 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:23.806732 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:23.806765 (+ 33us) server_negotiation.cc:407] Connection header received
0809 09:25:23.807355 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:23.807371 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:23.807659 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:23.807969 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:23.808961 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:23.810529 (+ 1568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:23.811587 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:23.812064 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:23.812251 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:23.814921 (+ 2670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:23.814927 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:23.814941 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:23.814971 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:23.816993 (+ 2022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:23.817451 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:23.817456 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:23.817462 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:23.817619 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:23.817912 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:23.817916 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:23.817920 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:23.818449 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:23.818680 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:23.818924 (+ 244us) server_negotiation.cc:299] Negotiation successful
0809 09:25:23.819207 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":122,"threads_started":1}
I20260809 09:25:23.820161 26814 raft_consensus.cc:348] T 00000000000000000000000000000000 P cc0c4226cc6d48428cd8e6266bec5594 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc0c4226cc6d48428cd8e6266bec5594" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42093 } }
I20260809 09:25:23.820405 26814 raft_consensus.cc:374] T 00000000000000000000000000000000 P cc0c4226cc6d48428cd8e6266bec5594 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:25:23.820462 26814 raft_consensus.cc:729] T 00000000000000000000000000000000 P cc0c4226cc6d48428cd8e6266bec5594 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc0c4226cc6d48428cd8e6266bec5594, State: Initialized, Role: FOLLOWER
I20260809 09:25:23.820896 26814 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc0c4226cc6d48428cd8e6266bec5594 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc0c4226cc6d48428cd8e6266bec5594" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42093 } }
I20260809 09:25:23.821049 26814 raft_consensus.cc:388] T 00000000000000000000000000000000 P cc0c4226cc6d48428cd8e6266bec5594 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:25:23.821131 26814 raft_consensus.cc:482] T 00000000000000000000000000000000 P cc0c4226cc6d48428cd8e6266bec5594 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:25:23.821233 26814 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cc0c4226cc6d48428cd8e6266bec5594 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:25:23.822283 26814 raft_consensus.cc:504] T 00000000000000000000000000000000 P cc0c4226cc6d48428cd8e6266bec5594 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc0c4226cc6d48428cd8e6266bec5594" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42093 } }
I20260809 09:25:23.822660 26814 leader_election.cc:302] T 00000000000000000000000000000000 P cc0c4226cc6d48428cd8e6266bec5594 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cc0c4226cc6d48428cd8e6266bec5594; no voters:
I20260809 09:25:23.823040 26814 leader_election.cc:288] T 00000000000000000000000000000000 P cc0c4226cc6d48428cd8e6266bec5594 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:25:23.823148 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 09:25:23.823246 26820 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cc0c4226cc6d48428cd8e6266bec5594 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:25:23.823454 26820 raft_consensus.cc:686] T 00000000000000000000000000000000 P cc0c4226cc6d48428cd8e6266bec5594 [term 1 LEADER]: Becoming Leader. State: Replica: cc0c4226cc6d48428cd8e6266bec5594, State: Running, Role: LEADER
I20260809 09:25:23.823773 26820 consensus_queue.cc:237] T 00000000000000000000000000000000 P cc0c4226cc6d48428cd8e6266bec5594 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc0c4226cc6d48428cd8e6266bec5594" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42093 } }
I20260809 09:25:23.824335 26814 sys_catalog.cc:564] T 00000000000000000000000000000000 P cc0c4226cc6d48428cd8e6266bec5594 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:25:23.825026 26822 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc0c4226cc6d48428cd8e6266bec5594 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc0c4226cc6d48428cd8e6266bec5594. Latest consensus state: current_term: 1 leader_uuid: "cc0c4226cc6d48428cd8e6266bec5594" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc0c4226cc6d48428cd8e6266bec5594" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42093 } } }
I20260809 09:25:23.825156 26822 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc0c4226cc6d48428cd8e6266bec5594 [sys.catalog]: This master's current role is: LEADER
I20260809 09:25:23.825438 26821 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc0c4226cc6d48428cd8e6266bec5594 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cc0c4226cc6d48428cd8e6266bec5594" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc0c4226cc6d48428cd8e6266bec5594" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 42093 } } }
I20260809 09:25:23.825546 26821 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc0c4226cc6d48428cd8e6266bec5594 [sys.catalog]: This master's current role is: LEADER
I20260809 09:25:23.825592 26827 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:25:23.828250 26827 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:25:23.833498 26827 catalog_manager.cc:1347] Generated new cluster ID: 1cf2cd9e1e4749e1b298f0f6ea834127
I20260809 09:25:23.833570 26827 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:25:23.845074 26827 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:25:23.845885 26827 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:25:23.852941 26827 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cc0c4226cc6d48428cd8e6266bec5594: Generated new TSK 0
I20260809 09:25:23.853564 26827 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:25:23.879240 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 26740
2026-08-09T09:25:23Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1440 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:25:23 dist-test-slave-pgkr krb5kdc[26842](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:25:23 dist-test-slave-pgkr krb5kdc[26842](info): set up 2 sockets
Aug 09 09:25:23 dist-test-slave-pgkr krb5kdc[26842](info): commencing operation
krb5kdc: starting...
W20260809 09:25:24.917143 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.016s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:25:24 dist-test-slave-pgkr krb5kdc[26842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267524, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:25:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:25:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:25:25.034412 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:34489
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:44125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:34489
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:25:25.138517 26855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:25.138859 26855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:25.138958 26855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:25.142494 26855 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:25:25.142568 26855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:25.142603 26855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:25.142650 26855 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:25:25.142715 26855 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:25:25.147449 26855 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:44125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:34489
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:34489
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:25.148372 26855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:25.149330 26855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:25:25.157224 26861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:25.157303 26863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:25.157310 26865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:25.157645 26855 server_base.cc:1034] running on GCE node
I20260809 09:25:25.158156 26855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:25.159238 26855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:25.160418 26855 hybrid_clock.cc:648] HybridClock initialized: now 1786267525160382 us; error 48 us; skew 500 ppm
Aug 09 09:25:25 dist-test-slave-pgkr krb5kdc[26842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267525, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:25.163043 26855 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:25:25.163887 26855 webserver.cc:460] Webserver started at http://127.11.99.254:42113/ using document root <none> and password file <none>
I20260809 09:25:25.164377 26855 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:25.164461 26855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:25:25.164686 26855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:25:25.166554 26855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "1f90d1c989c2461bb6da5a1693497c8f"
format_stamp: "Formatted at 2026-08-09 09:25:25 on dist-test-slave-pgkr"
server_key: "f70f79ee07a950e098a18bf26e41714a"
server_key_iv: "0ba6cb33dc5b2a6469916939a9efb8da"
server_key_version: "encryptionkey@0"
I20260809 09:25:25.167137 26855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "1f90d1c989c2461bb6da5a1693497c8f"
format_stamp: "Formatted at 2026-08-09 09:25:25 on dist-test-slave-pgkr"
server_key: "f70f79ee07a950e098a18bf26e41714a"
server_key_iv: "0ba6cb33dc5b2a6469916939a9efb8da"
server_key_version: "encryptionkey@0"
I20260809 09:25:25.170742 26855 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 09:25:25.172945 26872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:25.174058 26855 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:25:25.174190 26855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "1f90d1c989c2461bb6da5a1693497c8f"
format_stamp: "Formatted at 2026-08-09 09:25:25 on dist-test-slave-pgkr"
server_key: "f70f79ee07a950e098a18bf26e41714a"
server_key_iv: "0ba6cb33dc5b2a6469916939a9efb8da"
server_key_version: "encryptionkey@0"
I20260809 09:25:25.174324 26855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:25.196048 26855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:25.198473 26855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:25.198674 26855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:25.205459 26855 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:34489
I20260809 09:25:25.205740 26928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:34489 every 8 connection(s)
I20260809 09:25:25.206367 26855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:25:25.208933 26929 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:25:25.211284 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 26855
I20260809 09:25:25.211413 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:25:25.211666 11663 external_mini_cluster.cc:1428] Setting key dd2553c42d837acab28ba1d8446b5b60
I20260809 09:25:25.214550 26929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f: Bootstrap starting.
I20260809 09:25:25.216861 26929 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f: Neither blocks nor log segments found. Creating new log.
I20260809 09:25:25.217613 26929 log.cc:824] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f: Log is configured to *not* fsync() on all Append() calls
I20260809 09:25:25.219544 26929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f: No bootstrap required, opened a new log
Aug 09 09:25:25 dist-test-slave-pgkr krb5kdc[26842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267524, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:25:25.223793 26929 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f90d1c989c2461bb6da5a1693497c8f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34489 } }
I20260809 09:25:25.224059 26929 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:25:25.224128 26929 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f90d1c989c2461bb6da5a1693497c8f, State: Initialized, Role: FOLLOWER
I20260809 09:25:25.224536 26929 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f90d1c989c2461bb6da5a1693497c8f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34489 } }
I20260809 09:25:25.224685 26929 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:25:25.224781 26929 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:25:25.224900 26929 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:25:25.225055 26932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:25.212961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40964 (local address 127.11.99.254:34489)
0809 09:25:25.213325 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:25.213339 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:25.213371 (+ 32us) server_negotiation.cc:407] Connection header received
0809 09:25:25.213984 (+ 613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:25.213997 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:25.214273 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:25.214508 (+ 235us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:25.215400 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.216291 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.217335 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.217786 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.217891 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:25.220643 (+ 2752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:25.220648 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:25.220659 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:25.220683 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:25.222214 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:25.222697 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:25.222701 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:25.222704 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:25.222821 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:25.223106 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:25.223109 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:25.223110 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:25.223440 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:25.223590 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:25.223918 (+ 328us) server_negotiation.cc:299] Negotiation successful
0809 09:25:25.224212 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":114,"threads_started":1}
I20260809 09:25:25.225769 26929 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f90d1c989c2461bb6da5a1693497c8f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34489 } }
I20260809 09:25:25.226082 26929 leader_election.cc:302] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f90d1c989c2461bb6da5a1693497c8f; no voters:
I20260809 09:25:25.226392 26929 leader_election.cc:288] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:25:25.226486 26934 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:25:25.226733 26934 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [term 1 LEADER]: Becoming Leader. State: Replica: 1f90d1c989c2461bb6da5a1693497c8f, State: Running, Role: LEADER
I20260809 09:25:25.227155 26934 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f90d1c989c2461bb6da5a1693497c8f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34489 } }
I20260809 09:25:25.227550 26929 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:25:25.228636 26935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f90d1c989c2461bb6da5a1693497c8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f90d1c989c2461bb6da5a1693497c8f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34489 } } }
I20260809 09:25:25.228773 26935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [sys.catalog]: This master's current role is: LEADER
I20260809 09:25:25.229084 26936 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f90d1c989c2461bb6da5a1693497c8f. Latest consensus state: current_term: 1 leader_uuid: "1f90d1c989c2461bb6da5a1693497c8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f90d1c989c2461bb6da5a1693497c8f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34489 } } }
I20260809 09:25:25.229185 26943 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:25:25.229197 26936 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [sys.catalog]: This master's current role is: LEADER
I20260809 09:25:25.231664 26943 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:25:25.236539 26943 catalog_manager.cc:1347] Generated new cluster ID: 367ae9ca6c8f48ad91a1719980620f4d
I20260809 09:25:25.236598 26943 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:25:25.260295 26943 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:25:25.261356 26943 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:25:25.268878 26943 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f: Generated new TSK 0
I20260809 09:25:25.269582 26943 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.99.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
I20260809 09:25:25.299973 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:0
--local_ip_for_outbound_sockets=127.11.99.193
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34489
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:44125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:25:25.403565 26955 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:25.403812 26955 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:25.403883 26955 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:25.407647 26955 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:25.407723 26955 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:25.407804 26955 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:25:25.412462 26955 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:44125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26955
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:25.413335 26955 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:25.414227 26955 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:25:25.423092 26960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:25.423106 26961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:25.423115 26963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:25.423519 26955 server_base.cc:1034] running on GCE node
I20260809 09:25:25.423900 26955 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:25.424432 26955 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:25.425580 26955 hybrid_clock.cc:648] HybridClock initialized: now 1786267525425562 us; error 26 us; skew 500 ppm
Aug 09 09:25:25 dist-test-slave-pgkr krb5kdc[26842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267525, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:25.428527 26955 init.cc:377] Logged in from keytab as kudu/127.11.99.193@KRBTEST.COM (short username kudu)
I20260809 09:25:25.429390 26955 webserver.cc:460] Webserver started at http://127.11.99.193:32925/ using document root <none> and password file <none>
I20260809 09:25:25.429920 26955 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:25.429980 26955 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:25:25.430130 26955 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:25:25.431984 26955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/data/instance:
uuid: "0634f0173a7346b1bc2b7f73c33002e0"
format_stamp: "Formatted at 2026-08-09 09:25:25 on dist-test-slave-pgkr"
server_key: "16b2053ae04efa8903c9496be45e9520"
server_key_iv: "18dd732187c4a9cc76bda7fa68388772"
server_key_version: "encryptionkey@0"
I20260809 09:25:25.432515 26955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance:
uuid: "0634f0173a7346b1bc2b7f73c33002e0"
format_stamp: "Formatted at 2026-08-09 09:25:25 on dist-test-slave-pgkr"
server_key: "16b2053ae04efa8903c9496be45e9520"
server_key_iv: "18dd732187c4a9cc76bda7fa68388772"
server_key_version: "encryptionkey@0"
I20260809 09:25:25.436038 26955 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 09:25:25.438211 26970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:25.439364 26955 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:25:25.439450 26955 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "0634f0173a7346b1bc2b7f73c33002e0"
format_stamp: "Formatted at 2026-08-09 09:25:25 on dist-test-slave-pgkr"
server_key: "16b2053ae04efa8903c9496be45e9520"
server_key_iv: "18dd732187c4a9cc76bda7fa68388772"
server_key_version: "encryptionkey@0"
I20260809 09:25:25.439525 26955 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:25.453655 26955 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:25.456379 26955 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:25.456526 26955 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:25.456984 26955 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:25:25.457685 26955 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:25:25.457731 26955 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:25.457765 26955 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:25:25.457784 26955 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:25.465953 26955 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:38623
I20260809 09:25:25.465960 27092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:38623 every 8 connection(s)
I20260809 09:25:25.466894 26955 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
Aug 09 09:25:25 dist-test-slave-pgkr krb5kdc[26842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267525, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:25:25.476263 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 26955
I20260809 09:25:25.476403 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance
I20260809 09:25:25.476871 11663 external_mini_cluster.cc:1428] Setting key 3c982f10ca64d0a329e36341ce74bf0a
I20260809 09:25:25.480011 26932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:25.468592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:47849 (local address 127.11.99.254:34489)
0809 09:25:25.468745 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:25.468750 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:25.469600 (+ 850us) server_negotiation.cc:407] Connection header received
0809 09:25:25.470935 (+ 1335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:25.470937 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:25.470984 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:25.471057 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:25.472100 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.472620 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.473635 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.473848 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.473921 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:25.476130 (+ 2209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:25.476136 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:25.476141 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:25.476170 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:25.477728 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:25.478324 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:25.478327 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:25.478329 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:25.478444 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:25.478847 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:25.478851 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:25.478853 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:25.479100 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:25.479205 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:25.479634 (+ 429us) server_negotiation.cc:299] Negotiation successful
0809 09:25:25.479781 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 09:25:25.480562 27095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:25.468951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.193:47849)
0809 09:25:25.469413 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:25.469469 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:25.470758 (+ 1289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:25.471201 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:25.471207 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:25.471521 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:25.471973 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:25.471985 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.472726 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.472728 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:25.473521 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:25.473539 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.473966 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.473968 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:25.474094 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:25.474646 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:25.474674 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:25.475968 (+ 1294us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:25.477835 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:25.477841 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:25.477851 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:25.478215 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:25.478542 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:25.478545 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:25.478546 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:25.478748 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:25.479203 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:25.479207 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:25.479402 (+ 195us) client_negotiation.cc:769] Sending connection context
0809 09:25:25.479538 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 09:25:25.479749 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":115,"threads_started":1}
I20260809 09:25:25.481802 27093 heartbeater.cc:347] Connected to a master server at 127.11.99.254:34489
I20260809 09:25:25.482023 27093 heartbeater.cc:464] Registering TS with master...
I20260809 09:25:25.482560 27093 heartbeater.cc:511] Master 127.11.99.254:34489 requested a full tablet report, sending...
I20260809 09:25:25.484103 26891 ts_manager.cc:194] Registered new tserver with Master: 0634f0173a7346b1bc2b7f73c33002e0 (127.11.99.193:38623)
I20260809 09:25:25.485200 26891 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.193@KRBTEST.COM'} at 127.11.99.193:47849
WARNING: no policy specified for kudu/127.11.99.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
I20260809 09:25:25.503573 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:0
--local_ip_for_outbound_sockets=127.11.99.194
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34489
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:44125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:25:25.607591 27098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:25.607821 27098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:25.607893 27098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:25.611698 27098 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:25.611742 27098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:25.611815 27098 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:25:25.616724 27098 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:44125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27098
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:25.617650 27098 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:25.618513 27098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:25:25.627238 27105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:25.627297 27104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:25.627383 27098 server_base.cc:1034] running on GCE node
W20260809 09:25:25.627338 27107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:25.627851 27098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:25.628480 27098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:25.629627 27098 hybrid_clock.cc:648] HybridClock initialized: now 1786267525629605 us; error 42 us; skew 500 ppm
Aug 09 09:25:25 dist-test-slave-pgkr krb5kdc[26842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267525, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:25.632180 27098 init.cc:377] Logged in from keytab as kudu/127.11.99.194@KRBTEST.COM (short username kudu)
I20260809 09:25:25.633031 27098 webserver.cc:460] Webserver started at http://127.11.99.194:43315/ using document root <none> and password file <none>
I20260809 09:25:25.633565 27098 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:25.633656 27098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:25:25.633880 27098 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:25:25.635878 27098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/data/instance:
uuid: "f0635231a8d140628245d5ad29184f3b"
format_stamp: "Formatted at 2026-08-09 09:25:25 on dist-test-slave-pgkr"
server_key: "eaab62bd763781a653beeae54340259c"
server_key_iv: "d23e17577d2dffc24b04d007efd5f612"
server_key_version: "encryptionkey@0"
I20260809 09:25:25.636551 27098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance:
uuid: "f0635231a8d140628245d5ad29184f3b"
format_stamp: "Formatted at 2026-08-09 09:25:25 on dist-test-slave-pgkr"
server_key: "eaab62bd763781a653beeae54340259c"
server_key_iv: "d23e17577d2dffc24b04d007efd5f612"
server_key_version: "encryptionkey@0"
I20260809 09:25:25.640070 27098 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 09:25:25.642223 27114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:25.643411 27098 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:25:25.643556 27098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "f0635231a8d140628245d5ad29184f3b"
format_stamp: "Formatted at 2026-08-09 09:25:25 on dist-test-slave-pgkr"
server_key: "eaab62bd763781a653beeae54340259c"
server_key_iv: "d23e17577d2dffc24b04d007efd5f612"
server_key_version: "encryptionkey@0"
I20260809 09:25:25.643666 27098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:25.658931 27098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:25.661724 27098 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:25.661919 27098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:25.662465 27098 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:25:25.663277 27098 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:25:25.663371 27098 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:25.663435 27098 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:25:25.663479 27098 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:25.672190 27098 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:37387
I20260809 09:25:25.672358 27236 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:37387 every 8 connection(s)
I20260809 09:25:25.673118 27098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:25:25.679171 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 27098
I20260809 09:25:25.679307 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance
I20260809 09:25:25.679608 11663 external_mini_cluster.cc:1428] Setting key c08148975c1dab8c7994c0cf696a0fb6
Aug 09 09:25:25 dist-test-slave-pgkr krb5kdc[26842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267525, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:25:25.687740 26932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:25.674879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:50649 (local address 127.11.99.254:34489)
0809 09:25:25.675023 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:25.675027 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:25.675843 (+ 816us) server_negotiation.cc:407] Connection header received
0809 09:25:25.677174 (+ 1331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:25.677176 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:25.677223 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:25.677341 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:25.678475 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.679205 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.680474 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.680729 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.680840 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:25.683777 (+ 2937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:25.683780 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:25.683782 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:25.683805 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:25.685451 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:25.685988 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:25.685995 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:25.685999 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:25.686096 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:25.686483 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:25.686486 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:25.686488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:25.686760 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:25.686873 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:25.687357 (+ 484us) server_negotiation.cc:299] Negotiation successful
0809 09:25:25.687504 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 09:25:25.688247 27239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:25.675237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.194:50649)
0809 09:25:25.675692 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:25.675733 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:25.676925 (+ 1192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:25.677454 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:25.677460 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:25.677809 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:25.678312 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:25.678327 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.679340 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.679346 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:25.680344 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:25.680354 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.680856 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.680859 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:25.681051 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:25.681604 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:25.681627 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:25.683570 (+ 1943us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:25.685622 (+ 2052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:25.685626 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:25.685636 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:25.685879 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:25.686223 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:25.686228 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:25.686233 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:25.686380 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:25.686884 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:25.686888 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:25.687119 (+ 231us) client_negotiation.cc:769] Sending connection context
0809 09:25:25.687265 (+ 146us) client_negotiation.cc:240] Negotiation successful
0809 09:25:25.687488 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":118,"threads_started":1}
I20260809 09:25:25.689329 27237 heartbeater.cc:347] Connected to a master server at 127.11.99.254:34489
I20260809 09:25:25.689564 27237 heartbeater.cc:464] Registering TS with master...
I20260809 09:25:25.690126 27237 heartbeater.cc:511] Master 127.11.99.254:34489 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.99.195@KRBTEST.COM; defaulting to no policy
I20260809 09:25:25.691242 26891 ts_manager.cc:194] Registered new tserver with Master: f0635231a8d140628245d5ad29184f3b (127.11.99.194:37387)
I20260809 09:25:25.691895 26891 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.194@KRBTEST.COM'} at 127.11.99.194:50649
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
I20260809 09:25:25.706658 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:0
--local_ip_for_outbound_sockets=127.11.99.195
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34489
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:44125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:25:25.812671 27242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:25.812928 27242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:25.812994 27242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:25.817806 27242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:25.817893 27242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:25.817987 27242 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:25:25.823487 27242 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:44125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27242
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:25.824553 27242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:25.825466 27242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:25:25.835210 27249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:25.835229 27248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:25.835253 27251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:25.835608 27242 server_base.cc:1034] running on GCE node
I20260809 09:25:25.836010 27242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:25.836548 27242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:25.837734 27242 hybrid_clock.cc:648] HybridClock initialized: now 1786267525837721 us; error 26 us; skew 500 ppm
Aug 09 09:25:25 dist-test-slave-pgkr krb5kdc[26842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267525, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:25.840368 27242 init.cc:377] Logged in from keytab as kudu/127.11.99.195@KRBTEST.COM (short username kudu)
I20260809 09:25:25.841219 27242 webserver.cc:460] Webserver started at http://127.11.99.195:39745/ using document root <none> and password file <none>
I20260809 09:25:25.841761 27242 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:25.841850 27242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:25:25.842069 27242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:25:25.844071 27242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/data/instance:
uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0"
format_stamp: "Formatted at 2026-08-09 09:25:25 on dist-test-slave-pgkr"
server_key: "d4018170ed8b4d892f8e1f5865b69bbd"
server_key_iv: "050b0293aea450142fc1f6a84565da03"
server_key_version: "encryptionkey@0"
I20260809 09:25:25.844601 27242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance:
uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0"
format_stamp: "Formatted at 2026-08-09 09:25:25 on dist-test-slave-pgkr"
server_key: "d4018170ed8b4d892f8e1f5865b69bbd"
server_key_iv: "050b0293aea450142fc1f6a84565da03"
server_key_version: "encryptionkey@0"
I20260809 09:25:25.847939 27242 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 09:25:25.850194 27259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:25.851321 27242 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 09:25:25.851459 27242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0"
format_stamp: "Formatted at 2026-08-09 09:25:25 on dist-test-slave-pgkr"
server_key: "d4018170ed8b4d892f8e1f5865b69bbd"
server_key_iv: "050b0293aea450142fc1f6a84565da03"
server_key_version: "encryptionkey@0"
I20260809 09:25:25.851558 27242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:25.877287 27242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:25.880025 27242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:25.880208 27242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:25.880723 27242 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:25:25.881515 27242 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:25:25.881582 27242 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:25.881645 27242 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:25:25.881688 27242 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:25.890254 27242 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:46395
I20260809 09:25:25.890285 27382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:46395 every 8 connection(s)
I20260809 09:25:25.891068 27242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:25:25.893291 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 27242
I20260809 09:25:25.893406 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance
I20260809 09:25:25.893714 11663 external_mini_cluster.cc:1428] Setting key fe2bab5ac7a167a305a435724f9cb197
Aug 09 09:25:25 dist-test-slave-pgkr krb5kdc[26842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267525, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:25:25.903365 26932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:25.892661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:45921 (local address 127.11.99.254:34489)
0809 09:25:25.892809 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:25.892812 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:25.893584 (+ 772us) server_negotiation.cc:407] Connection header received
0809 09:25:25.894895 (+ 1311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:25.894898 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:25.894956 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:25.895048 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:25.896095 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.896580 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.897637 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.897868 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.897976 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:25.900173 (+ 2197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:25.900184 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:25.900186 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:25.900207 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:25.901367 (+ 1160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:25.901883 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:25.901887 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:25.901889 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:25.901969 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:25.902299 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:25.902304 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:25.902305 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:25.902480 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:25.902587 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:25.903074 (+ 487us) server_negotiation.cc:299] Negotiation successful
0809 09:25:25.903192 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 09:25:25.904207 27386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:25.892987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.195:45921)
0809 09:25:25.893422 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:25.893470 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:25.894698 (+ 1228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:25.895208 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:25.895215 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:25.895538 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:25.895960 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:25.895972 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.896699 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.896702 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:25.897517 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:25.897526 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.898009 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.898013 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:25.898191 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:25.898696 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:25.898710 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:25.900026 (+ 1316us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:25.901483 (+ 1457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:25.901489 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:25.901501 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:25.901777 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:25.902062 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:25.902066 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:25.902068 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:25.902200 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:25.902586 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:25.902592 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:25.902853 (+ 261us) client_negotiation.cc:769] Sending connection context
0809 09:25:25.903031 (+ 178us) client_negotiation.cc:240] Negotiation successful
0809 09:25:25.903313 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":137,"threads_started":1}
I20260809 09:25:25.905218 27384 heartbeater.cc:347] Connected to a master server at 127.11.99.254:34489
I20260809 09:25:25.905434 27384 heartbeater.cc:464] Registering TS with master...
I20260809 09:25:25.905925 27384 heartbeater.cc:511] Master 127.11.99.254:34489 requested a full tablet report, sending...
I20260809 09:25:25.906953 26891 ts_manager.cc:194] Registered new tserver with Master: c6cc71a71e7d4ad88b7abe46adb8b4b0 (127.11.99.195:46395)
I20260809 09:25:25.907526 26891 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.195@KRBTEST.COM'} at 127.11.99.195:45921
I20260809 09:25:25.918815 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 09:25:25.928951 26932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:25.920833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44060 (local address 127.11.99.254:34489)
0809 09:25:25.921047 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:25.921052 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:25.921197 (+ 145us) server_negotiation.cc:407] Connection header received
0809 09:25:25.921357 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:25.921362 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:25.921413 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:25.921504 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:25.922216 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.922757 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.923597 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.923813 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.923925 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:25.925369 (+ 1444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:25.925373 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:25.925376 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:25.925411 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:25.927159 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:25.927606 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:25.927611 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:25.927613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:25.927705 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:25.928036 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:25.928040 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:25.928042 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:25.928283 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:25.928425 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:25.928675 (+ 250us) server_negotiation.cc:299] Negotiation successful
0809 09:25:25.928788 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260809 09:25:25.931804 26891 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44060:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 09:25:25.934821 26891 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:25:25.949649 27396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:25.943084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48884 (local address 127.11.99.193:38623)
0809 09:25:25.944695 (+ 1611us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:25.944716 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:25.944737 (+ 21us) server_negotiation.cc:407] Connection header received
0809 09:25:25.944809 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:25.944814 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:25.944969 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:25.945117 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:25:25.945342 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.946559 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.948131 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.949021 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.949135 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:25.949275 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:25.949450 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 09:25:25.949521 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1483,"thread_start_us":149,"threads_started":1}
I20260809 09:25:25.949671 27397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:25.942935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:38623 (local address 127.0.0.1:48884)
0809 09:25:25.943590 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:25.943659 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:25.943800 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:25.945113 (+ 1313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:25.945115 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:25.945133 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:25:25.945248 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:25.945255 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.946708 (+ 1453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.946712 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:25.947992 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:25.948003 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.949149 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.949153 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:25.949273 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:25.949310 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 09:25:25.949421 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 09:25:25.949532 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"mutex_wait_us":29,"spinlock_wait_cycles":8960,"thread_start_us":69,"threads_started":1}
I20260809 09:25:25.950245 27395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:25.943217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:37387 (local address 127.0.0.1:49716)
0809 09:25:25.943625 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:25.943663 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:25.943802 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:25.945351 (+ 1549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:25.945353 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:25.945370 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:25:25.945441 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:25.945446 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.946903 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.946906 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:25.948045 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:25.948054 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.949832 (+ 1778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.949835 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:25.949933 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:25.949963 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 09:25:25.950030 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 09:25:25.950093 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"mutex_wait_us":2,"spinlock_wait_cycles":2304,"thread_start_us":119,"threads_started":1}
I20260809 09:25:25.950546 27399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:25.943854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38196 (local address 127.11.99.195:46395)
0809 09:25:25.944209 (+ 355us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:25.944220 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:25.944426 (+ 206us) server_negotiation.cc:407] Connection header received
0809 09:25:25.944549 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:25.944554 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:25.944742 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:25.944887 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:25:25.945339 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.946106 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.948898 (+ 2792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.949673 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.949800 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:25.949929 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:25.950316 (+ 387us) server_negotiation.cc:299] Negotiation successful
0809 09:25:25.950413 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":182,"threads_started":1}
I20260809 09:25:25.950662 27400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:25.944110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49716 (local address 127.11.99.194:37387)
0809 09:25:25.944776 (+ 666us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:25.944788 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:25.944811 (+ 23us) server_negotiation.cc:407] Connection header received
0809 09:25:25.944883 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:25.944887 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:25.945047 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:25.945180 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:25:25.945569 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.946756 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.948147 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.949020 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.949135 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:25.949275 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:25.950405 (+ 1130us) server_negotiation.cc:299] Negotiation successful
0809 09:25:25.950487 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560,"thread_start_us":156,"threads_started":1}
I20260809 09:25:25.950984 27398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:25.943683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:46395 (local address 127.0.0.1:38196)
0809 09:25:25.944314 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:25.944328 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:25.944429 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:25.945047 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:25.945053 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:25.945075 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:25:25.945201 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:25.945208 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.946274 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.946278 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:25.948779 (+ 2501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:25.948787 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:25.949986 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:25.949992 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:25.950073 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:25.950091 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 09:25:25.950150 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 09:25:25.950202 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"mutex_wait_us":1381,"thread_start_us":98,"threads_started":1}
I20260809 09:25:25.952924 27165 tablet_service.cc:1467] Processing CreateTablet for tablet 049fa4d1c6214285be3ff8f12db27633 (DEFAULT_TABLE table=test-table [id=7ac875e85c854ccf890bd8862f628254]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:25:25.952924 27023 tablet_service.cc:1467] Processing CreateTablet for tablet 049fa4d1c6214285be3ff8f12db27633 (DEFAULT_TABLE table=test-table [id=7ac875e85c854ccf890bd8862f628254]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:25:25.954049 27165 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 049fa4d1c6214285be3ff8f12db27633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:25:25.954047 27023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 049fa4d1c6214285be3ff8f12db27633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:25:25.955760 27312 tablet_service.cc:1467] Processing CreateTablet for tablet 049fa4d1c6214285be3ff8f12db27633 (DEFAULT_TABLE table=test-table [id=7ac875e85c854ccf890bd8862f628254]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:25:25.956578 27312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 049fa4d1c6214285be3ff8f12db27633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:25:25.961246 27401 tablet_bootstrap.cc:492] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0: Bootstrap starting.
I20260809 09:25:25.962106 27402 tablet_bootstrap.cc:492] T 049fa4d1c6214285be3ff8f12db27633 P f0635231a8d140628245d5ad29184f3b: Bootstrap starting.
I20260809 09:25:25.962438 27403 tablet_bootstrap.cc:492] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0: Bootstrap starting.
I20260809 09:25:25.963747 27401 tablet_bootstrap.cc:654] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0: Neither blocks nor log segments found. Creating new log.
I20260809 09:25:25.964334 27403 tablet_bootstrap.cc:654] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0: Neither blocks nor log segments found. Creating new log.
I20260809 09:25:25.964809 27402 tablet_bootstrap.cc:654] T 049fa4d1c6214285be3ff8f12db27633 P f0635231a8d140628245d5ad29184f3b: Neither blocks nor log segments found. Creating new log.
I20260809 09:25:25.965009 27401 log.cc:824] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0: Log is configured to *not* fsync() on all Append() calls
I20260809 09:25:25.965519 27402 log.cc:824] T 049fa4d1c6214285be3ff8f12db27633 P f0635231a8d140628245d5ad29184f3b: Log is configured to *not* fsync() on all Append() calls
I20260809 09:25:25.965519 27403 log.cc:824] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0: Log is configured to *not* fsync() on all Append() calls
I20260809 09:25:25.967017 27401 tablet_bootstrap.cc:492] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0: No bootstrap required, opened a new log
I20260809 09:25:25.967214 27401 ts_tablet_manager.cc:1397] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 09:25:25.967448 27403 tablet_bootstrap.cc:492] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0: No bootstrap required, opened a new log
I20260809 09:25:25.967628 27403 ts_tablet_manager.cc:1397] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 09:25:25.967754 27402 tablet_bootstrap.cc:492] T 049fa4d1c6214285be3ff8f12db27633 P f0635231a8d140628245d5ad29184f3b: No bootstrap required, opened a new log
I20260809 09:25:25.968014 27402 ts_tablet_manager.cc:1397] T 049fa4d1c6214285be3ff8f12db27633 P f0635231a8d140628245d5ad29184f3b: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 09:25:25.970556 27401 raft_consensus.cc:348] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } } peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } }
I20260809 09:25:25.970839 27401 raft_consensus.cc:374] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:25:25.970893 27401 raft_consensus.cc:729] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0634f0173a7346b1bc2b7f73c33002e0, State: Initialized, Role: FOLLOWER
I20260809 09:25:25.971320 27401 consensus_queue.cc:260] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } } peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } }
I20260809 09:25:25.971309 27403 raft_consensus.cc:348] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } } peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } }
I20260809 09:25:25.971552 27403 raft_consensus.cc:374] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:25:25.971613 27403 raft_consensus.cc:729] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6cc71a71e7d4ad88b7abe46adb8b4b0, State: Initialized, Role: FOLLOWER
I20260809 09:25:25.971995 27093 heartbeater.cc:503] Master 127.11.99.254:34489 was elected leader, sending a full tablet report...
I20260809 09:25:25.972019 27403 consensus_queue.cc:260] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } } peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } }
I20260809 09:25:25.972280 27401 ts_tablet_manager.cc:1428] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 09:25:25.971833 27402 raft_consensus.cc:348] T 049fa4d1c6214285be3ff8f12db27633 P f0635231a8d140628245d5ad29184f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } } peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } }
I20260809 09:25:25.972604 27402 raft_consensus.cc:374] T 049fa4d1c6214285be3ff8f12db27633 P f0635231a8d140628245d5ad29184f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:25:25.972661 27402 raft_consensus.cc:729] T 049fa4d1c6214285be3ff8f12db27633 P f0635231a8d140628245d5ad29184f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0635231a8d140628245d5ad29184f3b, State: Initialized, Role: FOLLOWER
I20260809 09:25:25.972899 27403 ts_tablet_manager.cc:1428] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
I20260809 09:25:25.973061 27384 heartbeater.cc:503] Master 127.11.99.254:34489 was elected leader, sending a full tablet report...
I20260809 09:25:25.973027 27402 consensus_queue.cc:260] T 049fa4d1c6214285be3ff8f12db27633 P f0635231a8d140628245d5ad29184f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } } peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } }
I20260809 09:25:25.973878 27237 heartbeater.cc:503] Master 127.11.99.254:34489 was elected leader, sending a full tablet report...
I20260809 09:25:25.974082 27402 ts_tablet_manager.cc:1428] T 049fa4d1c6214285be3ff8f12db27633 P f0635231a8d140628245d5ad29184f3b: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 09:25:26.057348 27408 raft_consensus.cc:482] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:25:26.057538 27408 raft_consensus.cc:504] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } } peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } }
I20260809 09:25:26.058698 27408 leader_election.cc:288] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0634f0173a7346b1bc2b7f73c33002e0 (127.11.99.193:38623), f0635231a8d140628245d5ad29184f3b (127.11.99.194:37387)
I20260809 09:25:26.062525 27400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:26.059048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:40801 (local address 127.11.99.194:37387)
0809 09:25:26.059162 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:26.059166 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:26.059183 (+ 17us) server_negotiation.cc:407] Connection header received
0809 09:25:26.059371 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:26.059376 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:26.059432 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:26.059522 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:25:26.059893 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.060461 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.061574 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.061961 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.062072 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:26.062130 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:26.062331 (+ 201us) server_negotiation.cc:299] Negotiation successful
0809 09:25:26.062407 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 09:25:26.062527 27396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:26.059060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:40191 (local address 127.11.99.193:38623)
0809 09:25:26.059189 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:26.059194 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:26.059600 (+ 406us) server_negotiation.cc:407] Connection header received
0809 09:25:26.059747 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:26.059750 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:26.059808 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:26.059900 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:25:26.060145 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.060630 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.061634 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.061978 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.062107 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:26.062157 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:26.062355 (+ 198us) server_negotiation.cc:299] Negotiation successful
0809 09:25:26.062416 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 09:25:26.062525 27386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:26.058935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:37387 (local address 127.11.99.195:40801)
0809 09:25:26.059114 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:26.059131 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:26.059225 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:26.059539 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:26.059541 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:26.059576 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:25:26.059746 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:26.059752 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.060567 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.060570 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:26.061450 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:26.061458 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.062084 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.062087 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:26.062197 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:26.062218 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 09:25:26.062287 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 09:25:26.062391 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61,"mutex_wait_us":66,"spinlock_wait_cycles":2816}
I20260809 09:25:26.062546 27410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:26.058938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:38623 (local address 127.11.99.195:40191)
0809 09:25:26.059499 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:26.059514 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:26.059633 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:26.059918 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:26.059922 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:26.059938 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:25:26.060045 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:26.060051 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.060739 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.060742 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:26.061491 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:26.061499 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.062120 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.062123 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:26.062218 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:26.062237 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 09:25:26.062326 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 09:25:26.062421 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"mutex_wait_us":190,"spinlock_wait_cycles":30336,"thread_start_us":144,"threads_started":1}
I20260809 09:25:26.063302 27046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "049fa4d1c6214285be3ff8f12db27633" candidate_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0634f0173a7346b1bc2b7f73c33002e0" is_pre_election: true
I20260809 09:25:26.063333 27186 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "049fa4d1c6214285be3ff8f12db27633" candidate_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0635231a8d140628245d5ad29184f3b" is_pre_election: true
I20260809 09:25:26.063611 27186 raft_consensus.cc:2454] T 049fa4d1c6214285be3ff8f12db27633 P f0635231a8d140628245d5ad29184f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6cc71a71e7d4ad88b7abe46adb8b4b0 in term 0.
I20260809 09:25:26.063611 27046 raft_consensus.cc:2454] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6cc71a71e7d4ad88b7abe46adb8b4b0 in term 0.
I20260809 09:25:26.064076 27264 leader_election.cc:302] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0634f0173a7346b1bc2b7f73c33002e0, c6cc71a71e7d4ad88b7abe46adb8b4b0; no voters:
I20260809 09:25:26.064347 27408 raft_consensus.cc:2781] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:25:26.064420 27408 raft_consensus.cc:482] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:25:26.064450 27408 raft_consensus.cc:3037] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:25:26.065552 27408 raft_consensus.cc:504] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } } peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } }
I20260809 09:25:26.065902 27408 leader_election.cc:288] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0 [CANDIDATE]: Term 1 election: Requested vote from peers 0634f0173a7346b1bc2b7f73c33002e0 (127.11.99.193:38623), f0635231a8d140628245d5ad29184f3b (127.11.99.194:37387)
I20260809 09:25:26.066224 27046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "049fa4d1c6214285be3ff8f12db27633" candidate_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0634f0173a7346b1bc2b7f73c33002e0"
I20260809 09:25:26.066242 27186 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "049fa4d1c6214285be3ff8f12db27633" candidate_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0635231a8d140628245d5ad29184f3b"
I20260809 09:25:26.066357 27186 raft_consensus.cc:3037] T 049fa4d1c6214285be3ff8f12db27633 P f0635231a8d140628245d5ad29184f3b [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:25:26.066357 27046 raft_consensus.cc:3037] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:25:26.067662 27046 raft_consensus.cc:2454] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6cc71a71e7d4ad88b7abe46adb8b4b0 in term 1.
I20260809 09:25:26.067662 27186 raft_consensus.cc:2454] T 049fa4d1c6214285be3ff8f12db27633 P f0635231a8d140628245d5ad29184f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6cc71a71e7d4ad88b7abe46adb8b4b0 in term 1.
I20260809 09:25:26.067926 27260 leader_election.cc:302] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6cc71a71e7d4ad88b7abe46adb8b4b0, f0635231a8d140628245d5ad29184f3b; no voters:
I20260809 09:25:26.068152 27408 raft_consensus.cc:2781] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:25:26.068373 27408 raft_consensus.cc:686] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0 [term 1 LEADER]: Becoming Leader. State: Replica: c6cc71a71e7d4ad88b7abe46adb8b4b0, State: Running, Role: LEADER
I20260809 09:25:26.068681 27408 consensus_queue.cc:237] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } } peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } }
I20260809 09:25:26.071599 26886 catalog_manager.cc:5495] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6cc71a71e7d4ad88b7abe46adb8b4b0 (127.11.99.195). New cstate: current_term: 1 leader_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } health_report { overall_health: HEALTHY } } }
I20260809 09:25:26.102845 27399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:26.099896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38210 (local address 127.11.99.195:46395)
0809 09:25:26.100019 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:26.100023 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:26.100034 (+ 11us) server_negotiation.cc:407] Connection header received
0809 09:25:26.100149 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:26.100151 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:26.100196 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:26.100282 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:25:26.100467 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.100908 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.101652 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.101838 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.101910 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:26.102127 (+ 217us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:25:26.102518 (+ 391us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:25:26.102598 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:26.102681 (+ 83us) server_negotiation.cc:299] Negotiation successful
0809 09:25:26.102727 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 09:25:26.108129 27186 raft_consensus.cc:1261] T 049fa4d1c6214285be3ff8f12db27633 P f0635231a8d140628245d5ad29184f3b [term 1 FOLLOWER]: Refusing update from remote peer c6cc71a71e7d4ad88b7abe46adb8b4b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:25:26.108129 27046 raft_consensus.cc:1261] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0 [term 1 FOLLOWER]: Refusing update from remote peer c6cc71a71e7d4ad88b7abe46adb8b4b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:25:26.108822 27408 consensus_queue.cc:1035] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:25:26.108989 27411 consensus_queue.cc:1035] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:25:26.117453 27415 mvcc.cc:205] Tried to move back new op lower bound from 7316551786931716096 to 7316551786779721728. Current Snapshot: MvccSnapshot[applied={T|T < 7316551786931716096}]
I20260809 09:25:26.117923 27416 mvcc.cc:205] Tried to move back new op lower bound from 7316551786931716096 to 7316551786779721728. Current Snapshot: MvccSnapshot[applied={T|T < 7316551786931716096}]
I20260809 09:25:26.123829 26890 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44060:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:25:26.123993 26890 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44060:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:25:26.126154 26890 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f: Sending DeleteTablet for 3 replicas of tablet 049fa4d1c6214285be3ff8f12db27633
I20260809 09:25:26.126914 27023 tablet_service.cc:1514] Processing DeleteTablet for tablet 049fa4d1c6214285be3ff8f12db27633 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:25:26 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:48884
I20260809 09:25:26.126981 27165 tablet_service.cc:1514] Processing DeleteTablet for tablet 049fa4d1c6214285be3ff8f12db27633 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:25:26 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:49716
I20260809 09:25:26.127393 27423 tablet_replica.cc:330] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0: stopping tablet replica
I20260809 09:25:26.127429 27312 tablet_service.cc:1514] Processing DeleteTablet for tablet 049fa4d1c6214285be3ff8f12db27633 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:25:26 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:38196
I20260809 09:25:26.127748 27423 raft_consensus.cc:2229] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:25:26.127888 27425 tablet_replica.cc:330] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0: stopping tablet replica
I20260809 09:25:26.128032 27423 raft_consensus.cc:2258] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:25:26.128079 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 26955
I20260809 09:25:26.129567 27425 raft_consensus.cc:2229] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0 [term 1 LEADER]: Raft consensus shutting down.
I20260809 09:25:26.129957 27425 raft_consensus.cc:2258] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:25:26.131624 27425 ts_tablet_manager.cc:1905] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:25:26.131932 27424 tablet_replica.cc:330] T 049fa4d1c6214285be3ff8f12db27633 P f0635231a8d140628245d5ad29184f3b: stopping tablet replica
I20260809 09:25:26.132210 27424 raft_consensus.cc:2229] T 049fa4d1c6214285be3ff8f12db27633 P f0635231a8d140628245d5ad29184f3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:25:26.132530 27424 raft_consensus.cc:2258] T 049fa4d1c6214285be3ff8f12db27633 P f0635231a8d140628245d5ad29184f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:25:26.133769 27424 ts_tablet_manager.cc:1905] T 049fa4d1c6214285be3ff8f12db27633 P f0635231a8d140628245d5ad29184f3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:25:26.134713 27425 ts_tablet_manager.cc:1918] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:25:26.134859 27425 log.cc:1196] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/049fa4d1c6214285be3ff8f12db27633
I20260809 09:25:26.135282 27425 ts_tablet_manager.cc:1939] T 049fa4d1c6214285be3ff8f12db27633 P c6cc71a71e7d4ad88b7abe46adb8b4b0: Deleting consensus metadata
I20260809 09:25:26.136384 26873 catalog_manager.cc:4841] TS c6cc71a71e7d4ad88b7abe46adb8b4b0 (127.11.99.195:46395): tablet 049fa4d1c6214285be3ff8f12db27633 (table test-table [id=7ac875e85c854ccf890bd8862f628254]) successfully deleted
I20260809 09:25:26.137125 27424 ts_tablet_manager.cc:1918] T 049fa4d1c6214285be3ff8f12db27633 P f0635231a8d140628245d5ad29184f3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:25:26.137246 27424 log.cc:1196] T 049fa4d1c6214285be3ff8f12db27633 P f0635231a8d140628245d5ad29184f3b: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/049fa4d1c6214285be3ff8f12db27633
I20260809 09:25:26.137591 27424 ts_tablet_manager.cc:1939] T 049fa4d1c6214285be3ff8f12db27633 P f0635231a8d140628245d5ad29184f3b: Deleting consensus metadata
I20260809 09:25:26.138738 26873 catalog_manager.cc:4841] TS f0635231a8d140628245d5ad29184f3b (127.11.99.194:37387): tablet 049fa4d1c6214285be3ff8f12db27633 (table test-table [id=7ac875e85c854ccf890bd8862f628254]) successfully deleted
W20260809 09:25:26.139468 26876 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.99.193:38623 (error 108)
I20260809 09:25:26.140432 27398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:26.140134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:38623 (local address 127.0.0.1:48896)
0809 09:25:26.140265 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:26.140338 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.193:38623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 09:25:26.140552 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 27098
W20260809 09:25:26.140646 26876 catalog_manager.cc:4584] TS 0634f0173a7346b1bc2b7f73c33002e0 (127.11.99.193:38623): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 049fa4d1c6214285be3ff8f12db27633: Network error: Client connection negotiation failed: client connection to 127.11.99.193:38623: connect: Connection refused (error 111)
I20260809 09:25:26.147696 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 27242
I20260809 09:25:26.154201 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 26855
I20260809 09:25:26.161264 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:34489
--webserver_interface=127.11.99.254
--webserver_port=42113
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:44125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:34489
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:25:26.266006 27427 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:26.266247 27427 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:26.266285 27427 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:26.270088 27427 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:25:26.270136 27427 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:26.270153 27427 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:26.270169 27427 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:25:26.270181 27427 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:25:26.275010 27427 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:44125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:34489
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:34489
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=42113
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27427
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:26.275955 27427 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:26.276873 27427 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:25:26.290369 27436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:26.290364 27434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:26.290364 27433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:26.290819 27427 server_base.cc:1034] running on GCE node
I20260809 09:25:26.291419 27427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:26.292554 27427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:26.293752 27427 hybrid_clock.cc:648] HybridClock initialized: now 1786267526293742 us; error 34 us; skew 500 ppm
Aug 09 09:25:26 dist-test-slave-pgkr krb5kdc[26842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267526, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:26.296519 27427 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:25:26.297434 27427 webserver.cc:460] Webserver started at http://127.11.99.254:42113/ using document root <none> and password file <none>
I20260809 09:25:26.297998 27427 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:26.298112 27427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:25:26.301838 27427 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:25:26.303946 27444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:26.305102 27427 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 09:25:26.305244 27427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "1f90d1c989c2461bb6da5a1693497c8f"
format_stamp: "Formatted at 2026-08-09 09:25:25 on dist-test-slave-pgkr"
server_key: "f70f79ee07a950e098a18bf26e41714a"
server_key_iv: "0ba6cb33dc5b2a6469916939a9efb8da"
server_key_version: "encryptionkey@0"
I20260809 09:25:26.305855 27427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:26.325994 27427 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:26.329310 27427 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:26.329492 27427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:26.336570 27427 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:34489
I20260809 09:25:26.336890 27497 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:34489 every 8 connection(s)
I20260809 09:25:26.337714 27427 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:25:26.341958 27498 sys_catalog.cc:263] Verifying existing consensus state
I20260809 09:25:26.343652 27498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f: Bootstrap starting.
I20260809 09:25:26.347386 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 27427
I20260809 09:25:26.347821 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:38623
--local_ip_for_outbound_sockets=127.11.99.193
--tserver_master_addrs=127.11.99.254:34489
--webserver_port=32925
--webserver_interface=127.11.99.193
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:44125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 09:25:26.360549 27498 log.cc:824] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f: Log is configured to *not* fsync() on all Append() calls
I20260809 09:25:26.369204 27498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 09:25:26.369580 27498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f: Bootstrap complete.
I20260809 09:25:26.373871 27498 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f90d1c989c2461bb6da5a1693497c8f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34489 } }
I20260809 09:25:26.374321 27498 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f90d1c989c2461bb6da5a1693497c8f, State: Initialized, Role: FOLLOWER
I20260809 09:25:26.374909 27498 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f90d1c989c2461bb6da5a1693497c8f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34489 } }
I20260809 09:25:26.375064 27498 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:25:26.375166 27498 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:25:26.375288 27498 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [term 1 FOLLOWER]: Advancing to term 2
I20260809 09:25:26.377301 27498 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f90d1c989c2461bb6da5a1693497c8f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34489 } }
I20260809 09:25:26.377653 27498 leader_election.cc:302] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f90d1c989c2461bb6da5a1693497c8f; no voters:
I20260809 09:25:26.378005 27498 leader_election.cc:288] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 09:25:26.378099 27502 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [term 2 FOLLOWER]: Leader election won for term 2
I20260809 09:25:26.378295 27502 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [term 2 LEADER]: Becoming Leader. State: Replica: 1f90d1c989c2461bb6da5a1693497c8f, State: Running, Role: LEADER
I20260809 09:25:26.378585 27502 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f90d1c989c2461bb6da5a1693497c8f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34489 } }
I20260809 09:25:26.379297 27498 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:25:26.379917 27503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "1f90d1c989c2461bb6da5a1693497c8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f90d1c989c2461bb6da5a1693497c8f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34489 } } }
I20260809 09:25:26.380061 27503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [sys.catalog]: This master's current role is: LEADER
I20260809 09:25:26.380401 27504 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f90d1c989c2461bb6da5a1693497c8f. Latest consensus state: current_term: 2 leader_uuid: "1f90d1c989c2461bb6da5a1693497c8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f90d1c989c2461bb6da5a1693497c8f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34489 } } }
I20260809 09:25:26.380497 27504 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [sys.catalog]: This master's current role is: LEADER
I20260809 09:25:26.380829 27507 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:25:26.385617 27507 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:25:26.386478 27507 catalog_manager.cc:1259] Loaded cluster ID: 367ae9ca6c8f48ad91a1719980620f4d
I20260809 09:25:26.386543 27507 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:25:26.388010 27507 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260809 09:25:26.392970 27507 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260809 09:25:26.398300 27507 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:25:26.399050 27507 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f: Loaded TSK: 0
I20260809 09:25:26.400209 27507 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 09:25:26.462481 27500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:26.462770 27500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:26.462857 27500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:26.466710 27500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:26.466799 27500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:26.466884 27500 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:25:26.471843 27500 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:44125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:38623
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=32925
--tserver_master_addrs=127.11.99.254:34489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:26.472819 27500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:26.473837 27500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:25:26.484115 27526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:26.484043 27525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:26.484066 27528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:26.484513 27500 server_base.cc:1034] running on GCE node
I20260809 09:25:26.484925 27500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:26.485536 27500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:26.486720 27500 hybrid_clock.cc:648] HybridClock initialized: now 1786267526486697 us; error 39 us; skew 500 ppm
Aug 09 09:25:26 dist-test-slave-pgkr krb5kdc[26842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267526, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:26.489405 27500 init.cc:377] Logged in from keytab as kudu/127.11.99.193@KRBTEST.COM (short username kudu)
I20260809 09:25:26.490272 27500 webserver.cc:460] Webserver started at http://127.11.99.193:32925/ using document root <none> and password file <none>
I20260809 09:25:26.490888 27500 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:26.491037 27500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:25:26.495064 27500 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 09:25:26.497280 27535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:26.498593 27500 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:25:26.498781 27500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "0634f0173a7346b1bc2b7f73c33002e0"
format_stamp: "Formatted at 2026-08-09 09:25:25 on dist-test-slave-pgkr"
server_key: "16b2053ae04efa8903c9496be45e9520"
server_key_iv: "18dd732187c4a9cc76bda7fa68388772"
server_key_version: "encryptionkey@0"
I20260809 09:25:26.499346 27500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:26.516497 27500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:26.519652 27500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:26.519860 27500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:26.520490 27500 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:25:26.521531 27542 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 09:25:26.526535 27500 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 09:25:26.526610 27500 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260809 09:25:26.526731 27500 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 09:25:26.528414 27500 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 09:25:26.528483 27500 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260809 09:25:26.528761 27542 tablet_bootstrap.cc:492] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0: Bootstrap starting.
I20260809 09:25:26.539369 27500 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:38623
I20260809 09:25:26.539392 27655 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:38623 every 8 connection(s)
I20260809 09:25:26.540328 27500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:25:26.545095 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 27500
I20260809 09:25:26.545629 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:37387
--local_ip_for_outbound_sockets=127.11.99.194
--tserver_master_addrs=127.11.99.254:34489
--webserver_port=43315
--webserver_interface=127.11.99.194
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:44125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 09:25:26.548794 27542 log.cc:824] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0: Log is configured to *not* fsync() on all Append() calls
Aug 09 09:25:26 dist-test-slave-pgkr krb5kdc[26842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267526, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:25:26.557081 27542 tablet_bootstrap.cc:492] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 09:25:26.557540 27542 tablet_bootstrap.cc:492] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0: Bootstrap complete.
I20260809 09:25:26.558939 27542 ts_tablet_manager.cc:1397] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0: Time spent bootstrapping tablet: real 0.030s user 0.022s sys 0.008s
I20260809 09:25:26.560034 27658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:26.542500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:35211 (local address 127.11.99.254:34489)
0809 09:25:26.542898 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:26.542917 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:26.543243 (+ 326us) server_negotiation.cc:407] Connection header received
0809 09:25:26.544348 (+ 1105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:26.544363 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:26.544808 (+ 445us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:26.545280 (+ 472us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:26.546858 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.548307 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.549591 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.550302 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.550479 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:26.553823 (+ 3344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:26.553829 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:26.553847 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:26.553879 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:26.556062 (+ 2183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:26.556826 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:26.556835 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:26.556842 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:26.556996 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:26.557468 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:26.557474 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:26.557479 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:26.557963 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:26.558102 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:26.558856 (+ 754us) server_negotiation.cc:299] Negotiation successful
0809 09:25:26.559176 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":131,"threads_started":1}
I20260809 09:25:26.560039 27659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:26.542392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.193:35211)
0809 09:25:26.543057 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:26.543108 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:26.543912 (+ 804us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:26.545407 (+ 1495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:26.545419 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:26.545942 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:26.546617 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:26.546671 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.548496 (+ 1825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.548502 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:26.549460 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:26.549471 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.550477 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.550484 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:26.550789 (+ 305us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:26.551515 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:26.551550 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:26.553578 (+ 2028us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:26.556224 (+ 2646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:26.556230 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:26.556245 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:26.556660 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:26.557115 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:26.557121 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:26.557126 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:26.557324 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:26.558102 (+ 778us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:26.558108 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:26.558433 (+ 325us) client_negotiation.cc:769] Sending connection context
0809 09:25:26.558715 (+ 282us) client_negotiation.cc:240] Negotiation successful
0809 09:25:26.559146 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":169,"threads_started":1}
I20260809 09:25:26.561750 27542 raft_consensus.cc:348] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } } peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } }
I20260809 09:25:26.562276 27542 raft_consensus.cc:729] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0634f0173a7346b1bc2b7f73c33002e0, State: Initialized, Role: FOLLOWER
I20260809 09:25:26.562798 27542 consensus_queue.cc:260] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } } peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } }
I20260809 09:25:26.563205 27656 heartbeater.cc:347] Connected to a master server at 127.11.99.254:34489
I20260809 09:25:26.563418 27656 heartbeater.cc:464] Registering TS with master...
I20260809 09:25:26.563808 27542 ts_tablet_manager.cc:1428] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260809 09:25:26.563941 27656 heartbeater.cc:511] Master 127.11.99.254:34489 requested a full tablet report, sending...
I20260809 09:25:26.566061 27462 ts_manager.cc:194] Registered new tserver with Master: 0634f0173a7346b1bc2b7f73c33002e0 (127.11.99.193:38623)
I20260809 09:25:26.569538 27462 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.193@KRBTEST.COM'} at 127.11.99.193:35211
I20260809 09:25:26.571856 27656 heartbeater.cc:503] Master 127.11.99.254:34489 was elected leader, sending a full tablet report...
Aug 09 09:25:26 dist-test-slave-pgkr krb5kdc[26842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267526, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for kudu/127.11.99.193@KRBTEST.COM
I20260809 09:25:26.580214 27663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:26.568878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:38623 (local address 127.0.0.1:48908)
0809 09:25:26.569650 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:26.569701 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:26.569846 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:26.570488 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:26.570493 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:26.570966 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:26.571094 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:26.571102 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.572564 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.572568 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:26.573475 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:26.573487 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.574064 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.574068 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:26.574175 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:26.574795 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:26.574810 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:26.576376 (+ 1566us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:26.578259 (+ 1883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:26.578269 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:26.578274 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:26.578568 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:26.578977 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:26.578980 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:26.578981 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:26.579062 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:26.579543 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:26.579549 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:26.579668 (+ 119us) client_negotiation.cc:769] Sending connection context
0809 09:25:26.579822 (+ 154us) client_negotiation.cc:240] Negotiation successful
0809 09:25:26.580036 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":105,"threads_started":1}
I20260809 09:25:26.580277 27664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:26.568984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48908 (local address 127.11.99.193:38623)
0809 09:25:26.569376 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:26.569387 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:26.569807 (+ 420us) server_negotiation.cc:407] Connection header received
0809 09:25:26.569996 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:26.570001 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:26.570195 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:26.570471 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:26.571253 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.572377 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.573610 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.573943 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.574026 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:26.576524 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:26.576532 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:26.576541 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:26.576563 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:26.578144 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:26.578706 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:26.578710 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:26.578711 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:26.578795 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:26.579172 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:26.579175 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:26.579177 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:26.579411 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:26.579566 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:26.579919 (+ 353us) server_negotiation.cc:299] Negotiation successful
0809 09:25:26.580126 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":122,"threads_started":1}
I20260809 09:25:26.581552 27585 tablet_service.cc:1514] Processing DeleteTablet for tablet 049fa4d1c6214285be3ff8f12db27633 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:25:26 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:48908
I20260809 09:25:26.582396 27665 tablet_replica.cc:330] stopping tablet replica
I20260809 09:25:26.582710 27665 raft_consensus.cc:2229] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:25:26.582947 27665 raft_consensus.cc:2258] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:25:26.583806 27665 ts_tablet_manager.cc:1905] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:25:26.587431 27665 ts_tablet_manager.cc:1918] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:25:26.587540 27665 log.cc:1196] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/wal/wals/049fa4d1c6214285be3ff8f12db27633
I20260809 09:25:26.587808 27665 ts_tablet_manager.cc:1939] T 049fa4d1c6214285be3ff8f12db27633 P 0634f0173a7346b1bc2b7f73c33002e0: Deleting consensus metadata
I20260809 09:25:26.589883 27448 catalog_manager.cc:4841] TS 0634f0173a7346b1bc2b7f73c33002e0 (127.11.99.193:38623): tablet 049fa4d1c6214285be3ff8f12db27633 (table test-table [id=7ac875e85c854ccf890bd8862f628254]) successfully deleted
W20260809 09:25:26.663226 27660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:26.663498 27660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:26.663583 27660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:26.667608 27660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:26.667685 27660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:26.667764 27660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:25:26.672922 27660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:44125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:37387
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=43315
--tserver_master_addrs=127.11.99.254:34489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:26.674024 27660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:26.675024 27660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:25:26.684176 27671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:26.684144 27673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:26.684165 27670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:26.684212 27660 server_base.cc:1034] running on GCE node
I20260809 09:25:26.684854 27660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:26.685451 27660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:26.686661 27660 hybrid_clock.cc:648] HybridClock initialized: now 1786267526686647 us; error 26 us; skew 500 ppm
Aug 09 09:25:26 dist-test-slave-pgkr krb5kdc[26842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267526, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:26.689174 27660 init.cc:377] Logged in from keytab as kudu/127.11.99.194@KRBTEST.COM (short username kudu)
I20260809 09:25:26.689946 27660 webserver.cc:460] Webserver started at http://127.11.99.194:43315/ using document root <none> and password file <none>
I20260809 09:25:26.690404 27660 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:26.690510 27660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:25:26.694453 27660 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 09:25:26.696322 27681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:26.697379 27660 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 09:25:26.697465 27660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "f0635231a8d140628245d5ad29184f3b"
format_stamp: "Formatted at 2026-08-09 09:25:25 on dist-test-slave-pgkr"
server_key: "eaab62bd763781a653beeae54340259c"
server_key_iv: "d23e17577d2dffc24b04d007efd5f612"
server_key_version: "encryptionkey@0"
I20260809 09:25:26.697898 27660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:26.706883 27660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:26.709462 27660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:26.709636 27660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:26.710183 27660 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:25:26.710975 27660 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:25:26.711020 27660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:26.711091 27660 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:25:26.711131 27660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:26.719551 27660 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:37387
I20260809 09:25:26.719594 27799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:37387 every 8 connection(s)
I20260809 09:25:26.720510 27660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:25:26.723433 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 27660
I20260809 09:25:26.723835 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:46395
--local_ip_for_outbound_sockets=127.11.99.195
--tserver_master_addrs=127.11.99.254:34489
--webserver_port=39745
--webserver_interface=127.11.99.195
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:44125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 09:25:26 dist-test-slave-pgkr krb5kdc[26842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267526, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:25:26.735826 27658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:26.722128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:45639 (local address 127.11.99.254:34489)
0809 09:25:26.722262 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:26.722266 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:26.723063 (+ 797us) server_negotiation.cc:407] Connection header received
0809 09:25:26.724524 (+ 1461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:26.724528 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:26.724592 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:26.724695 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:26.726040 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.726552 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.728330 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.728583 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.728669 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:26.731870 (+ 3201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:26.731872 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:26.731874 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:26.731895 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:26.733429 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:26.734091 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:26.734094 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:26.734095 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:26.734167 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:26.734596 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:26.734598 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:26.734599 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:26.734849 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:26.734928 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:26.735609 (+ 681us) server_negotiation.cc:299] Negotiation successful
0809 09:25:26.735709 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 09:25:26.737049 27802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:26.722458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.194:45639)
0809 09:25:26.722906 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:26.722947 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:26.724318 (+ 1371us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:26.724864 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:26.724870 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:26.725195 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:26.725875 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:26.725896 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.726705 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.726712 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:26.728200 (+ 1488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:26.728217 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.728767 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.728775 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:26.729008 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:26.729821 (+ 813us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:26.729847 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:26.731693 (+ 1846us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:26.733552 (+ 1859us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:26.733560 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:26.733575 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:26.733980 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:26.734285 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:26.734290 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:26.734292 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:26.734495 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:26.734985 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:26.734994 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:26.735339 (+ 345us) client_negotiation.cc:769] Sending connection context
0809 09:25:26.735577 (+ 238us) client_negotiation.cc:240] Negotiation successful
0809 09:25:26.735950 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":132,"threads_started":1}
I20260809 09:25:26.738173 27800 heartbeater.cc:347] Connected to a master server at 127.11.99.254:34489
I20260809 09:25:26.738399 27800 heartbeater.cc:464] Registering TS with master...
I20260809 09:25:26.738919 27800 heartbeater.cc:511] Master 127.11.99.254:34489 requested a full tablet report, sending...
I20260809 09:25:26.739914 27462 ts_manager.cc:194] Registered new tserver with Master: f0635231a8d140628245d5ad29184f3b (127.11.99.194:37387)
I20260809 09:25:26.740458 27462 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.194@KRBTEST.COM'} at 127.11.99.194:45639
W20260809 09:25:26.836707 27803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:26.836966 27803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:26.837067 27803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:26.840963 27803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:26.841037 27803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:26.841118 27803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:25:26.845957 27803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:44125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:46395
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=39745
--tserver_master_addrs=127.11.99.254:34489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27803
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:26.846931 27803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:26.847812 27803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:25:26.856779 27809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:26.856771 27803 server_base.cc:1034] running on GCE node
W20260809 09:25:26.856751 27808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:26.856956 27811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:26.857318 27803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:26.857945 27803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:26.859098 27803 hybrid_clock.cc:648] HybridClock initialized: now 1786267526859070 us; error 39 us; skew 500 ppm
Aug 09 09:25:26 dist-test-slave-pgkr krb5kdc[26842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267526, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:26.861922 27803 init.cc:377] Logged in from keytab as kudu/127.11.99.195@KRBTEST.COM (short username kudu)
I20260809 09:25:26.862747 27803 webserver.cc:460] Webserver started at http://127.11.99.195:39745/ using document root <none> and password file <none>
I20260809 09:25:26.863224 27803 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:26.863292 27803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:25:26.867046 27803 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260809 09:25:26.868993 27818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:26.870213 27803 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:25:26.870321 27803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0"
format_stamp: "Formatted at 2026-08-09 09:25:25 on dist-test-slave-pgkr"
server_key: "d4018170ed8b4d892f8e1f5865b69bbd"
server_key_iv: "050b0293aea450142fc1f6a84565da03"
server_key_version: "encryptionkey@0"
I20260809 09:25:26.870934 27803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:26.891146 27803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:26.894181 27803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:26.894325 27803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:26.894919 27803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:25:26.895732 27803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:25:26.895785 27803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:26.895825 27803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:25:26.895845 27803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:26.904918 27803 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:46395
I20260809 09:25:26.905002 27933 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:46395 every 8 connection(s)
I20260809 09:25:26.905871 27803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:25:26.911285 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 27803
Aug 09 09:25:26 dist-test-slave-pgkr krb5kdc[26842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267526, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:25:26.919968 27938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:26.911925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44074 (local address 127.11.99.254:34489)
0809 09:25:26.912179 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:26.912182 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:26.912323 (+ 141us) server_negotiation.cc:407] Connection header received
0809 09:25:26.912460 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:26.912462 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:26.912499 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:26.912582 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:26.913490 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.913991 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.914923 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.915146 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.915253 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:26.916672 (+ 1419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:26.916681 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:26.916683 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:26.916704 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:26.918135 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:26.918570 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:26.918577 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:26.918580 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:26.918712 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:26.919051 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:26.919057 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:26.919059 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:26.919235 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:26.919447 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:26.919658 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 09:25:26.919787 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":183,"thread_start_us":98,"threads_started":1}
I20260809 09:25:26.920816 27658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:26.907586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:36581 (local address 127.11.99.254:34489)
0809 09:25:26.907714 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:26.907718 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:26.908437 (+ 719us) server_negotiation.cc:407] Connection header received
0809 09:25:26.909857 (+ 1420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:26.909860 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:26.909919 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:26.910023 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:26.911215 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.911777 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.913688 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.913937 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.914047 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:26.916725 (+ 2678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:26.916728 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:26.916730 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:26.916763 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:26.918366 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:26.918980 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:26.918985 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:26.918986 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:26.919070 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:26.919407 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:26.919409 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:26.919411 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:26.919573 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:26.919698 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:26.920578 (+ 880us) server_negotiation.cc:299] Negotiation successful
0809 09:25:26.920674 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":49}
I20260809 09:25:26.921682 27936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:26.907902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.195:36581)
0809 09:25:26.908297 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:26.908335 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:26.909654 (+ 1319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:26.910202 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:26.910209 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:26.910547 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:26.911073 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:26.911087 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.912134 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.912138 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:26.913569 (+ 1431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:26.913578 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.914084 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.914089 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:26.914263 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:26.914860 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:26.914875 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:26.916558 (+ 1683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:26.918497 (+ 1939us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:26.918511 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:26.918524 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:26.918863 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:26.919162 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:26.919166 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:26.919168 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:26.919304 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:26.919745 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:26.919749 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:26.920035 (+ 286us) client_negotiation.cc:769] Sending connection context
0809 09:25:26.920477 (+ 442us) client_negotiation.cc:240] Negotiation successful
0809 09:25:26.920785 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":110,"threads_started":1}
I20260809 09:25:26.922778 27934 heartbeater.cc:347] Connected to a master server at 127.11.99.254:34489
I20260809 09:25:26.923034 27934 heartbeater.cc:464] Registering TS with master...
I20260809 09:25:26.923525 27934 heartbeater.cc:511] Master 127.11.99.254:34489 requested a full tablet report, sending...
I20260809 09:25:26.924499 27462 ts_manager.cc:194] Registered new tserver with Master: c6cc71a71e7d4ad88b7abe46adb8b4b0 (127.11.99.195:46395)
I20260809 09:25:26.925034 27462 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.195@KRBTEST.COM'} at 127.11.99.195:36581
I20260809 09:25:26.933426 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 09:25:26.937306 27658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:26.933991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44088 (local address 127.11.99.254:34489)
0809 09:25:26.934119 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:26.934122 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:26.934313 (+ 191us) server_negotiation.cc:407] Connection header received
0809 09:25:26.934416 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:26.934418 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:26.934496 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:26.934574 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:25:26.934841 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.935325 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.936153 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.936366 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.936437 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:26.936681 (+ 244us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:25:26.937018 (+ 337us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:25:26.937102 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:26.937171 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 09:25:26.937209 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 09:25:26.937904 27462 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:44088:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 09:25:26.941155 27462 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:25:26.948405 27585 tablet_service.cc:1467] Processing CreateTablet for tablet ef65ef39840a43869fd00783cc64095d (DEFAULT_TABLE table=test-table [id=d211a7aa5cd54b5c9d95b36ffbc8e895]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:25:26.949044 27585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef65ef39840a43869fd00783cc64095d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:25:26.951704 27542 tablet_bootstrap.cc:492] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0: Bootstrap starting.
I20260809 09:25:26.952639 27542 tablet_bootstrap.cc:654] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0: Neither blocks nor log segments found. Creating new log.
I20260809 09:25:26.953102 27663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:26.947389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:37387 (local address 127.0.0.1:49728)
0809 09:25:26.947506 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:26.947543 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:26.947614 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:26.948785 (+ 1171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:26.948788 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:26.948807 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:25:26.948902 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:26.948909 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.950191 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.950197 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:26.951601 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:26.951612 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.952715 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.952718 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:26.952810 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:26.952862 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 09:25:26.952919 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 09:25:26.953006 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47,"mutex_wait_us":72}
I20260809 09:25:26.953378 27945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:26.947826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:46395 (local address 127.0.0.1:38212)
0809 09:25:26.948083 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:26.948096 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:26.948178 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:26.949004 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:26.949007 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:26.949026 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:25:26.949105 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:26.949113 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.950650 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.950654 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:26.951811 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:26.951822 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.952985 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.952989 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:26.953083 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:26.953107 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 09:25:26.953162 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 09:25:26.953232 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":37,"thread_start_us":97,"threads_started":1}
I20260809 09:25:26.953837 27944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:26.947590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49728 (local address 127.11.99.194:37387)
0809 09:25:26.948153 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:26.948165 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:26.948188 (+ 23us) server_negotiation.cc:407] Connection header received
0809 09:25:26.948265 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:26.948270 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:26.948486 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:26.948805 (+ 319us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:25:26.949039 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.950018 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.951748 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.952434 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.953391 (+ 957us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:26.953556 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:26.953618 (+ 62us) server_negotiation.cc:299] Negotiation successful
0809 09:25:26.953720 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":165,"threads_started":1}
I20260809 09:25:26.954109 27542 tablet_bootstrap.cc:492] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0: No bootstrap required, opened a new log
I20260809 09:25:26.954203 27542 ts_tablet_manager.cc:1397] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260809 09:25:26.954674 27542 raft_consensus.cc:348] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } } peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } }
I20260809 09:25:26.954798 27542 raft_consensus.cc:374] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:25:26.954840 27947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:26.948239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38212 (local address 127.11.99.195:46395)
0809 09:25:26.948558 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:26.948571 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:26.948591 (+ 20us) server_negotiation.cc:407] Connection header received
0809 09:25:26.948656 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:26.948661 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:26.948820 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:26.948995 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:25:26.949200 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.950473 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.951956 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:26.952818 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:26.953637 (+ 819us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:26.953789 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:26.953841 (+ 52us) server_negotiation.cc:299] Negotiation successful
0809 09:25:26.954678 (+ 837us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":102,"threads_started":1}
I20260809 09:25:26.954840 27542 raft_consensus.cc:729] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0634f0173a7346b1bc2b7f73c33002e0, State: Initialized, Role: FOLLOWER
I20260809 09:25:26.955005 27542 consensus_queue.cc:260] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } } peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } }
I20260809 09:25:26.955286 27542 ts_tablet_manager.cc:1428] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 09:25:26.956852 27731 tablet_service.cc:1467] Processing CreateTablet for tablet ef65ef39840a43869fd00783cc64095d (DEFAULT_TABLE table=test-table [id=d211a7aa5cd54b5c9d95b36ffbc8e895]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:25:26.957369 27866 tablet_service.cc:1467] Processing CreateTablet for tablet ef65ef39840a43869fd00783cc64095d (DEFAULT_TABLE table=test-table [id=d211a7aa5cd54b5c9d95b36ffbc8e895]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:25:26.957827 27731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef65ef39840a43869fd00783cc64095d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:25:26.958320 27866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef65ef39840a43869fd00783cc64095d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:25:26.963929 27949 tablet_bootstrap.cc:492] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b: Bootstrap starting.
I20260809 09:25:26.963977 27950 tablet_bootstrap.cc:492] T ef65ef39840a43869fd00783cc64095d P c6cc71a71e7d4ad88b7abe46adb8b4b0: Bootstrap starting.
I20260809 09:25:26.966055 27949 tablet_bootstrap.cc:654] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b: Neither blocks nor log segments found. Creating new log.
I20260809 09:25:26.966326 27950 tablet_bootstrap.cc:654] T ef65ef39840a43869fd00783cc64095d P c6cc71a71e7d4ad88b7abe46adb8b4b0: Neither blocks nor log segments found. Creating new log.
I20260809 09:25:26.966995 27949 log.cc:824] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b: Log is configured to *not* fsync() on all Append() calls
I20260809 09:25:26.967195 27950 log.cc:824] T ef65ef39840a43869fd00783cc64095d P c6cc71a71e7d4ad88b7abe46adb8b4b0: Log is configured to *not* fsync() on all Append() calls
I20260809 09:25:26.969017 27949 tablet_bootstrap.cc:492] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b: No bootstrap required, opened a new log
I20260809 09:25:26.969017 27950 tablet_bootstrap.cc:492] T ef65ef39840a43869fd00783cc64095d P c6cc71a71e7d4ad88b7abe46adb8b4b0: No bootstrap required, opened a new log
I20260809 09:25:26.969205 27949 ts_tablet_manager.cc:1397] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 09:25:26.969205 27950 ts_tablet_manager.cc:1397] T ef65ef39840a43869fd00783cc64095d P c6cc71a71e7d4ad88b7abe46adb8b4b0: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 09:25:26.973029 27950 raft_consensus.cc:348] T ef65ef39840a43869fd00783cc64095d P c6cc71a71e7d4ad88b7abe46adb8b4b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } } peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } }
I20260809 09:25:26.973021 27949 raft_consensus.cc:348] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } } peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } }
I20260809 09:25:26.973343 27949 raft_consensus.cc:374] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:25:26.973343 27950 raft_consensus.cc:374] T ef65ef39840a43869fd00783cc64095d P c6cc71a71e7d4ad88b7abe46adb8b4b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:25:26.973397 27949 raft_consensus.cc:729] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0635231a8d140628245d5ad29184f3b, State: Initialized, Role: FOLLOWER
I20260809 09:25:26.973407 27950 raft_consensus.cc:729] T ef65ef39840a43869fd00783cc64095d P c6cc71a71e7d4ad88b7abe46adb8b4b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6cc71a71e7d4ad88b7abe46adb8b4b0, State: Initialized, Role: FOLLOWER
I20260809 09:25:26.973917 27950 consensus_queue.cc:260] T ef65ef39840a43869fd00783cc64095d P c6cc71a71e7d4ad88b7abe46adb8b4b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } } peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } }
I20260809 09:25:26.973917 27949 consensus_queue.cc:260] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } } peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } }
I20260809 09:25:26.974732 27800 heartbeater.cc:503] Master 127.11.99.254:34489 was elected leader, sending a full tablet report...
I20260809 09:25:26.975006 27949 ts_tablet_manager.cc:1428] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260809 09:25:26.975000 27934 heartbeater.cc:503] Master 127.11.99.254:34489 was elected leader, sending a full tablet report...
I20260809 09:25:26.975006 27950 ts_tablet_manager.cc:1428] T ef65ef39840a43869fd00783cc64095d P c6cc71a71e7d4ad88b7abe46adb8b4b0: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
W20260809 09:25:27.041662 27657 tablet.cc:2369] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:25:27.140594 27954 raft_consensus.cc:482] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:25:27.140861 27954 raft_consensus.cc:504] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } } peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } }
I20260809 09:25:27.141949 27954 leader_election.cc:288] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6cc71a71e7d4ad88b7abe46adb8b4b0 (127.11.99.195:46395), 0634f0173a7346b1bc2b7f73c33002e0 (127.11.99.193:38623)
I20260809 09:25:27.145988 27947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:27.142351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:39261 (local address 127.11.99.195:46395)
0809 09:25:27.142486 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:27.142491 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:27.142508 (+ 17us) server_negotiation.cc:407] Connection header received
0809 09:25:27.142570 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:27.142573 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:27.142665 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:27.142748 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:25:27.143079 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:27.143783 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:27.144959 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:27.145516 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:27.145601 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:27.145639 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:27.145844 (+ 205us) server_negotiation.cc:299] Negotiation successful
0809 09:25:27.145897 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 09:25:27.146001 27802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:27.142166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:46395 (local address 127.11.99.194:39261)
0809 09:25:27.142288 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:27.142303 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:27.142390 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:27.142794 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:27.142797 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:27.142819 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:25:27.142937 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:27.142942 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:27.143890 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:27.143894 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:27.144815 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:27.144824 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:27.145621 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:27.145624 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:27.145725 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:27.145750 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 09:25:27.145823 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 09:25:27.145885 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260809 09:25:27.146696 27956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:27.142172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:38623 (local address 127.11.99.194:48659)
0809 09:25:27.142968 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:27.142979 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:27.143106 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:27.143386 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:27.143388 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:27.143405 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:25:27.143509 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:27.143514 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:27.144408 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:27.144410 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:27.145314 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:27.145324 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:27.146265 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:27.146268 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:27.146360 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:27.146385 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 09:25:27.146462 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 09:25:27.146517 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":741,"mutex_wait_us":333,"thread_start_us":193,"threads_started":1}
I20260809 09:25:27.146667 27887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef65ef39840a43869fd00783cc64095d" candidate_uuid: "f0635231a8d140628245d5ad29184f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" is_pre_election: true
I20260809 09:25:27.146764 27955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:27.142300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:48659 (local address 127.11.99.193:38623)
0809 09:25:27.142650 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:27.142655 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:27.143095 (+ 440us) server_negotiation.cc:407] Connection header received
0809 09:25:27.143202 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:27.143204 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:27.143260 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:27.143346 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:25:27.143637 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:27.144296 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:27.145436 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:27.146015 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:27.146135 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:27.146288 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:27.146500 (+ 212us) server_negotiation.cc:299] Negotiation successful
0809 09:25:27.146567 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":138,"threads_started":1}
I20260809 09:25:27.146975 27887 raft_consensus.cc:2454] T ef65ef39840a43869fd00783cc64095d P c6cc71a71e7d4ad88b7abe46adb8b4b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0635231a8d140628245d5ad29184f3b in term 0.
I20260809 09:25:27.147264 27609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef65ef39840a43869fd00783cc64095d" candidate_uuid: "f0635231a8d140628245d5ad29184f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0634f0173a7346b1bc2b7f73c33002e0" is_pre_election: true
I20260809 09:25:27.147449 27682 leader_election.cc:302] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6cc71a71e7d4ad88b7abe46adb8b4b0, f0635231a8d140628245d5ad29184f3b; no voters:
I20260809 09:25:27.147518 27609 raft_consensus.cc:2454] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0635231a8d140628245d5ad29184f3b in term 0.
I20260809 09:25:27.147720 27954 raft_consensus.cc:2781] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:25:27.147816 27954 raft_consensus.cc:482] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:25:27.147869 27954 raft_consensus.cc:3037] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:25:27.148878 27954 raft_consensus.cc:504] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } } peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } }
I20260809 09:25:27.149222 27954 leader_election.cc:288] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b [CANDIDATE]: Term 1 election: Requested vote from peers c6cc71a71e7d4ad88b7abe46adb8b4b0 (127.11.99.195:46395), 0634f0173a7346b1bc2b7f73c33002e0 (127.11.99.193:38623)
I20260809 09:25:27.149540 27887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef65ef39840a43869fd00783cc64095d" candidate_uuid: "f0635231a8d140628245d5ad29184f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0"
I20260809 09:25:27.149561 27609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef65ef39840a43869fd00783cc64095d" candidate_uuid: "f0635231a8d140628245d5ad29184f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0634f0173a7346b1bc2b7f73c33002e0"
I20260809 09:25:27.149673 27887 raft_consensus.cc:3037] T ef65ef39840a43869fd00783cc64095d P c6cc71a71e7d4ad88b7abe46adb8b4b0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:25:27.149673 27609 raft_consensus.cc:3037] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:25:27.150929 27609 raft_consensus.cc:2454] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0635231a8d140628245d5ad29184f3b in term 1.
I20260809 09:25:27.150929 27887 raft_consensus.cc:2454] T ef65ef39840a43869fd00783cc64095d P c6cc71a71e7d4ad88b7abe46adb8b4b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0635231a8d140628245d5ad29184f3b in term 1.
I20260809 09:25:27.151268 27686 leader_election.cc:302] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0634f0173a7346b1bc2b7f73c33002e0, f0635231a8d140628245d5ad29184f3b; no voters:
I20260809 09:25:27.151434 27954 raft_consensus.cc:2781] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:25:27.151648 27954 raft_consensus.cc:686] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b [term 1 LEADER]: Becoming Leader. State: Replica: f0635231a8d140628245d5ad29184f3b, State: Running, Role: LEADER
I20260809 09:25:27.151954 27954 consensus_queue.cc:237] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } } peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } }
I20260809 09:25:27.154981 27462 catalog_manager.cc:5495] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b reported cstate change: term changed from 0 to 1, leader changed from <none> to f0635231a8d140628245d5ad29184f3b (127.11.99.194). New cstate: current_term: 1 leader_uuid: "f0635231a8d140628245d5ad29184f3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } health_report { overall_health: UNKNOWN } } }
W20260809 09:25:27.156757 27935 tablet.cc:2369] T ef65ef39840a43869fd00783cc64095d P c6cc71a71e7d4ad88b7abe46adb8b4b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:25:27.193594 27944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:27.190557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49744 (local address 127.11.99.194:37387)
0809 09:25:27.190710 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:27.190713 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:27.190729 (+ 16us) server_negotiation.cc:407] Connection header received
0809 09:25:27.190867 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:27.190869 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:27.190917 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:27.190999 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:25:27.191191 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:27.191659 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:27.192408 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:27.192632 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:27.192706 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:27.192956 (+ 250us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:25:27.193316 (+ 360us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:25:27.193401 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:27.193459 (+ 58us) server_negotiation.cc:299] Negotiation successful
0809 09:25:27.193503 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 09:25:27.198901 27887 raft_consensus.cc:1261] T ef65ef39840a43869fd00783cc64095d P c6cc71a71e7d4ad88b7abe46adb8b4b0 [term 1 FOLLOWER]: Refusing update from remote peer f0635231a8d140628245d5ad29184f3b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:25:27.198902 27609 raft_consensus.cc:1261] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [term 1 FOLLOWER]: Refusing update from remote peer f0635231a8d140628245d5ad29184f3b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:25:27.199546 27957 consensus_queue.cc:1035] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:25:27.199705 27954 consensus_queue.cc:1035] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:25:27.206854 27961 mvcc.cc:205] Tried to move back new op lower bound from 7316551791400222720 to 7316551791216680960. Current Snapshot: MvccSnapshot[applied={T|T < 7316551791400222720}]
I20260809 09:25:27.207394 27962 mvcc.cc:205] Tried to move back new op lower bound from 7316551791400222720 to 7316551791216680960. Current Snapshot: MvccSnapshot[applied={T|T < 7316551791400222720}]
I20260809 09:25:27.214547 27459 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:44088:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:25:27.214730 27459 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:44088:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:25:27.216763 27459 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f: Sending DeleteTablet for 3 replicas of tablet ef65ef39840a43869fd00783cc64095d
I20260809 09:25:27.217355 27585 tablet_service.cc:1514] Processing DeleteTablet for tablet ef65ef39840a43869fd00783cc64095d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:25:27 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:48908
I20260809 09:25:27.217543 27731 tablet_service.cc:1514] Processing DeleteTablet for tablet ef65ef39840a43869fd00783cc64095d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:25:27 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:49728
I20260809 09:25:27.217730 27970 tablet_replica.cc:330] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0: stopping tablet replica
I20260809 09:25:27.217692 27866 tablet_service.cc:1514] Processing DeleteTablet for tablet ef65ef39840a43869fd00783cc64095d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:25:27 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:38212
I20260809 09:25:27.217880 27970 raft_consensus.cc:2229] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:25:27.217938 27971 tablet_replica.cc:330] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b: stopping tablet replica
I20260809 09:25:27.218091 27970 raft_consensus.cc:2258] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:25:27.218135 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 27500
I20260809 09:25:27.218192 27971 raft_consensus.cc:2229] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b [term 1 LEADER]: Raft consensus shutting down.
I20260809 09:25:27.218518 27971 raft_consensus.cc:2258] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:25:27.220536 27971 ts_tablet_manager.cc:1905] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:25:27.223413 27971 ts_tablet_manager.cc:1918] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:25:27.223508 27971 log.cc:1196] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/ef65ef39840a43869fd00783cc64095d
I20260809 09:25:27.223817 27971 ts_tablet_manager.cc:1939] T ef65ef39840a43869fd00783cc64095d P f0635231a8d140628245d5ad29184f3b: Deleting consensus metadata
I20260809 09:25:27.224895 27445 catalog_manager.cc:4841] TS f0635231a8d140628245d5ad29184f3b (127.11.99.194:37387): tablet ef65ef39840a43869fd00783cc64095d (table test-table [id=d211a7aa5cd54b5c9d95b36ffbc8e895]) successfully deleted
I20260809 09:25:27.226828 27972 tablet_replica.cc:330] T ef65ef39840a43869fd00783cc64095d P c6cc71a71e7d4ad88b7abe46adb8b4b0: stopping tablet replica
I20260809 09:25:27.227130 27972 raft_consensus.cc:2229] T ef65ef39840a43869fd00783cc64095d P c6cc71a71e7d4ad88b7abe46adb8b4b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:25:27.227430 27972 raft_consensus.cc:2258] T ef65ef39840a43869fd00783cc64095d P c6cc71a71e7d4ad88b7abe46adb8b4b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:25:27.228857 27972 ts_tablet_manager.cc:1905] T ef65ef39840a43869fd00783cc64095d P c6cc71a71e7d4ad88b7abe46adb8b4b0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 09:25:27.229236 27448 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.99.193:38623 (error 108)
I20260809 09:25:27.229851 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 27660
I20260809 09:25:27.231513 27945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:27.230746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:38623 (local address 127.0.0.1:48922)
0809 09:25:27.231336 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:27.231422 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.193:38623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":485}
I20260809 09:25:27.231549 27972 ts_tablet_manager.cc:1918] T ef65ef39840a43869fd00783cc64095d P c6cc71a71e7d4ad88b7abe46adb8b4b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:25:27.231642 27972 log.cc:1196] T ef65ef39840a43869fd00783cc64095d P c6cc71a71e7d4ad88b7abe46adb8b4b0: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/ef65ef39840a43869fd00783cc64095d
I20260809 09:25:27.232005 27972 ts_tablet_manager.cc:1939] T ef65ef39840a43869fd00783cc64095d P c6cc71a71e7d4ad88b7abe46adb8b4b0: Deleting consensus metadata
W20260809 09:25:27.232405 27448 catalog_manager.cc:4584] TS 0634f0173a7346b1bc2b7f73c33002e0 (127.11.99.193:38623): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ef65ef39840a43869fd00783cc64095d: Network error: Client connection negotiation failed: client connection to 127.11.99.193:38623: connect: Connection refused (error 111)
I20260809 09:25:27.233150 27445 catalog_manager.cc:4841] TS c6cc71a71e7d4ad88b7abe46adb8b4b0 (127.11.99.195:46395): tablet ef65ef39840a43869fd00783cc64095d (table test-table [id=d211a7aa5cd54b5c9d95b36ffbc8e895]) successfully deleted
I20260809 09:25:27.238059 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 27803
I20260809 09:25:27.245108 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 27427
I20260809 09:25:27.254104 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:34489
--webserver_interface=127.11.99.254
--webserver_port=42113
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:44125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:34489
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:25:27.357146 27974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:27.357347 27974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:27.357381 27974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:27.361079 27974 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:25:27.361128 27974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:27.361146 27974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:27.361161 27974 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:25:27.361176 27974 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:25:27.365748 27974 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:44125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:34489
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:34489
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=42113
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27974
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:27.366508 27974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:27.367367 27974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:25:27.374801 27979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:27.374845 27974 server_base.cc:1034] running on GCE node
W20260809 09:25:27.374845 27980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:27.374804 27982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:27.375589 27974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:27.376477 27974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:27.377636 27974 hybrid_clock.cc:648] HybridClock initialized: now 1786267527377626 us; error 23 us; skew 500 ppm
Aug 09 09:25:27 dist-test-slave-pgkr krb5kdc[26842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267527, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:27.385047 27974 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:25:27.385864 27974 webserver.cc:460] Webserver started at http://127.11.99.254:42113/ using document root <none> and password file <none>
I20260809 09:25:27.386365 27974 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:27.386453 27974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:25:27.389808 27974 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:25:27.391691 27989 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:27.392804 27974 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 09:25:27.392937 27974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "1f90d1c989c2461bb6da5a1693497c8f"
format_stamp: "Formatted at 2026-08-09 09:25:25 on dist-test-slave-pgkr"
server_key: "f70f79ee07a950e098a18bf26e41714a"
server_key_iv: "0ba6cb33dc5b2a6469916939a9efb8da"
server_key_version: "encryptionkey@0"
I20260809 09:25:27.393420 27974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:27.405002 27974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:27.407567 27974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:27.407734 27974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:27.414072 27974 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:34489
I20260809 09:25:27.414335 28043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:34489 every 8 connection(s)
I20260809 09:25:27.415059 27974 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:25:27.418823 28044 sys_catalog.cc:263] Verifying existing consensus state
I20260809 09:25:27.420401 28044 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f: Bootstrap starting.
I20260809 09:25:27.420506 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 27974
I20260809 09:25:27.420941 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:38623
--local_ip_for_outbound_sockets=127.11.99.193
--tserver_master_addrs=127.11.99.254:34489
--webserver_port=32925
--webserver_interface=127.11.99.193
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:44125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 09:25:27.437287 28044 log.cc:824] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f: Log is configured to *not* fsync() on all Append() calls
I20260809 09:25:27.447799 28044 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 09:25:27.448158 28044 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f: Bootstrap complete.
I20260809 09:25:27.451934 28044 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f90d1c989c2461bb6da5a1693497c8f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34489 } }
I20260809 09:25:27.452302 28044 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f90d1c989c2461bb6da5a1693497c8f, State: Initialized, Role: FOLLOWER
I20260809 09:25:27.452752 28044 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f90d1c989c2461bb6da5a1693497c8f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34489 } }
I20260809 09:25:27.452852 28044 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:25:27.452934 28044 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:25:27.453061 28044 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [term 2 FOLLOWER]: Advancing to term 3
I20260809 09:25:27.454800 28044 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f90d1c989c2461bb6da5a1693497c8f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34489 } }
I20260809 09:25:27.455094 28044 leader_election.cc:302] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f90d1c989c2461bb6da5a1693497c8f; no voters:
I20260809 09:25:27.455436 28044 leader_election.cc:288] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 09:25:27.455550 28048 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [term 3 FOLLOWER]: Leader election won for term 3
I20260809 09:25:27.455718 28048 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [term 3 LEADER]: Becoming Leader. State: Replica: 1f90d1c989c2461bb6da5a1693497c8f, State: Running, Role: LEADER
I20260809 09:25:27.455999 28048 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f90d1c989c2461bb6da5a1693497c8f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34489 } }
I20260809 09:25:27.456596 28044 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:25:27.456872 28048 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f90d1c989c2461bb6da5a1693497c8f. Latest consensus state: current_term: 3 leader_uuid: "1f90d1c989c2461bb6da5a1693497c8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f90d1c989c2461bb6da5a1693497c8f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34489 } } }
I20260809 09:25:27.457082 28048 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [sys.catalog]: This master's current role is: LEADER
I20260809 09:25:27.456857 28049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "1f90d1c989c2461bb6da5a1693497c8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f90d1c989c2461bb6da5a1693497c8f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34489 } } }
I20260809 09:25:27.457442 28049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f90d1c989c2461bb6da5a1693497c8f [sys.catalog]: This master's current role is: LEADER
I20260809 09:25:27.458184 28052 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:25:27.463127 28052 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:25:27.463935 28052 catalog_manager.cc:1259] Loaded cluster ID: 367ae9ca6c8f48ad91a1719980620f4d
I20260809 09:25:27.464005 28052 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260809 09:25:27.465071 28052 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f6af073e9ad google::LogMessage::Fail() at ??:0
@ 0x7f6af074188a google::LogMessage::SendToLog() at ??:0
@ 0x7f6af073e4de google::LogMessage::Flush() at ??:0
@ 0x7f6af073fa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f6afb081fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f6afb082d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f6afb07f579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f6afb0c3640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f6af29903d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f6af2990c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f6af29923f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f6af2981512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f6af3fc56db start_thread at ??:0
@ 0x7f6aef23c61f clone at ??:0
W20260809 09:25:27.546031 28046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:27.546296 28046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:27.546411 28046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:27.550182 28046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:27.550267 28046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:27.550357 28046 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:25:27.555459 28046 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:44125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:38623
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=32925
--tserver_master_addrs=127.11.99.254:34489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28046
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:27.556427 28046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:27.557390 28046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:25:27.566658 28087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:27.566666 28088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:27.566905 28090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:27.567286 28046 server_base.cc:1034] running on GCE node
I20260809 09:25:27.567723 28046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:27.568524 28046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:27.569725 28046 hybrid_clock.cc:648] HybridClock initialized: now 1786267527569690 us; error 45 us; skew 500 ppm
Aug 09 09:25:27 dist-test-slave-pgkr krb5kdc[26842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267527, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:27.573172 28046 init.cc:377] Logged in from keytab as kudu/127.11.99.193@KRBTEST.COM (short username kudu)
I20260809 09:25:27.574203 28046 webserver.cc:460] Webserver started at http://127.11.99.193:32925/ using document root <none> and password file <none>
I20260809 09:25:27.574898 28046 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:27.574981 28046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:25:27.579785 28046 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 09:25:27.582418 28099 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:27.583921 28046 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 09:25:27.584061 28046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "0634f0173a7346b1bc2b7f73c33002e0"
format_stamp: "Formatted at 2026-08-09 09:25:25 on dist-test-slave-pgkr"
server_key: "16b2053ae04efa8903c9496be45e9520"
server_key_iv: "18dd732187c4a9cc76bda7fa68388772"
server_key_version: "encryptionkey@0"
I20260809 09:25:27.584712 28046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:27.604667 28046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:27.608278 28046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:27.608458 28046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:27.609141 28046 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:25:27.610353 28107 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 09:25:27.614264 28046 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 09:25:27.614344 28046 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260809 09:25:27.614414 28046 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 09:25:27.616446 28046 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 09:25:27.616518 28046 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260809 09:25:27.616888 28107 tablet_bootstrap.cc:492] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0: Bootstrap starting.
I20260809 09:25:27.626681 28046 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:38623
I20260809 09:25:27.626966 28215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:38623 every 8 connection(s)
I20260809 09:25:27.627729 28046 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:25:27.636579 28107 log.cc:824] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0: Log is configured to *not* fsync() on all Append() calls
I20260809 09:25:27.637962 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 28046
I20260809 09:25:27.638450 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:37387
--local_ip_for_outbound_sockets=127.11.99.194
--tserver_master_addrs=127.11.99.254:34489
--webserver_port=43315
--webserver_interface=127.11.99.194
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:44125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 09:25:27.644202 28107 tablet_bootstrap.cc:492] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 09:25:27.644608 28107 tablet_bootstrap.cc:492] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0: Bootstrap complete.
I20260809 09:25:27.646014 28107 ts_tablet_manager.cc:1397] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0: Time spent bootstrapping tablet: real 0.029s user 0.021s sys 0.004s
I20260809 09:25:27.649880 28107 raft_consensus.cc:348] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } } peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } }
I20260809 09:25:27.650523 28107 raft_consensus.cc:729] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0634f0173a7346b1bc2b7f73c33002e0, State: Initialized, Role: FOLLOWER
I20260809 09:25:27.651093 28107 consensus_queue.cc:260] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } } peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } }
I20260809 09:25:27.652169 28107 ts_tablet_manager.cc:1428] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0: Time spent starting tablet: real 0.006s user 0.009s sys 0.000s
W20260809 09:25:27.689721 28218 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:25:27.630048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.193:44107)
0809 09:25:27.630695 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:27.630770 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:27.631977 (+ 1207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:27.688910 (+ 56933us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":151,"threads_started":1}
W20260809 09:25:27.690308 28216 heartbeater.cc:644] Failed to heartbeat to 127.11.99.254:34489 (0 consecutive failures): Network error: Failed to ping master at 127.11.99.254:34489: Client connection negotiation failed: client connection to 127.11.99.254:34489: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 09:25:27.691062 28218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:27.690813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.193:41793)
0809 09:25:27.690934 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:27.691007 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 09:25:27.691756 28218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:27.691549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.193:52873)
0809 09:25:27.691652 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:27.691700 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 09:25:27.691983 28216 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 09:25:27.754700 28222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:27.754930 28222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:27.754993 28222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:27.758813 28222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:27.758882 28222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:27.758968 28222 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:25:27.763978 28222 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:44125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:37387
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=43315
--tserver_master_addrs=127.11.99.254:34489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28222
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:27.764894 28222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:27.765774 28222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 09:25:27.774812 28222 server_base.cc:1034] running on GCE node
W20260809 09:25:27.774775 28228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:27.774776 28229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:27.774780 28231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:27.775422 28222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:27.775980 28222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:27.777163 28222 hybrid_clock.cc:648] HybridClock initialized: now 1786267527777147 us; error 29 us; skew 500 ppm
Aug 09 09:25:27 dist-test-slave-pgkr krb5kdc[26842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267527, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:27.779914 28222 init.cc:377] Logged in from keytab as kudu/127.11.99.194@KRBTEST.COM (short username kudu)
I20260809 09:25:27.780738 28222 webserver.cc:460] Webserver started at http://127.11.99.194:43315/ using document root <none> and password file <none>
I20260809 09:25:27.781221 28222 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:27.781286 28222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:25:27.784736 28222 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:25:27.786651 28238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:27.787784 28222 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:25:27.787909 28222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "f0635231a8d140628245d5ad29184f3b"
format_stamp: "Formatted at 2026-08-09 09:25:25 on dist-test-slave-pgkr"
server_key: "eaab62bd763781a653beeae54340259c"
server_key_iv: "d23e17577d2dffc24b04d007efd5f612"
server_key_version: "encryptionkey@0"
I20260809 09:25:27.788405 28222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:27.800319 28222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:27.803280 28222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:27.803463 28222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:27.803994 28222 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:25:27.804757 28222 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:25:27.804803 28222 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:27.804879 28222 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:25:27.804914 28222 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:27.814077 28222 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:37387
I20260809 09:25:27.814105 28356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:37387 every 8 connection(s)
I20260809 09:25:27.815105 28222 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:25:27.817207 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 28222
I20260809 09:25:27.817608 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:46395
--local_ip_for_outbound_sockets=127.11.99.195
--tserver_master_addrs=127.11.99.254:34489
--webserver_port=39745
--webserver_interface=127.11.99.195
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:44125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 09:25:27.819190 28359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:27.817091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.194:37399)
0809 09:25:27.817585 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:27.817719 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":146,"threads_started":1}
W20260809 09:25:27.819875 28357 heartbeater.cc:644] Failed to heartbeat to 127.11.99.254:34489 (0 consecutive failures): Network error: Failed to ping master at 127.11.99.254:34489: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
I20260809 09:25:27.820621 28359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:27.820343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.194:51159)
0809 09:25:27.820500 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:27.820558 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260809 09:25:27.821364 28359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:27.821132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.194:41909)
0809 09:25:27.821239 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:27.821283 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 09:25:27.821552 28357 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 09:25:27.926175 28360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:27.926432 28360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:27.926505 28360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:27.930411 28360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:27.930495 28360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:27.930621 28360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:25:27.935691 28360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:44125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:46395
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=39745
--tserver_master_addrs=127.11.99.254:34489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:27.936573 28360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:27.937492 28360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 09:25:27.946528 28360 server_base.cc:1034] running on GCE node
W20260809 09:25:27.946482 28365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:27.946516 28368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:27.946485 28366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:27.947149 28360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:27.947745 28360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:27.948933 28360 hybrid_clock.cc:648] HybridClock initialized: now 1786267527948912 us; error 33 us; skew 500 ppm
Aug 09 09:25:27 dist-test-slave-pgkr krb5kdc[26842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267527, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:27.951455 28360 init.cc:377] Logged in from keytab as kudu/127.11.99.195@KRBTEST.COM (short username kudu)
I20260809 09:25:27.952293 28360 webserver.cc:460] Webserver started at http://127.11.99.195:39745/ using document root <none> and password file <none>
I20260809 09:25:27.952802 28360 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:27.952888 28360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:25:27.956300 28360 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260809 09:25:27.958074 28375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:27.959134 28360 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 09:25:27.959261 28360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0"
format_stamp: "Formatted at 2026-08-09 09:25:25 on dist-test-slave-pgkr"
server_key: "d4018170ed8b4d892f8e1f5865b69bbd"
server_key_iv: "050b0293aea450142fc1f6a84565da03"
server_key_version: "encryptionkey@0"
I20260809 09:25:27.959722 28360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:27.975131 28360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:27.977468 28360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:27.977638 28360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:27.978174 28360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:25:27.978991 28360 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:25:27.979068 28360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:27.979154 28360 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:25:27.979205 28360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:27.987989 28360 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:46395
I20260809 09:25:27.988019 28492 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:46395 every 8 connection(s)
I20260809 09:25:27.988878 28360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:25:27.992681 28495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:27.990920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.195:57263)
0809 09:25:27.991398 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:27.991517 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":160,"threads_started":1}
W20260809 09:25:27.993134 28493 heartbeater.cc:644] Failed to heartbeat to 127.11.99.254:34489 (0 consecutive failures): Network error: Failed to ping master at 127.11.99.254:34489: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
I20260809 09:25:27.993708 28495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:27.993490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.195:49657)
0809 09:25:27.993605 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:27.993652 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 09:25:27.994329 28495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:27.994161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.195:54707)
0809 09:25:27.994249 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:27.994288 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 09:25:27.994553 28493 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 09:25:27.995250 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 28360
I20260809 09:25:28.693095 28498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:28.692523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.193:48837)
0809 09:25:28.692850 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:28.692967 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":86,"threads_started":1}
I20260809 09:25:28.822391 28499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:28.822003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.194:50015)
0809 09:25:28.822235 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:28.822289 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":69,"threads_started":1}
I20260809 09:25:28.898053 28500 raft_consensus.cc:482] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:25:28.898275 28500 raft_consensus.cc:504] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } } peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } }
I20260809 09:25:28.899430 28500 leader_election.cc:288] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0635231a8d140628245d5ad29184f3b (127.11.99.194:37387), c6cc71a71e7d4ad88b7abe46adb8b4b0 (127.11.99.195:46395)
Aug 09 09:25:28 dist-test-slave-pgkr krb5kdc[26842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267527, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for kudu/127.11.99.194@KRBTEST.COM
Aug 09 09:25:28 dist-test-slave-pgkr krb5kdc[26842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267527, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for kudu/127.11.99.195@KRBTEST.COM
I20260809 09:25:28.914072 28503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:28.900065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:49749 (local address 127.11.99.195:46395)
0809 09:25:28.900418 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:28.900429 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:28.900458 (+ 29us) server_negotiation.cc:407] Connection header received
0809 09:25:28.901163 (+ 705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:28.901171 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:28.901617 (+ 446us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:28.901970 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:28.903648 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:28.905036 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:28.905920 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:28.906374 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:28.906544 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:28.909649 (+ 3105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:28.909653 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:28.909663 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:28.909688 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:28.911409 (+ 1721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:28.911941 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:28.911946 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:28.912010 (+ 64us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:28.912138 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:28.912622 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:28.912627 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:28.912629 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:28.912983 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:28.913152 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:28.913647 (+ 495us) server_negotiation.cc:299] Negotiation successful
0809 09:25:28.913894 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":61,"threads_started":1}
I20260809 09:25:28.914058 28501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:28.899867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:46395 (local address 127.11.99.193:49749)
0809 09:25:28.900171 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:28.900182 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:28.900263 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:28.902052 (+ 1789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:28.902057 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:28.903425 (+ 1368us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:28.903503 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:28.903508 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:28.905163 (+ 1655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:28.905167 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:28.905801 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:28.905810 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:28.906499 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:28.906503 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:28.906754 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:28.907495 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:28.907522 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:28.909470 (+ 1948us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:28.911527 (+ 2057us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:28.911532 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:28.911534 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:28.911810 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:28.912286 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:28.912291 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:28.912293 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:28.912480 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:28.913124 (+ 644us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:28.913133 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:28.913360 (+ 227us) client_negotiation.cc:769] Sending connection context
0809 09:25:28.913548 (+ 188us) client_negotiation.cc:240] Negotiation successful
0809 09:25:28.913889 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"mutex_wait_us":114,"spinlock_wait_cycles":43648,"thread_start_us":60,"threads_started":1}
I20260809 09:25:28.914168 28502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:28.899788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:44793 (local address 127.11.99.194:37387)
0809 09:25:28.900186 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:28.900214 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:28.900260 (+ 46us) server_negotiation.cc:407] Connection header received
0809 09:25:28.901163 (+ 903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:28.901171 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:28.901617 (+ 446us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:28.902388 (+ 771us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:28.903331 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:28.904809 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:28.905935 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:28.906376 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:28.906544 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:28.909373 (+ 2829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:28.909378 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:28.909388 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:28.909414 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:28.911289 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:28.911951 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:28.911960 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:28.911964 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:28.912097 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:28.912579 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:28.912584 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:28.912591 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:28.912968 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:28.913135 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:28.913673 (+ 538us) server_negotiation.cc:299] Negotiation successful
0809 09:25:28.913961 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":147,"threads_started":1}
I20260809 09:25:28.915009 28498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:28.899592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:37387 (local address 127.11.99.193:44793)
0809 09:25:28.899747 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:28.899764 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:28.899916 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:28.902048 (+ 2132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:28.902053 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:28.902725 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:28.903159 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:28.903176 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:28.904936 (+ 1760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:28.904938 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:28.905806 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:28.905815 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:28.906496 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:28.906499 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:28.906780 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:28.907495 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:28.907522 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:28.909124 (+ 1602us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:28.911416 (+ 2292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:28.911422 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:28.911435 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:28.911768 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:28.912261 (+ 493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:28.912265 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:28.912267 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:28.912440 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:28.913121 (+ 681us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:28.913127 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:28.913367 (+ 240us) client_negotiation.cc:769] Sending connection context
0809 09:25:28.913549 (+ 182us) client_negotiation.cc:240] Negotiation successful
0809 09:25:28.913975 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":310,"spinlock_wait_cycles":27776}
W20260809 09:25:28.916767 28100 leader_election.cc:341] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c6cc71a71e7d4ad88b7abe46adb8b4b0 (127.11.99.195:46395): Not found: Tablet not found: ef65ef39840a43869fd00783cc64095d
W20260809 09:25:28.917013 28100 leader_election.cc:341] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f0635231a8d140628245d5ad29184f3b (127.11.99.194:37387): Not found: Tablet not found: ef65ef39840a43869fd00783cc64095d
I20260809 09:25:28.917078 28100 leader_election.cc:302] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0634f0173a7346b1bc2b7f73c33002e0; no voters: c6cc71a71e7d4ad88b7abe46adb8b4b0, f0635231a8d140628245d5ad29184f3b
I20260809 09:25:28.917291 28500 raft_consensus.cc:2726] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 09:25:28.995420 28504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:28.995028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.195:57873)
0809 09:25:28.995289 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:28.995336 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":99,"threads_started":1}
I20260809 09:25:29.694295 28505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:29.693906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.193:37235)
0809 09:25:29.694154 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:29.694205 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":89,"threads_started":1}
I20260809 09:25:29.823483 28506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:29.823111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.194:41965)
0809 09:25:29.823353 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:29.823404 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":90,"threads_started":1}
I20260809 09:25:29.996459 28507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:29.996096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.195:60555)
0809 09:25:29.996316 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:29.996366 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":69,"threads_started":1}
I20260809 09:25:30.695372 28508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:30.694997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.193:38983)
0809 09:25:30.695231 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:30.695281 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":76,"threads_started":1}
I20260809 09:25:30.824508 28509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:30.824139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.194:33403)
0809 09:25:30.824380 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:30.824428 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":94,"threads_started":1}
I20260809 09:25:30.853648 28510 raft_consensus.cc:482] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:25:30.853768 28510 raft_consensus.cc:504] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } } peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } }
I20260809 09:25:30.854168 28510 leader_election.cc:288] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0635231a8d140628245d5ad29184f3b (127.11.99.194:37387), c6cc71a71e7d4ad88b7abe46adb8b4b0 (127.11.99.195:46395)
W20260809 09:25:30.855044 28100 leader_election.cc:341] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f0635231a8d140628245d5ad29184f3b (127.11.99.194:37387): Not found: Tablet not found: ef65ef39840a43869fd00783cc64095d
W20260809 09:25:30.855230 28100 leader_election.cc:341] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c6cc71a71e7d4ad88b7abe46adb8b4b0 (127.11.99.195:46395): Not found: Tablet not found: ef65ef39840a43869fd00783cc64095d
I20260809 09:25:30.855353 28100 leader_election.cc:302] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0634f0173a7346b1bc2b7f73c33002e0; no voters: c6cc71a71e7d4ad88b7abe46adb8b4b0, f0635231a8d140628245d5ad29184f3b
I20260809 09:25:30.855553 28510 raft_consensus.cc:2726] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 09:25:30.997565 28511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:30.997212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.195:36785)
0809 09:25:30.997437 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:30.997485 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":83,"threads_started":1}
I20260809 09:25:31.696429 28512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:31.696059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.193:35109)
0809 09:25:31.696292 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:31.696340 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":74,"threads_started":1}
I20260809 09:25:31.825531 28513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:31.825157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.194:54861)
0809 09:25:31.825399 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:31.825449 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":80,"threads_started":1}
I20260809 09:25:31.998812 28514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:31.998227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.195:39545)
0809 09:25:31.998597 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:31.998724 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":86,"threads_started":1}
I20260809 09:25:32.697700 28515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:32.697266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.193:55173)
0809 09:25:32.697556 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:32.697607 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":80,"threads_started":1}
I20260809 09:25:32.826661 28516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:32.826262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.194:53535)
0809 09:25:32.826476 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:32.826528 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":69,"threads_started":1}
I20260809 09:25:32.999891 28517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:32.999509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.195:58371)
0809 09:25:32.999755 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:32.999816 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":71,"threads_started":1}
I20260809 09:25:33.698930 28518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:33.698401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.193:43247)
0809 09:25:33.698784 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:33.698838 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":78,"threads_started":1}
I20260809 09:25:33.781375 28519 raft_consensus.cc:482] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:25:33.781525 28519 raft_consensus.cc:504] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } } peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } }
I20260809 09:25:33.781910 28519 leader_election.cc:288] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0635231a8d140628245d5ad29184f3b (127.11.99.194:37387), c6cc71a71e7d4ad88b7abe46adb8b4b0 (127.11.99.195:46395)
W20260809 09:25:33.782661 28100 leader_election.cc:341] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f0635231a8d140628245d5ad29184f3b (127.11.99.194:37387): Not found: Tablet not found: ef65ef39840a43869fd00783cc64095d
W20260809 09:25:33.782820 28100 leader_election.cc:341] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c6cc71a71e7d4ad88b7abe46adb8b4b0 (127.11.99.195:46395): Not found: Tablet not found: ef65ef39840a43869fd00783cc64095d
I20260809 09:25:33.782888 28100 leader_election.cc:302] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0634f0173a7346b1bc2b7f73c33002e0; no voters: c6cc71a71e7d4ad88b7abe46adb8b4b0, f0635231a8d140628245d5ad29184f3b
I20260809 09:25:33.783043 28519 raft_consensus.cc:2726] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 09:25:33.827714 28520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:33.827341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.194:43339)
0809 09:25:33.827580 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:33.827631 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":88,"threads_started":1}
I20260809 09:25:34.001032 28521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:34.000631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.195:59429)
0809 09:25:34.000873 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:34.000923 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":90,"threads_started":1}
I20260809 09:25:34.700094 28522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:34.699658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.193:39997)
0809 09:25:34.699924 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:34.699977 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":73,"threads_started":1}
I20260809 09:25:34.828958 28523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:34.828537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.194:35061)
0809 09:25:34.828820 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:34.828872 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":72,"threads_started":1}
I20260809 09:25:35.002279 28524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:35.001837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.195:33799)
0809 09:25:35.002128 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:35.002186 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":71,"threads_started":1}
I20260809 09:25:35.701371 28525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:35.700957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.193:41379)
0809 09:25:35.701218 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:35.701278 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":73,"threads_started":1}
I20260809 09:25:35.830315 28526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:35.829941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.194:37923)
0809 09:25:35.830179 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:35.830230 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":72,"threads_started":1}
I20260809 09:25:36.003319 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:36.002963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.195:55955)
0809 09:25:36.003191 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:36.003239 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":82,"threads_started":1}
I20260809 09:25:36.702441 28528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:36.702069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.193:57011)
0809 09:25:36.702303 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:36.702351 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":71,"threads_started":1}
I20260809 09:25:36.831519 28529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:36.831134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.194:59991)
0809 09:25:36.831366 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:36.831432 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":73,"threads_started":1}
I20260809 09:25:37.004311 28531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:37.003965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.195:60515)
0809 09:25:37.004181 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:37.004231 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":68,"threads_started":1}
I20260809 09:25:37.703642 28532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:37.703213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.193:51031)
0809 09:25:37.703489 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:37.703550 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":85,"threads_started":1}
I20260809 09:25:37.832818 28533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:37.832257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.194:56221)
0809 09:25:37.832595 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:37.832670 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":91,"threads_started":1}
I20260809 09:25:38.005359 28534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:38.004995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.195:53631)
0809 09:25:38.005231 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:38.005277 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":90,"threads_started":1}
I20260809 09:25:38.164322 28535 raft_consensus.cc:482] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:25:38.164445 28535 raft_consensus.cc:504] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0635231a8d140628245d5ad29184f3b" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37387 } } peers { permanent_uuid: "c6cc71a71e7d4ad88b7abe46adb8b4b0" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 46395 } } peers { permanent_uuid: "0634f0173a7346b1bc2b7f73c33002e0" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38623 } }
I20260809 09:25:38.164923 28535 leader_election.cc:288] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0635231a8d140628245d5ad29184f3b (127.11.99.194:37387), c6cc71a71e7d4ad88b7abe46adb8b4b0 (127.11.99.195:46395)
W20260809 09:25:38.165637 28100 leader_election.cc:341] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c6cc71a71e7d4ad88b7abe46adb8b4b0 (127.11.99.195:46395): Not found: Tablet not found: ef65ef39840a43869fd00783cc64095d
W20260809 09:25:38.165752 28100 leader_election.cc:341] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f0635231a8d140628245d5ad29184f3b (127.11.99.194:37387): Not found: Tablet not found: ef65ef39840a43869fd00783cc64095d
I20260809 09:25:38.165783 28100 leader_election.cc:302] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0634f0173a7346b1bc2b7f73c33002e0; no voters: c6cc71a71e7d4ad88b7abe46adb8b4b0, f0635231a8d140628245d5ad29184f3b
I20260809 09:25:38.165908 28535 raft_consensus.cc:2726] T ef65ef39840a43869fd00783cc64095d P 0634f0173a7346b1bc2b7f73c33002e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 09:25:38.704713 28536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:38.704320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.193:42775)
0809 09:25:38.704569 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:38.704622 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":70,"threads_started":1}
I20260809 09:25:38.834128 28537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:38.833579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.194:60825)
0809 09:25:38.833915 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:38.833997 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":96,"threads_started":1}
I20260809 09:25:39.006443 28538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:39.006039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.195:56885)
0809 09:25:39.006302 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:39.006355 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":70,"threads_started":1}
I20260809 09:25:39.705895 28539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:39.705497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.193:41739)
0809 09:25:39.705752 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:39.705802 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":94,"threads_started":1}
I20260809 09:25:39.835348 28540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:39.834969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.194:46541)
0809 09:25:39.835199 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:39.835262 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":71,"threads_started":1}
I20260809 09:25:40.007555 28541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:40.007160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.195:44975)
0809 09:25:40.007414 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:40.007465 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":102,"threads_started":1}
I20260809 09:25:40.706991 28542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:40.706568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.193:49319)
0809 09:25:40.706852 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:40.706900 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":128,"threads_started":1}
I20260809 09:25:40.836380 28543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:40.836026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.194:58857)
0809 09:25:40.836247 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:40.836294 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":73,"threads_started":1}
I20260809 09:25:41.008882 28544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:41.008426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.195:59373)
0809 09:25:41.008724 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:41.008795 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":102,"threads_started":1}
I20260809 09:25:41.708331 28545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:41.707805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.193:47371)
0809 09:25:41.708166 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:41.708223 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":73,"threads_started":1}
I20260809 09:25:41.837544 28546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:41.837154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.194:50185)
0809 09:25:41.837411 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:41.837462 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":80,"threads_started":1}
I20260809 09:25:42.010053 28548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:42.009640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.195:41575)
0809 09:25:42.009914 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:42.009967 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":105,"threads_started":1}
I20260809 09:25:42.709771 28549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:42.709342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.193:53713)
0809 09:25:42.709600 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:42.709651 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":73,"threads_started":1}
I20260809 09:25:42.839035 28550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:42.838563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.194:55907)
0809 09:25:42.838877 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:42.838930 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":138,"threads_started":1}
I20260809 09:25:43.004668 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 28046
I20260809 09:25:43.011416 28552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:43.011021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34489 (local address 127.11.99.195:51941)
0809 09:25:43.011268 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:43.011322 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34489: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":91,"threads_started":1}
I20260809 09:25:43.013352 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 28222
I20260809 09:25:43.021483 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 28360
2026-08-09T09:25:43Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19144 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:25:43 dist-test-slave-pgkr krb5kdc[28555](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:25:43 dist-test-slave-pgkr krb5kdc[28555](info): set up 2 sockets
Aug 09 09:25:43 dist-test-slave-pgkr krb5kdc[28555](info): commencing operation
krb5kdc: starting...
W20260809 09:25:44.068223 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.022s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:25:44 dist-test-slave-pgkr krb5kdc[28555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267544, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:25:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:25:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:25:44.184919 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:34617
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:36061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:34617
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:25:44.292462 28569 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:44.292695 28569 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:44.292732 28569 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:44.296530 28569 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 09:25:44.296566 28569 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 09:25:44.296581 28569 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 09:25:44.296594 28569 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:25:44.296610 28569 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:44.296628 28569 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:44.296643 28569 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:25:44.296657 28569 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:25:44.301182 28569 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:36061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:34617
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:34617
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28569
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:44.302026 28569 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:44.302930 28569 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 09:25:44.311123 28569 server_base.cc:1034] running on GCE node
W20260809 09:25:44.311038 28575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:44.311028 28577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:44.311028 28574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:44.311812 28569 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:44.312873 28569 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:44.314057 28569 hybrid_clock.cc:648] HybridClock initialized: now 1786267544314042 us; error 29 us; skew 500 ppm
Aug 09 09:25:44 dist-test-slave-pgkr krb5kdc[28555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267544, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:44.316730 28569 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:25:44.317489 28569 webserver.cc:460] Webserver started at http://127.11.99.254:43685/ using document root <none> and password file <none>
I20260809 09:25:44.318008 28569 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:44.318064 28569 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:25:44.318213 28569 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:25:44.320118 28569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "34ea624d5232413682c17a67ecfe52dc"
format_stamp: "Formatted at 2026-08-09 09:25:44 on dist-test-slave-pgkr"
server_key: "1b37c003e3899c69af43b1c8d016e199"
server_key_iv: "6f615591a07f03e9b86b99eb98adaf45"
server_key_version: "encryptionkey@0"
I20260809 09:25:44.320613 28569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "34ea624d5232413682c17a67ecfe52dc"
format_stamp: "Formatted at 2026-08-09 09:25:44 on dist-test-slave-pgkr"
server_key: "1b37c003e3899c69af43b1c8d016e199"
server_key_iv: "6f615591a07f03e9b86b99eb98adaf45"
server_key_version: "encryptionkey@0"
I20260809 09:25:44.323953 28569 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 09:25:44.326231 28584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:44.327441 28569 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:25:44.327564 28569 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "34ea624d5232413682c17a67ecfe52dc"
format_stamp: "Formatted at 2026-08-09 09:25:44 on dist-test-slave-pgkr"
server_key: "1b37c003e3899c69af43b1c8d016e199"
server_key_iv: "6f615591a07f03e9b86b99eb98adaf45"
server_key_version: "encryptionkey@0"
I20260809 09:25:44.327664 28569 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:44.349812 28569 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:44.352398 28569 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:44.352614 28569 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:44.359541 28569 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:34617
I20260809 09:25:44.359850 28638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:34617 every 8 connection(s)
I20260809 09:25:44.360455 28569 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:25:44.360867 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 28569
I20260809 09:25:44.360999 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:25:44.361253 11663 external_mini_cluster.cc:1428] Setting key 311dea29c9a3b64385699be2fa3ccbb3
I20260809 09:25:44.363418 28640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:25:44.368634 28640 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc: Bootstrap starting.
Aug 09 09:25:44 dist-test-slave-pgkr krb5kdc[28555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267544, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:25:44.370771 28640 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc: Neither blocks nor log segments found. Creating new log.
I20260809 09:25:44.371582 28640 log.cc:824] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc: Log is configured to *not* fsync() on all Append() calls
I20260809 09:25:44.373615 28640 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc: No bootstrap required, opened a new log
I20260809 09:25:44.374779 28643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:44.362696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33904 (local address 127.11.99.254:34617)
0809 09:25:44.363129 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:44.363143 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:44.363176 (+ 33us) server_negotiation.cc:407] Connection header received
0809 09:25:44.363829 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:44.363844 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:44.364122 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:44.364413 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:44.365227 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:44.366195 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:44.367109 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:44.367529 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:44.367681 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:44.370153 (+ 2472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:44.370157 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:44.370168 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:44.370193 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:44.371958 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:44.372535 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:44.372540 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:44.372544 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:44.372650 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:44.372947 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:44.372950 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:44.372951 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:44.373297 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:44.373438 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:44.373792 (+ 354us) server_negotiation.cc:299] Negotiation successful
0809 09:25:44.374090 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":140,"threads_started":1}
I20260809 09:25:44.376677 28640 raft_consensus.cc:348] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34ea624d5232413682c17a67ecfe52dc" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34617 } }
I20260809 09:25:44.376924 28640 raft_consensus.cc:374] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:25:44.377041 28640 raft_consensus.cc:729] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34ea624d5232413682c17a67ecfe52dc, State: Initialized, Role: FOLLOWER
I20260809 09:25:44.377413 28640 consensus_queue.cc:260] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34ea624d5232413682c17a67ecfe52dc" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34617 } }
I20260809 09:25:44.377525 28640 raft_consensus.cc:388] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:25:44.377580 28640 raft_consensus.cc:482] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:25:44.377645 28640 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:25:44.378393 28640 raft_consensus.cc:504] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34ea624d5232413682c17a67ecfe52dc" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34617 } }
I20260809 09:25:44.378721 28640 leader_election.cc:302] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 34ea624d5232413682c17a67ecfe52dc; no voters:
I20260809 09:25:44.378960 28640 leader_election.cc:288] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:25:44.379091 28645 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:25:44.379383 28645 raft_consensus.cc:686] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [term 1 LEADER]: Becoming Leader. State: Replica: 34ea624d5232413682c17a67ecfe52dc, State: Running, Role: LEADER
I20260809 09:25:44.379691 28645 consensus_queue.cc:237] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34ea624d5232413682c17a67ecfe52dc" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34617 } }
I20260809 09:25:44.380043 28640 sys_catalog.cc:564] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:25:44.381184 28646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "34ea624d5232413682c17a67ecfe52dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34ea624d5232413682c17a67ecfe52dc" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34617 } } }
I20260809 09:25:44.381351 28646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [sys.catalog]: This master's current role is: LEADER
I20260809 09:25:44.381764 28647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 34ea624d5232413682c17a67ecfe52dc. Latest consensus state: current_term: 1 leader_uuid: "34ea624d5232413682c17a67ecfe52dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34ea624d5232413682c17a67ecfe52dc" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34617 } } }
I20260809 09:25:44.381870 28647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [sys.catalog]: This master's current role is: LEADER
I20260809 09:25:44.382154 28655 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:25:44.384862 28655 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:25:44.389566 28655 catalog_manager.cc:1347] Generated new cluster ID: a776969024d44649bb2508bf4c2bdf61
I20260809 09:25:44.389626 28655 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:25:44.405004 28655 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:25:44.406136 28655 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:25:44.411712 28655 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc: Generated new TSK 0
I20260809 09:25:44.412392 28655 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.99.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
I20260809 09:25:44.446972 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:0
--local_ip_for_outbound_sockets=127.11.99.193
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34617
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:36061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:25:44.557624 28667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:44.557891 28667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:44.557976 28667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:44.561990 28667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:44.562077 28667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:44.562191 28667 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:25:44.567361 28667 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:36061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28667
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:44.568353 28667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:44.569334 28667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:25:44.578476 28673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:44.578495 28672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:44.578480 28675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:44.578758 28667 server_base.cc:1034] running on GCE node
I20260809 09:25:44.579218 28667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:44.579901 28667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:44.581081 28667 hybrid_clock.cc:648] HybridClock initialized: now 1786267544581068 us; error 22 us; skew 500 ppm
Aug 09 09:25:44 dist-test-slave-pgkr krb5kdc[28555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267544, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:44.583879 28667 init.cc:377] Logged in from keytab as kudu/127.11.99.193@KRBTEST.COM (short username kudu)
I20260809 09:25:44.584720 28667 webserver.cc:460] Webserver started at http://127.11.99.193:44101/ using document root <none> and password file <none>
I20260809 09:25:44.585266 28667 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:44.585368 28667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:25:44.585597 28667 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:25:44.587849 28667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/data/instance:
uuid: "42e19074b9cf4a8f8a37a80ef0657455"
format_stamp: "Formatted at 2026-08-09 09:25:44 on dist-test-slave-pgkr"
server_key: "ba0de19193944a058c37dbbf077ee39b"
server_key_iv: "be8d10956e6e6d832454273c7b0a31bf"
server_key_version: "encryptionkey@0"
I20260809 09:25:44.588406 28667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance:
uuid: "42e19074b9cf4a8f8a37a80ef0657455"
format_stamp: "Formatted at 2026-08-09 09:25:44 on dist-test-slave-pgkr"
server_key: "ba0de19193944a058c37dbbf077ee39b"
server_key_iv: "be8d10956e6e6d832454273c7b0a31bf"
server_key_version: "encryptionkey@0"
I20260809 09:25:44.591899 28667 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 09:25:44.594177 28682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:44.595377 28667 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:25:44.595511 28667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "42e19074b9cf4a8f8a37a80ef0657455"
format_stamp: "Formatted at 2026-08-09 09:25:44 on dist-test-slave-pgkr"
server_key: "ba0de19193944a058c37dbbf077ee39b"
server_key_iv: "be8d10956e6e6d832454273c7b0a31bf"
server_key_version: "encryptionkey@0"
I20260809 09:25:44.595623 28667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:44.610093 28667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:44.612906 28667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:44.613107 28667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:44.613662 28667 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:25:44.614450 28667 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:25:44.614522 28667 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:44.614595 28667 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:25:44.614696 28667 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:44.623739 28667 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:46799
I20260809 09:25:44.623781 28802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:46799 every 8 connection(s)
I20260809 09:25:44.624537 28667 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:25:44.632954 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 28667
I20260809 09:25:44.633082 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance
I20260809 09:25:44.633373 11663 external_mini_cluster.cc:1428] Setting key 9027cbbbb9be602fa61df1952d54c9b1
Aug 09 09:25:44 dist-test-slave-pgkr krb5kdc[28555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267544, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:25:44.638343 28643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:44.626227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:55517 (local address 127.11.99.254:34617)
0809 09:25:44.626374 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:44.626379 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:44.627416 (+ 1037us) server_negotiation.cc:407] Connection header received
0809 09:25:44.628304 (+ 888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:44.628308 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:44.628370 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:44.628460 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:44.629569 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:44.630120 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:44.631436 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:44.631689 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:44.631816 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:44.634416 (+ 2600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:44.634420 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:44.634438 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:44.634471 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:44.636252 (+ 1781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:44.636793 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:44.636798 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:44.636800 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:44.636894 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:44.637255 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:44.637260 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:44.637263 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:44.637451 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:44.637567 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:44.638039 (+ 472us) server_negotiation.cc:299] Negotiation successful
0809 09:25:44.638167 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 09:25:44.639195 28805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:44.626557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.193:55517)
0809 09:25:44.627269 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:44.627309 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:44.628092 (+ 783us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:44.628634 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:44.628641 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:44.628979 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:44.629408 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:44.629421 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:44.630257 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:44.630262 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:44.631302 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:44.631312 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:44.631861 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:44.631865 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:44.632080 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:44.632697 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:44.632714 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:44.634240 (+ 1526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:44.636373 (+ 2133us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:44.636379 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:44.636391 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:44.636680 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:44.636998 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:44.637001 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:44.637003 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:44.637151 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:44.637566 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:44.637572 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:44.637798 (+ 226us) client_negotiation.cc:769] Sending connection context
0809 09:25:44.637984 (+ 186us) client_negotiation.cc:240] Negotiation successful
0809 09:25:44.638276 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":119,"threads_started":1}
I20260809 09:25:44.640422 28803 heartbeater.cc:347] Connected to a master server at 127.11.99.254:34617
I20260809 09:25:44.640673 28803 heartbeater.cc:464] Registering TS with master...
I20260809 09:25:44.641170 28803 heartbeater.cc:511] Master 127.11.99.254:34617 requested a full tablet report, sending...
I20260809 09:25:44.642799 28601 ts_manager.cc:194] Registered new tserver with Master: 42e19074b9cf4a8f8a37a80ef0657455 (127.11.99.193:46799)
WARNING: no policy specified for kudu/127.11.99.194@KRBTEST.COM; defaulting to no policy
I20260809 09:25:44.644160 28601 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.193@KRBTEST.COM'} at 127.11.99.193:55517
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
I20260809 09:25:44.659238 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:0
--local_ip_for_outbound_sockets=127.11.99.194
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34617
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:36061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:25:44.767469 28808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:44.767710 28808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:44.767752 28808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:44.771554 28808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:44.771605 28808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:44.771663 28808 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:25:44.776525 28808 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:36061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28808
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:44.777357 28808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:44.778209 28808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:25:44.787653 28816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:44.787668 28814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:44.787631 28813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:44.787648 28808 server_base.cc:1034] running on GCE node
I20260809 09:25:44.788182 28808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:44.788791 28808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:44.789975 28808 hybrid_clock.cc:648] HybridClock initialized: now 1786267544789955 us; error 31 us; skew 500 ppm
Aug 09 09:25:44 dist-test-slave-pgkr krb5kdc[28555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267544, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:44.792583 28808 init.cc:377] Logged in from keytab as kudu/127.11.99.194@KRBTEST.COM (short username kudu)
I20260809 09:25:44.793396 28808 webserver.cc:460] Webserver started at http://127.11.99.194:35481/ using document root <none> and password file <none>
I20260809 09:25:44.793912 28808 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:44.794000 28808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:25:44.794222 28808 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:25:44.796208 28808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/data/instance:
uuid: "dc7687ff7b64478eac60bbc4b1602703"
format_stamp: "Formatted at 2026-08-09 09:25:44 on dist-test-slave-pgkr"
server_key: "2672fdf36f15e52de1e391fe751312dd"
server_key_iv: "db107370dd0e50143a92297ba2f87952"
server_key_version: "encryptionkey@0"
I20260809 09:25:44.796772 28808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance:
uuid: "dc7687ff7b64478eac60bbc4b1602703"
format_stamp: "Formatted at 2026-08-09 09:25:44 on dist-test-slave-pgkr"
server_key: "2672fdf36f15e52de1e391fe751312dd"
server_key_iv: "db107370dd0e50143a92297ba2f87952"
server_key_version: "encryptionkey@0"
I20260809 09:25:44.800359 28808 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 09:25:44.802490 28823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:44.803673 28808 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:25:44.803812 28808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "dc7687ff7b64478eac60bbc4b1602703"
format_stamp: "Formatted at 2026-08-09 09:25:44 on dist-test-slave-pgkr"
server_key: "2672fdf36f15e52de1e391fe751312dd"
server_key_iv: "db107370dd0e50143a92297ba2f87952"
server_key_version: "encryptionkey@0"
I20260809 09:25:44.803920 28808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:44.828503 28808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:44.831636 28808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:44.831830 28808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:44.832458 28808 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:25:44.833247 28808 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:25:44.833300 28808 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:44.833366 28808 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:25:44.833402 28808 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:44.842370 28808 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:41953
I20260809 09:25:44.842399 28940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:41953 every 8 connection(s)
I20260809 09:25:44.843242 28808 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:25:44.845021 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 28808
I20260809 09:25:44.845162 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance
I20260809 09:25:44.845496 11663 external_mini_cluster.cc:1428] Setting key 0c58d7d9453fcf07cbc9bbd45f3938f7
Aug 09 09:25:44 dist-test-slave-pgkr krb5kdc[28555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267544, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.99.195@KRBTEST.COM; defaulting to no policy
I20260809 09:25:44.857678 28643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:44.844830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:52793 (local address 127.11.99.254:34617)
0809 09:25:44.844985 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:44.844990 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:44.846073 (+ 1083us) server_negotiation.cc:407] Connection header received
0809 09:25:44.847162 (+ 1089us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:44.847165 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:44.847216 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:44.847305 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:44.848381 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:44.849153 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:44.850875 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:44.851246 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:44.851363 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:44.854040 (+ 2677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:44.854042 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:44.854044 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:44.854067 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:44.855566 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:44.856160 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:44.856162 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:44.856163 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:44.856239 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:44.856625 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:44.856627 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:44.856628 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:44.856813 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:44.856928 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:44.857434 (+ 506us) server_negotiation.cc:299] Negotiation successful
0809 09:25:44.857532 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 09:25:44.858364 28944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:44.845207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.194:52793)
0809 09:25:44.845932 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:44.845981 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:44.846975 (+ 994us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:44.847446 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:44.847452 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:44.847785 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:44.848207 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:44.848218 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:44.849300 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:44.849306 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:44.850747 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:44.850758 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:44.851380 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:44.851383 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:44.851504 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:44.852020 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:44.852034 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:44.853874 (+ 1840us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:44.855688 (+ 1814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:44.855698 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:44.855713 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:44.856064 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:44.856332 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:44.856337 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:44.856339 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:44.856521 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:44.856948 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:44.856953 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:44.857235 (+ 282us) client_negotiation.cc:769] Sending connection context
0809 09:25:44.857379 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 09:25:44.857598 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":150,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.195@KRBTEST.COM" created.
I20260809 09:25:44.859584 28941 heartbeater.cc:347] Connected to a master server at 127.11.99.254:34617
I20260809 09:25:44.859812 28941 heartbeater.cc:464] Registering TS with master...
I20260809 09:25:44.860347 28941 heartbeater.cc:511] Master 127.11.99.254:34617 requested a full tablet report, sending...
I20260809 09:25:44.861449 28601 ts_manager.cc:194] Registered new tserver with Master: dc7687ff7b64478eac60bbc4b1602703 (127.11.99.194:41953)
I20260809 09:25:44.862269 28601 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.194@KRBTEST.COM'} at 127.11.99.194:52793
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
I20260809 09:25:44.875314 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:0
--local_ip_for_outbound_sockets=127.11.99.195
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34617
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:36061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:25:44.984102 28948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:25:44.984375 28948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:25:44.984443 28948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:25:44.988147 28948 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:25:44.988224 28948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:25:44.988322 28948 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:25:44.993057 28948 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:36061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:34617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28948
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:25:44.993971 28948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:25:44.994935 28948 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:25:45.004215 28954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:45.004253 28956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:25:45.004176 28953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:25:45.004508 28948 server_base.cc:1034] running on GCE node
I20260809 09:25:45.004928 28948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:25:45.005506 28948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:25:45.006688 28948 hybrid_clock.cc:648] HybridClock initialized: now 1786267545006666 us; error 32 us; skew 500 ppm
Aug 09 09:25:45 dist-test-slave-pgkr krb5kdc[28555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267545, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:25:45.009387 28948 init.cc:377] Logged in from keytab as kudu/127.11.99.195@KRBTEST.COM (short username kudu)
I20260809 09:25:45.010289 28948 webserver.cc:460] Webserver started at http://127.11.99.195:34373/ using document root <none> and password file <none>
I20260809 09:25:45.010897 28948 fs_manager.cc:359] Metadata directory not provided
I20260809 09:25:45.010990 28948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:25:45.011220 28948 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:25:45.013211 28948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/data/instance:
uuid: "f625dea395cb46479ace142069d562c3"
format_stamp: "Formatted at 2026-08-09 09:25:45 on dist-test-slave-pgkr"
server_key: "368d76247e84254869250db2d263f675"
server_key_iv: "c886b3adddf5c6e5ce851678090c37b5"
server_key_version: "encryptionkey@0"
I20260809 09:25:45.013797 28948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance:
uuid: "f625dea395cb46479ace142069d562c3"
format_stamp: "Formatted at 2026-08-09 09:25:45 on dist-test-slave-pgkr"
server_key: "368d76247e84254869250db2d263f675"
server_key_iv: "c886b3adddf5c6e5ce851678090c37b5"
server_key_version: "encryptionkey@0"
I20260809 09:25:45.017386 28948 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 09:25:45.019677 28963 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:45.020781 28948 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 09:25:45.020910 28948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "f625dea395cb46479ace142069d562c3"
format_stamp: "Formatted at 2026-08-09 09:25:45 on dist-test-slave-pgkr"
server_key: "368d76247e84254869250db2d263f675"
server_key_iv: "c886b3adddf5c6e5ce851678090c37b5"
server_key_version: "encryptionkey@0"
I20260809 09:25:45.021015 28948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:25:45.044826 28948 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:25:45.047719 28948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:25:45.047931 28948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:25:45.048502 28948 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:25:45.049299 28948 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:25:45.049366 28948 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:45.049430 28948 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:25:45.049477 28948 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:25:45.058315 28948 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:37347
I20260809 09:25:45.058360 29080 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:37347 every 8 connection(s)
I20260809 09:25:45.059186 28948 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:25:45.061023 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 28948
I20260809 09:25:45.061141 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance
I20260809 09:25:45.061465 11663 external_mini_cluster.cc:1428] Setting key 1ca75c0e54ae0f62430f2798f849dc5f
Aug 09 09:25:45 dist-test-slave-pgkr krb5kdc[28555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267545, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:25:45.071945 28643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:45.060866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:37473 (local address 127.11.99.254:34617)
0809 09:25:45.060998 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:45.061002 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:45.062194 (+ 1192us) server_negotiation.cc:407] Connection header received
0809 09:25:45.063169 (+ 975us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:45.063172 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:45.063221 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:45.063287 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:45.064301 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.064847 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.065924 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.066193 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.066305 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:45.068696 (+ 2391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:45.068699 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:45.068702 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:45.068734 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:45.069967 (+ 1233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:45.070446 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:45.070451 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:45.070453 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:45.070533 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:45.070905 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:45.070910 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:45.070912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:45.071100 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:45.071218 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:45.071668 (+ 450us) server_negotiation.cc:299] Negotiation successful
0809 09:25:45.071783 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 09:25:45.072659 29083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:45.061288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.195:37473)
0809 09:25:45.062067 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:45.062105 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:45.063000 (+ 895us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:45.063425 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:45.063435 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:45.063763 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:25:45.064173 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:45.064185 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.064970 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.064973 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:45.065764 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:45.065773 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.066341 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.066345 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:45.066520 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:45.067148 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:25:45.067163 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:25:45.068544 (+ 1381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:25:45.070087 (+ 1543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:45.070092 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:45.070104 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:45.070344 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:45.070644 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:25:45.070647 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:25:45.070649 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:25:45.070789 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:25:45.071216 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:25:45.071222 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:25:45.071435 (+ 213us) client_negotiation.cc:769] Sending connection context
0809 09:25:45.071611 (+ 176us) client_negotiation.cc:240] Negotiation successful
0809 09:25:45.071895 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":148,"threads_started":1}
I20260809 09:25:45.073729 29081 heartbeater.cc:347] Connected to a master server at 127.11.99.254:34617
I20260809 09:25:45.073961 29081 heartbeater.cc:464] Registering TS with master...
I20260809 09:25:45.074451 29081 heartbeater.cc:511] Master 127.11.99.254:34617 requested a full tablet report, sending...
I20260809 09:25:45.075453 28601 ts_manager.cc:194] Registered new tserver with Master: f625dea395cb46479ace142069d562c3 (127.11.99.195:37347)
I20260809 09:25:45.075999 28601 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.195@KRBTEST.COM'} at 127.11.99.195:37473
I20260809 09:25:45.086577 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 09:25:45.095480 28643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:45.088584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33914 (local address 127.11.99.254:34617)
0809 09:25:45.088691 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:45.088694 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:45.088909 (+ 215us) server_negotiation.cc:407] Connection header received
0809 09:25:45.088996 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:45.088998 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:45.089036 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:45.089095 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:25:45.089714 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.090174 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.091003 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.091205 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.091279 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:45.092579 (+ 1300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:25:45.092581 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:25:45.092583 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:25:45.092600 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:25:45.093757 (+ 1157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:45.094167 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:45.094172 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:45.094174 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:45.094249 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:25:45.094521 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:25:45.094524 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:25:45.094525 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:25:45.094851 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:25:45.094990 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:45.095227 (+ 237us) server_negotiation.cc:299] Negotiation successful
0809 09:25:45.095339 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 09:25:45.098110 28601 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33914:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 09:25:45.101071 28601 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:25:45.114869 29092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:45.108966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:46799 (local address 127.0.0.1:53774)
0809 09:25:45.109596 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:45.109644 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:45.109791 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:45.110594 (+ 803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:45.110599 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:45.110646 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:25:45.110838 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:45.110846 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.112300 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.112303 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:45.113445 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:45.113456 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.114307 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.114311 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:45.114411 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:45.114444 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 09:25:45.114573 (+ 129us) client_negotiation.cc:240] Negotiation successful
0809 09:25:45.114701 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"mutex_wait_us":43,"spinlock_wait_cycles":26112,"thread_start_us":92,"threads_started":1}
I20260809 09:25:45.115185 29095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:45.108793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:41953 (local address 127.0.0.1:34908)
0809 09:25:45.109627 (+ 834us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:45.109644 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:45.109792 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:45.110598 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:45.110600 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:45.110629 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:25:45.110838 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:45.110846 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.112056 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.112061 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:45.113510 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:45.113520 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.114584 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.114592 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:45.114708 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:45.114728 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 09:25:45.114817 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 09:25:45.114875 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"mutex_wait_us":7,"spinlock_wait_cycles":9088,"thread_start_us":63,"threads_started":1}
I20260809 09:25:45.115334 29096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:45.109409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:37347 (local address 127.0.0.1:54506)
0809 09:25:45.110179 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:45.110191 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:45.110267 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:45.111029 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:45.111032 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:45.111051 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:25:45.111154 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:45.111160 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.112520 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.112526 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:45.113581 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:45.113591 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.114941 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.114944 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:45.115048 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:45.115072 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 09:25:45.115141 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 09:25:45.115217 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":714,"mutex_wait_us":27,"thread_start_us":88,"threads_started":1}
I20260809 09:25:45.115325 29098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:45.109720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53774 (local address 127.11.99.193:46799)
0809 09:25:45.110086 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:45.110104 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:45.110128 (+ 24us) server_negotiation.cc:407] Connection header received
0809 09:25:45.110204 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:45.110213 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:45.110418 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:45.110598 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:25:45.110972 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.112164 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.113575 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.114169 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.114296 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:45.114440 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:45.115065 (+ 625us) server_negotiation.cc:299] Negotiation successful
0809 09:25:45.115188 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":137,"threads_started":1}
I20260809 09:25:45.115698 29097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:45.109590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54506 (local address 127.11.99.195:37347)
0809 09:25:45.110537 (+ 947us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:45.110563 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:45.110582 (+ 19us) server_negotiation.cc:407] Connection header received
0809 09:25:45.110681 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:45.110687 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:45.110877 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:45.111062 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:25:45.111281 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.112383 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.113702 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.114463 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.114575 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:45.114737 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:45.115488 (+ 751us) server_negotiation.cc:299] Negotiation successful
0809 09:25:45.115599 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":806,"thread_start_us":113,"threads_started":1}
I20260809 09:25:45.117017 29094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:45.108919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34908 (local address 127.11.99.194:41953)
0809 09:25:45.110117 (+ 1198us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:45.110129 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:45.110152 (+ 23us) server_negotiation.cc:407] Connection header received
0809 09:25:45.110226 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:45.110231 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:45.110423 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:45.110999 (+ 576us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:25:45.111168 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.111923 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.113637 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.114463 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.114575 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:45.114727 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:45.114852 (+ 125us) server_negotiation.cc:299] Negotiation successful
0809 09:25:45.114949 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1069,"thread_start_us":109,"threads_started":1}
I20260809 09:25:45.118319 28733 tablet_service.cc:1467] Processing CreateTablet for tablet 99bbc8d802934d4ba954d84fc3f4dcbc (DEFAULT_TABLE table=test-table [id=5b01421c0fb9471e84dc5a66ae5468fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:25:45.118726 29012 tablet_service.cc:1467] Processing CreateTablet for tablet 99bbc8d802934d4ba954d84fc3f4dcbc (DEFAULT_TABLE table=test-table [id=5b01421c0fb9471e84dc5a66ae5468fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:25:45.119426 28733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99bbc8d802934d4ba954d84fc3f4dcbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:25:45.119705 29012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99bbc8d802934d4ba954d84fc3f4dcbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:25:45.119524 28871 tablet_service.cc:1467] Processing CreateTablet for tablet 99bbc8d802934d4ba954d84fc3f4dcbc (DEFAULT_TABLE table=test-table [id=5b01421c0fb9471e84dc5a66ae5468fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:25:45.120433 28871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99bbc8d802934d4ba954d84fc3f4dcbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:25:45.125567 29100 tablet_bootstrap.cc:492] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455: Bootstrap starting.
I20260809 09:25:45.126374 29101 tablet_bootstrap.cc:492] T 99bbc8d802934d4ba954d84fc3f4dcbc P f625dea395cb46479ace142069d562c3: Bootstrap starting.
I20260809 09:25:45.128300 29101 tablet_bootstrap.cc:654] T 99bbc8d802934d4ba954d84fc3f4dcbc P f625dea395cb46479ace142069d562c3: Neither blocks nor log segments found. Creating new log.
I20260809 09:25:45.128300 29100 tablet_bootstrap.cc:654] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455: Neither blocks nor log segments found. Creating new log.
I20260809 09:25:45.129654 29100 log.cc:824] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455: Log is configured to *not* fsync() on all Append() calls
I20260809 09:25:45.129654 29101 log.cc:824] T 99bbc8d802934d4ba954d84fc3f4dcbc P f625dea395cb46479ace142069d562c3: Log is configured to *not* fsync() on all Append() calls
I20260809 09:25:45.130347 29102 tablet_bootstrap.cc:492] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703: Bootstrap starting.
I20260809 09:25:45.131747 29101 tablet_bootstrap.cc:492] T 99bbc8d802934d4ba954d84fc3f4dcbc P f625dea395cb46479ace142069d562c3: No bootstrap required, opened a new log
I20260809 09:25:45.131989 29101 ts_tablet_manager.cc:1397] T 99bbc8d802934d4ba954d84fc3f4dcbc P f625dea395cb46479ace142069d562c3: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 09:25:45.132055 29100 tablet_bootstrap.cc:492] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455: No bootstrap required, opened a new log
I20260809 09:25:45.132252 29100 ts_tablet_manager.cc:1397] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 09:25:45.132860 29102 tablet_bootstrap.cc:654] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703: Neither blocks nor log segments found. Creating new log.
I20260809 09:25:45.133680 29102 log.cc:824] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703: Log is configured to *not* fsync() on all Append() calls
I20260809 09:25:45.135147 29101 raft_consensus.cc:348] T 99bbc8d802934d4ba954d84fc3f4dcbc P f625dea395cb46479ace142069d562c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } } peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } }
I20260809 09:25:45.135339 29101 raft_consensus.cc:374] T 99bbc8d802934d4ba954d84fc3f4dcbc P f625dea395cb46479ace142069d562c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:25:45.135370 29101 raft_consensus.cc:729] T 99bbc8d802934d4ba954d84fc3f4dcbc P f625dea395cb46479ace142069d562c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f625dea395cb46479ace142069d562c3, State: Initialized, Role: FOLLOWER
I20260809 09:25:45.135562 29100 raft_consensus.cc:348] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } } peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } }
I20260809 09:25:45.135757 29100 raft_consensus.cc:374] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:25:45.135860 29100 raft_consensus.cc:729] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42e19074b9cf4a8f8a37a80ef0657455, State: Initialized, Role: FOLLOWER
I20260809 09:25:45.135779 29101 consensus_queue.cc:260] T 99bbc8d802934d4ba954d84fc3f4dcbc P f625dea395cb46479ace142069d562c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } } peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } }
I20260809 09:25:45.136314 29100 consensus_queue.cc:260] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } } peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } }
I20260809 09:25:45.136474 29081 heartbeater.cc:503] Master 127.11.99.254:34617 was elected leader, sending a full tablet report...
I20260809 09:25:45.136693 29101 ts_tablet_manager.cc:1428] T 99bbc8d802934d4ba954d84fc3f4dcbc P f625dea395cb46479ace142069d562c3: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 09:25:45.136971 28803 heartbeater.cc:503] Master 127.11.99.254:34617 was elected leader, sending a full tablet report...
I20260809 09:25:45.137192 29100 ts_tablet_manager.cc:1428] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 09:25:45.139483 29102 tablet_bootstrap.cc:492] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703: No bootstrap required, opened a new log
I20260809 09:25:45.139700 29102 ts_tablet_manager.cc:1397] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20260809 09:25:45.142412 29102 raft_consensus.cc:348] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } } peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } }
I20260809 09:25:45.142659 29102 raft_consensus.cc:374] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:25:45.142738 29102 raft_consensus.cc:729] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc7687ff7b64478eac60bbc4b1602703, State: Initialized, Role: FOLLOWER
I20260809 09:25:45.143126 29102 consensus_queue.cc:260] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } } peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } }
I20260809 09:25:45.143750 28941 heartbeater.cc:503] Master 127.11.99.254:34617 was elected leader, sending a full tablet report...
I20260809 09:25:45.143980 29102 ts_tablet_manager.cc:1428] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
W20260809 09:25:45.310125 29082 tablet.cc:2369] T 99bbc8d802934d4ba954d84fc3f4dcbc P f625dea395cb46479ace142069d562c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 09:25:45.344411 28943 tablet.cc:2369] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 09:25:45.375681 28804 tablet.cc:2369] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:25:45.439647 29108 raft_consensus.cc:482] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:25:45.439888 29108 raft_consensus.cc:504] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } } peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } }
I20260809 09:25:45.441015 29108 leader_election.cc:288] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42e19074b9cf4a8f8a37a80ef0657455 (127.11.99.193:46799), f625dea395cb46479ace142069d562c3 (127.11.99.195:37347)
I20260809 09:25:45.445799 29109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:45.441297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:46799 (local address 127.11.99.194:40199)
0809 09:25:45.441596 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:45.441611 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:45.441770 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:45.442092 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:45.442096 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:45.442111 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:25:45.442257 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:45.442263 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.443276 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.443279 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:45.444574 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:45.444585 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.445427 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.445430 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:45.445505 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:45.445527 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 09:25:45.445598 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 09:25:45.445649 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"mutex_wait_us":65,"thread_start_us":78,"threads_started":1}
I20260809 09:25:45.445844 29098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:45.441445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:40199 (local address 127.11.99.193:46799)
0809 09:25:45.441591 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:45.441596 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:45.441700 (+ 104us) server_negotiation.cc:407] Connection header received
0809 09:25:45.441908 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:45.441912 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:45.441971 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:45.442074 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:25:45.442398 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.443181 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.444720 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.445306 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.445423 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:45.445474 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:45.445637 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 09:25:45.445705 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 09:25:45.445997 29110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:45.441712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:37347 (local address 127.11.99.194:40661)
0809 09:25:45.441975 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:45.441986 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 09:25:45.442093 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:25:45.442364 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:25:45.442368 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:25:45.442389 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:25:45.442491 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:45.442496 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.443395 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.443397 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:45.444574 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:25:45.444585 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.445561 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.445571 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:25:45.445698 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:45.445719 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 09:25:45.445793 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 09:25:45.445853 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"mutex_wait_us":27,"thread_start_us":110,"threads_started":1}
I20260809 09:25:45.446074 29097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:45.441874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:40661 (local address 127.11.99.195:37347)
0809 09:25:45.442043 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:45.442050 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:45.442065 (+ 15us) server_negotiation.cc:407] Connection header received
0809 09:25:45.442204 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:45.442207 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:45.442256 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:45.442313 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:25:45.442601 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.443299 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.444720 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.445306 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.445424 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:45.445474 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:45.445839 (+ 365us) server_negotiation.cc:299] Negotiation successful
0809 09:25:45.445927 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 09:25:45.446668 28755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99bbc8d802934d4ba954d84fc3f4dcbc" candidate_uuid: "dc7687ff7b64478eac60bbc4b1602703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42e19074b9cf4a8f8a37a80ef0657455" is_pre_election: true
I20260809 09:25:45.446867 29034 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99bbc8d802934d4ba954d84fc3f4dcbc" candidate_uuid: "dc7687ff7b64478eac60bbc4b1602703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f625dea395cb46479ace142069d562c3" is_pre_election: true
I20260809 09:25:45.447018 28755 raft_consensus.cc:2454] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc7687ff7b64478eac60bbc4b1602703 in term 0.
I20260809 09:25:45.447104 29034 raft_consensus.cc:2454] T 99bbc8d802934d4ba954d84fc3f4dcbc P f625dea395cb46479ace142069d562c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc7687ff7b64478eac60bbc4b1602703 in term 0.
I20260809 09:25:45.447535 28827 leader_election.cc:302] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42e19074b9cf4a8f8a37a80ef0657455, dc7687ff7b64478eac60bbc4b1602703; no voters:
I20260809 09:25:45.447768 29108 raft_consensus.cc:2781] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:25:45.447849 29108 raft_consensus.cc:482] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:25:45.447899 29108 raft_consensus.cc:3037] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:25:45.448926 29108 raft_consensus.cc:504] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } } peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } }
I20260809 09:25:45.449247 29108 leader_election.cc:288] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 [CANDIDATE]: Term 1 election: Requested vote from peers 42e19074b9cf4a8f8a37a80ef0657455 (127.11.99.193:46799), f625dea395cb46479ace142069d562c3 (127.11.99.195:37347)
I20260809 09:25:45.449599 28755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99bbc8d802934d4ba954d84fc3f4dcbc" candidate_uuid: "dc7687ff7b64478eac60bbc4b1602703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42e19074b9cf4a8f8a37a80ef0657455"
I20260809 09:25:45.449606 29034 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99bbc8d802934d4ba954d84fc3f4dcbc" candidate_uuid: "dc7687ff7b64478eac60bbc4b1602703" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f625dea395cb46479ace142069d562c3"
I20260809 09:25:45.449726 28755 raft_consensus.cc:3037] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:25:45.449751 29034 raft_consensus.cc:3037] T 99bbc8d802934d4ba954d84fc3f4dcbc P f625dea395cb46479ace142069d562c3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:25:45.451021 29034 raft_consensus.cc:2454] T 99bbc8d802934d4ba954d84fc3f4dcbc P f625dea395cb46479ace142069d562c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc7687ff7b64478eac60bbc4b1602703 in term 1.
I20260809 09:25:45.451021 28755 raft_consensus.cc:2454] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc7687ff7b64478eac60bbc4b1602703 in term 1.
I20260809 09:25:45.451396 28827 leader_election.cc:302] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc7687ff7b64478eac60bbc4b1602703, f625dea395cb46479ace142069d562c3; no voters:
I20260809 09:25:45.451587 29108 raft_consensus.cc:2781] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:25:45.451776 29108 raft_consensus.cc:686] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 [term 1 LEADER]: Becoming Leader. State: Replica: dc7687ff7b64478eac60bbc4b1602703, State: Running, Role: LEADER
I20260809 09:25:45.452085 29108 consensus_queue.cc:237] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } } peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } }
I20260809 09:25:45.455107 28601 catalog_manager.cc:5495] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc7687ff7b64478eac60bbc4b1602703 (127.11.99.194). New cstate: current_term: 1 leader_uuid: "dc7687ff7b64478eac60bbc4b1602703" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } health_report { overall_health: UNKNOWN } } }
I20260809 09:25:45.477214 29094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:45.473565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52962 (local address 127.11.99.194:41953)
0809 09:25:45.473781 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 09:25:45.473786 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:25:45.473838 (+ 52us) server_negotiation.cc:407] Connection header received
0809 09:25:45.474020 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:25:45.474022 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:25:45.474077 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:25:45.474183 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:25:45.474427 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.475016 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.475874 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:25:45.476094 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:25:45.476198 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:25:45.476491 (+ 293us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:25:45.476864 (+ 373us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:25:45.476988 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 09:25:45.477040 (+ 52us) server_negotiation.cc:299] Negotiation successful
0809 09:25:45.477089 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148}
I20260809 09:25:45.482872 29034 raft_consensus.cc:1261] T 99bbc8d802934d4ba954d84fc3f4dcbc P f625dea395cb46479ace142069d562c3 [term 1 FOLLOWER]: Refusing update from remote peer dc7687ff7b64478eac60bbc4b1602703: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:25:45.482895 28755 raft_consensus.cc:1261] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455 [term 1 FOLLOWER]: Refusing update from remote peer dc7687ff7b64478eac60bbc4b1602703: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:25:45.483532 29108 consensus_queue.cc:1035] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:25:45.483709 29111 consensus_queue.cc:1035] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:25:45.499038 28601 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33914:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:25:45.499189 28601 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33914:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:25:45.501619 28601 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc: Sending DeleteTablet for 3 replicas of tablet 99bbc8d802934d4ba954d84fc3f4dcbc
I20260809 09:25:45.502343 28871 tablet_service.cc:1514] Processing DeleteTablet for tablet 99bbc8d802934d4ba954d84fc3f4dcbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:25:45 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:34908
I20260809 09:25:45.502418 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 28667
I20260809 09:25:45.502408 29012 tablet_service.cc:1514] Processing DeleteTablet for tablet 99bbc8d802934d4ba954d84fc3f4dcbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:25:45 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:54506
I20260809 09:25:45.503893 29124 tablet_replica.cc:330] T 99bbc8d802934d4ba954d84fc3f4dcbc P f625dea395cb46479ace142069d562c3: stopping tablet replica
I20260809 09:25:45.504431 29124 raft_consensus.cc:2229] T 99bbc8d802934d4ba954d84fc3f4dcbc P f625dea395cb46479ace142069d562c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:25:45.504824 29124 raft_consensus.cc:2258] T 99bbc8d802934d4ba954d84fc3f4dcbc P f625dea395cb46479ace142069d562c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:25:45.506449 29124 ts_tablet_manager.cc:1905] T 99bbc8d802934d4ba954d84fc3f4dcbc P f625dea395cb46479ace142069d562c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:25:45.510321 29124 ts_tablet_manager.cc:1918] T 99bbc8d802934d4ba954d84fc3f4dcbc P f625dea395cb46479ace142069d562c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:25:45.510421 29124 log.cc:1196] T 99bbc8d802934d4ba954d84fc3f4dcbc P f625dea395cb46479ace142069d562c3: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/99bbc8d802934d4ba954d84fc3f4dcbc
I20260809 09:25:45.510838 29124 ts_tablet_manager.cc:1939] T 99bbc8d802934d4ba954d84fc3f4dcbc P f625dea395cb46479ace142069d562c3: Deleting consensus metadata
I20260809 09:25:45.512183 28588 catalog_manager.cc:4841] TS f625dea395cb46479ace142069d562c3 (127.11.99.195:37347): tablet 99bbc8d802934d4ba954d84fc3f4dcbc (table test-table [id=5b01421c0fb9471e84dc5a66ae5468fb]) successfully deleted
W20260809 09:25:45.513233 28588 connection.cc:535] client connection to 127.11.99.193:46799 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 09:25:45.513363 28588 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 09:25:45.514122 29123 tablet_replica.cc:330] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703: stopping tablet replica
I20260809 09:25:45.514285 29095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:45.514018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:46799 (local address 127.0.0.1:44438)
0809 09:25:45.514141 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:45.514206 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.193:46799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 09:25:45.514442 29123 raft_consensus.cc:2229] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 [term 1 LEADER]: Raft consensus shutting down.
W20260809 09:25:45.514472 28588 catalog_manager.cc:4584] TS 42e19074b9cf4a8f8a37a80ef0657455 (127.11.99.193:46799): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 99bbc8d802934d4ba954d84fc3f4dcbc: Network error: Client connection negotiation failed: client connection to 127.11.99.193:46799: connect: Connection refused (error 111)
I20260809 09:25:45.514791 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 28808
I20260809 09:25:45.514876 29123 raft_consensus.cc:2258] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:25:45.522212 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 28948
I20260809 09:25:45.522372 29095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:25:45.522098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:41953 (local address 127.0.0.1:52974)
0809 09:25:45.522217 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 09:25:45.522272 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.194:41953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 09:25:45.528296 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 28569
I20260809 09:26:05.535776 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:34617
--webserver_interface=127.11.99.254
--webserver_port=43685
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:36061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:34617
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:26:05.640945 29126 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:05.641160 29126 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:05.641196 29126 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:05.644851 29126 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 09:26:05.644899 29126 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 09:26:05.644915 29126 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 09:26:05.644928 29126 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:26:05.644945 29126 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:05.644992 29126 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:05.645020 29126 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:26:05.645051 29126 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:26:05.650111 29126 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:36061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:34617
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:34617
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=43685
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29126
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:05.651037 29126 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:05.651963 29126 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:05.665218 29135 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:05.665299 29126 server_base.cc:1034] running on GCE node
W20260809 09:26:05.665207 29132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:05.665207 29133 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:05.666924 29126 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:05.667949 29126 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:05.669107 29126 hybrid_clock.cc:648] HybridClock initialized: now 1786267565669087 us; error 32 us; skew 500 ppm
Aug 09 09:26:05 dist-test-slave-pgkr krb5kdc[28555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267565, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:26:05.671963 29126 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:26:05.672887 29126 webserver.cc:460] Webserver started at http://127.11.99.254:43685/ using document root <none> and password file <none>
I20260809 09:26:05.673410 29126 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:05.673483 29126 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:05.677155 29126 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:26:05.679188 29142 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:05.680337 29126 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:26:05.680467 29126 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "34ea624d5232413682c17a67ecfe52dc"
format_stamp: "Formatted at 2026-08-09 09:25:44 on dist-test-slave-pgkr"
server_key: "1b37c003e3899c69af43b1c8d016e199"
server_key_iv: "6f615591a07f03e9b86b99eb98adaf45"
server_key_version: "encryptionkey@0"
I20260809 09:26:05.681025 29126 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:05.692632 29126 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:05.695204 29126 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:05.695387 29126 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:05.702041 29126 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:34617
I20260809 09:26:05.702327 29195 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:34617 every 8 connection(s)
I20260809 09:26:05.703115 29126 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:26:05.707111 29196 sys_catalog.cc:263] Verifying existing consensus state
I20260809 09:26:05.708657 29196 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc: Bootstrap starting.
I20260809 09:26:05.712829 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 29126
I20260809 09:26:05.713325 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:46799
--local_ip_for_outbound_sockets=127.11.99.193
--tserver_master_addrs=127.11.99.254:34617
--webserver_port=44101
--webserver_interface=127.11.99.193
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:36061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 09:26:05.726686 29196 log.cc:824] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:05.736085 29196 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 09:26:05.736497 29196 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc: Bootstrap complete.
I20260809 09:26:05.740547 29196 raft_consensus.cc:348] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34ea624d5232413682c17a67ecfe52dc" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34617 } }
I20260809 09:26:05.740953 29196 raft_consensus.cc:729] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34ea624d5232413682c17a67ecfe52dc, State: Initialized, Role: FOLLOWER
I20260809 09:26:05.741451 29196 consensus_queue.cc:260] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34ea624d5232413682c17a67ecfe52dc" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34617 } }
I20260809 09:26:05.741582 29196 raft_consensus.cc:388] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:26:05.741680 29196 raft_consensus.cc:482] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:26:05.741796 29196 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [term 1 FOLLOWER]: Advancing to term 2
I20260809 09:26:05.743759 29196 raft_consensus.cc:504] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34ea624d5232413682c17a67ecfe52dc" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34617 } }
I20260809 09:26:05.744092 29196 leader_election.cc:302] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 34ea624d5232413682c17a67ecfe52dc; no voters:
I20260809 09:26:05.744408 29196 leader_election.cc:288] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 09:26:05.744520 29200 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [term 2 FOLLOWER]: Leader election won for term 2
I20260809 09:26:05.744716 29200 raft_consensus.cc:686] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [term 2 LEADER]: Becoming Leader. State: Replica: 34ea624d5232413682c17a67ecfe52dc, State: Running, Role: LEADER
I20260809 09:26:05.745103 29200 consensus_queue.cc:237] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34ea624d5232413682c17a67ecfe52dc" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34617 } }
I20260809 09:26:05.745700 29196 sys_catalog.cc:564] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:26:05.746568 29201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "34ea624d5232413682c17a67ecfe52dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34ea624d5232413682c17a67ecfe52dc" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34617 } } }
I20260809 09:26:05.746580 29202 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 34ea624d5232413682c17a67ecfe52dc. Latest consensus state: current_term: 2 leader_uuid: "34ea624d5232413682c17a67ecfe52dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34ea624d5232413682c17a67ecfe52dc" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34617 } } }
I20260809 09:26:05.746732 29201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [sys.catalog]: This master's current role is: LEADER
I20260809 09:26:05.746763 29202 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [sys.catalog]: This master's current role is: LEADER
I20260809 09:26:05.747900 29209 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:26:05.752629 29209 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:26:05.753203 29209 catalog_manager.cc:1259] Loaded cluster ID: a776969024d44649bb2508bf4c2bdf61
I20260809 09:26:05.753276 29209 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:26:05.755614 29209 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:26:05.756214 29209 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc: Loaded TSK: 0
I20260809 09:26:05.773126 29209 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc: Generated new TSK 1
I20260809 09:26:05.773377 29209 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 09:26:05.832093 29198 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:05.832348 29198 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:05.832389 29198 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:05.836376 29198 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:05.836429 29198 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:05.836503 29198 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:26:05.841497 29198 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:36061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:46799
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=44101
--tserver_master_addrs=127.11.99.254:34617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29198
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:05.842440 29198 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:05.843458 29198 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:05.852767 29226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:05.852777 29223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:05.852831 29224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:05.853004 29198 server_base.cc:1034] running on GCE node
I20260809 09:26:05.853503 29198 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:05.854054 29198 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:05.855233 29198 hybrid_clock.cc:648] HybridClock initialized: now 1786267565855200 us; error 40 us; skew 500 ppm
Aug 09 09:26:05 dist-test-slave-pgkr krb5kdc[28555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267565, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:26:05.857877 29198 init.cc:377] Logged in from keytab as kudu/127.11.99.193@KRBTEST.COM (short username kudu)
I20260809 09:26:05.858777 29198 webserver.cc:460] Webserver started at http://127.11.99.193:44101/ using document root <none> and password file <none>
I20260809 09:26:05.859324 29198 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:05.859395 29198 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:05.863086 29198 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260809 09:26:05.865209 29233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:05.866456 29198 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:26:05.866592 29198 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "42e19074b9cf4a8f8a37a80ef0657455"
format_stamp: "Formatted at 2026-08-09 09:25:44 on dist-test-slave-pgkr"
server_key: "ba0de19193944a058c37dbbf077ee39b"
server_key_iv: "be8d10956e6e6d832454273c7b0a31bf"
server_key_version: "encryptionkey@0"
I20260809 09:26:05.867156 29198 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:05.890241 29198 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:05.893110 29198 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:05.893321 29198 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:05.893939 29198 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:26:05.895046 29241 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 09:26:05.898787 29198 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 09:26:05.898865 29198 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260809 09:26:05.898959 29198 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 09:26:05.900599 29198 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 09:26:05.900666 29198 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260809 09:26:05.900894 29241 tablet_bootstrap.cc:492] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455: Bootstrap starting.
I20260809 09:26:05.912110 29198 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:46799
I20260809 09:26:05.912184 29352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:46799 every 8 connection(s)
I20260809 09:26:05.913116 29198 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:26:05.919142 29241 log.cc:824] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:05.921329 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 29198
I20260809 09:26:05.921758 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:41953
--local_ip_for_outbound_sockets=127.11.99.194
--tserver_master_addrs=127.11.99.254:34617
--webserver_port=35481
--webserver_interface=127.11.99.194
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:36061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 09:26:05 dist-test-slave-pgkr krb5kdc[28555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267565, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:26:05.926762 29241 tablet_bootstrap.cc:492] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 09:26:05.927224 29241 tablet_bootstrap.cc:492] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455: Bootstrap complete.
I20260809 09:26:05.928488 29241 ts_tablet_manager.cc:1397] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455: Time spent bootstrapping tablet: real 0.028s user 0.018s sys 0.008s
I20260809 09:26:05.930497 29355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:05.915182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:34567 (local address 127.11.99.254:34617)
0809 09:26:05.915604 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:05.915624 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:05.915889 (+ 265us) server_negotiation.cc:407] Connection header received
0809 09:26:05.916994 (+ 1105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:05.917027 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:05.917395 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:05.917732 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:05.918803 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:05.920037 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:05.921131 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:05.921802 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:05.922526 (+ 724us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:05.924790 (+ 2264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:05.924796 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:05.924809 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:05.924840 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:05.926917 (+ 2077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:05.927577 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:05.927586 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:05.927594 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:05.927753 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:05.928162 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:05.928167 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:05.928172 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:05.928589 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:05.928713 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:05.929384 (+ 671us) server_negotiation.cc:299] Negotiation successful
0809 09:26:05.929645 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":127,"threads_started":1}
I20260809 09:26:05.930598 29356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:05.915095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.193:34567)
0809 09:26:05.915701 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:05.915752 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:05.916539 (+ 787us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:05.917780 (+ 1241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:05.917786 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:05.918140 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:26:05.918580 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:05.918593 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:05.920189 (+ 1596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:05.920191 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:05.920994 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:05.921003 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:05.921971 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:05.921974 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:05.922168 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:05.922846 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:26:05.922864 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:26:05.924579 (+ 1715us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:26:05.927040 (+ 2461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:05.927049 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:05.927064 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:05.927452 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:05.927863 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:05.927868 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:05.927871 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:05.928055 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:05.928718 (+ 663us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:26:05.928733 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:26:05.929051 (+ 318us) client_negotiation.cc:769] Sending connection context
0809 09:26:05.929266 (+ 215us) client_negotiation.cc:240] Negotiation successful
0809 09:26:05.929614 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":141,"threads_started":1}
I20260809 09:26:05.931174 29241 raft_consensus.cc:348] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } } peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } }
I20260809 09:26:05.931704 29241 raft_consensus.cc:729] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42e19074b9cf4a8f8a37a80ef0657455, State: Initialized, Role: FOLLOWER
I20260809 09:26:05.932188 29241 consensus_queue.cc:260] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } } peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } }
I20260809 09:26:05.933130 29241 ts_tablet_manager.cc:1428] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 09:26:05.933208 29353 heartbeater.cc:347] Connected to a master server at 127.11.99.254:34617
I20260809 09:26:05.933442 29353 heartbeater.cc:464] Registering TS with master...
I20260809 09:26:05.933877 29353 heartbeater.cc:511] Master 127.11.99.254:34617 requested a full tablet report, sending...
I20260809 09:26:05.936082 29159 ts_manager.cc:194] Registered new tserver with Master: 42e19074b9cf4a8f8a37a80ef0657455 (127.11.99.193:46799)
I20260809 09:26:05.939564 29159 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.193@KRBTEST.COM'} at 127.11.99.193:34567
I20260809 09:26:05.942025 29353 heartbeater.cc:503] Master 127.11.99.254:34617 was elected leader, sending a full tablet report...
Aug 09 09:26:05 dist-test-slave-pgkr krb5kdc[28555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267565, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for kudu/127.11.99.193@KRBTEST.COM
I20260809 09:26:05.949677 29360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:05.938905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:46799 (local address 127.0.0.1:60648)
0809 09:26:05.939603 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:05.939651 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:05.939836 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:05.940477 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:05.940483 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:05.940912 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:26:05.941040 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:05.941048 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:05.942235 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:05.942238 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:05.943186 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:05.943198 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:05.943952 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:05.943955 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:05.944035 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:05.944566 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:26:05.944577 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:26:05.945950 (+ 1373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:26:05.947939 (+ 1989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:05.947949 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:05.947954 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:05.948181 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:05.948485 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:05.948487 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:05.948489 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:05.948586 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:05.949038 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:26:05.949043 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:26:05.949181 (+ 138us) client_negotiation.cc:769] Sending connection context
0809 09:26:05.949313 (+ 132us) client_negotiation.cc:240] Negotiation successful
0809 09:26:05.949503 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":121,"threads_started":1}
I20260809 09:26:05.949693 29361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:05.938991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60648 (local address 127.11.99.193:46799)
0809 09:26:05.939345 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:05.939355 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:05.939736 (+ 381us) server_negotiation.cc:407] Connection header received
0809 09:26:05.940023 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:05.940028 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:05.940220 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:05.940378 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:05.941171 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:05.942105 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:05.943318 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:05.943838 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:05.943941 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:05.946071 (+ 2130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:05.946081 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:05.946094 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:05.946117 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:05.947831 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:05.948299 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:05.948309 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:05.948311 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:05.948387 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:05.948696 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:05.948699 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:05.948701 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:05.948931 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:05.949078 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:05.949403 (+ 325us) server_negotiation.cc:299] Negotiation successful
0809 09:26:05.949556 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":105,"threads_started":1}
I20260809 09:26:05.950598 29284 tablet_service.cc:1514] Processing DeleteTablet for tablet 99bbc8d802934d4ba954d84fc3f4dcbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:25:45 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:60648
I20260809 09:26:05.951418 29362 tablet_replica.cc:330] stopping tablet replica
I20260809 09:26:05.951704 29362 raft_consensus.cc:2229] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:26:05.951934 29362 raft_consensus.cc:2258] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:26:05.952859 29362 ts_tablet_manager.cc:1905] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:26:05.957259 29362 ts_tablet_manager.cc:1918] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:26:05.957371 29362 log.cc:1196] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/wal/wals/99bbc8d802934d4ba954d84fc3f4dcbc
I20260809 09:26:05.957628 29362 ts_tablet_manager.cc:1939] T 99bbc8d802934d4ba954d84fc3f4dcbc P 42e19074b9cf4a8f8a37a80ef0657455: Deleting consensus metadata
I20260809 09:26:05.959242 29146 catalog_manager.cc:4841] TS 42e19074b9cf4a8f8a37a80ef0657455 (127.11.99.193:46799): tablet 99bbc8d802934d4ba954d84fc3f4dcbc (table test-table [id=5b01421c0fb9471e84dc5a66ae5468fb]) successfully deleted
W20260809 09:26:06.035799 29358 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:06.036064 29358 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:06.036104 29358 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:06.039839 29358 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:06.039896 29358 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:06.039968 29358 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:26:06.044823 29358 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:36061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:41953
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=35481
--tserver_master_addrs=127.11.99.254:34617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29358
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:06.045812 29358 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:06.046897 29358 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:06.055787 29367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:06.055920 29371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:06.056149 29358 server_base.cc:1034] running on GCE node
W20260809 09:26:06.055943 29368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:06.056559 29358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:06.057134 29358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:06.058307 29358 hybrid_clock.cc:648] HybridClock initialized: now 1786267566058283 us; error 43 us; skew 500 ppm
Aug 09 09:26:06 dist-test-slave-pgkr krb5kdc[28555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267566, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:26:06.060984 29358 init.cc:377] Logged in from keytab as kudu/127.11.99.194@KRBTEST.COM (short username kudu)
I20260809 09:26:06.061834 29358 webserver.cc:460] Webserver started at http://127.11.99.194:35481/ using document root <none> and password file <none>
I20260809 09:26:06.062351 29358 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:06.062456 29358 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:06.065865 29358 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:26:06.067873 29378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:06.069018 29358 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 09:26:06.069149 29358 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "dc7687ff7b64478eac60bbc4b1602703"
format_stamp: "Formatted at 2026-08-09 09:25:44 on dist-test-slave-pgkr"
server_key: "2672fdf36f15e52de1e391fe751312dd"
server_key_iv: "db107370dd0e50143a92297ba2f87952"
server_key_version: "encryptionkey@0"
I20260809 09:26:06.069634 29358 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:06.079313 29358 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:06.081703 29358 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:06.081887 29358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:06.082391 29358 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:26:06.083369 29386 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 09:26:06.087352 29358 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 09:26:06.087423 29358 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260809 09:26:06.087508 29358 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 09:26:06.089046 29358 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 09:26:06.089112 29358 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260809 09:26:06.089359 29386 tablet_bootstrap.cc:492] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703: Bootstrap starting.
I20260809 09:26:06.099195 29358 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:41953
I20260809 09:26:06.099251 29499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:41953 every 8 connection(s)
I20260809 09:26:06.100214 29358 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:26:06.107977 29386 log.cc:824] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:06.109766 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 29358
Aug 09 09:26:06 dist-test-slave-pgkr krb5kdc[28555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267566, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:26:06.110270 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:37347
--local_ip_for_outbound_sockets=127.11.99.195
--tserver_master_addrs=127.11.99.254:34617
--webserver_port=34373
--webserver_interface=127.11.99.195
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:36061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 09:26:06.115245 29355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:06.101899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:49733 (local address 127.11.99.254:34617)
0809 09:26:06.102053 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:06.102058 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:06.102638 (+ 580us) server_negotiation.cc:407] Connection header received
0809 09:26:06.103840 (+ 1202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:06.103842 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:06.103886 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:06.103954 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:06.105540 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.106070 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.107620 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.107835 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.107910 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:06.110762 (+ 2852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:06.110766 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:06.110768 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:06.110794 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:06.112656 (+ 1862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:06.113260 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:06.113266 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:06.113270 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:06.113392 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:06.113799 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:06.113805 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:06.113808 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:06.114099 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:06.114214 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:06.114791 (+ 577us) server_negotiation.cc:299] Negotiation successful
0809 09:26:06.114964 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 09:26:06.115867 29502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:06.101965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.194:49733)
0809 09:26:06.102470 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:06.102522 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:06.103637 (+ 1115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:06.104146 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:06.104157 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:06.104736 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:26:06.105374 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:06.105392 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.106210 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.106213 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:06.107503 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:06.107513 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.107960 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.107964 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:06.108140 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:06.108750 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:26:06.108765 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:26:06.110497 (+ 1732us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:26:06.112798 (+ 2301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:06.112804 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:06.112815 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:06.113134 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:06.113506 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:06.113509 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:06.113511 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:06.113674 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:06.114216 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:26:06.114221 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:26:06.114507 (+ 286us) client_negotiation.cc:769] Sending connection context
0809 09:26:06.114705 (+ 198us) client_negotiation.cc:240] Negotiation successful
0809 09:26:06.114998 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":122,"threads_started":1}
I20260809 09:26:06.116024 29386 tablet_bootstrap.cc:492] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 09:26:06.116458 29386 tablet_bootstrap.cc:492] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703: Bootstrap complete.
I20260809 09:26:06.117149 29500 heartbeater.cc:347] Connected to a master server at 127.11.99.254:34617
I20260809 09:26:06.117403 29500 heartbeater.cc:464] Registering TS with master...
I20260809 09:26:06.117712 29386 ts_tablet_manager.cc:1397] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703: Time spent bootstrapping tablet: real 0.029s user 0.027s sys 0.000s
I20260809 09:26:06.117954 29500 heartbeater.cc:511] Master 127.11.99.254:34617 requested a full tablet report, sending...
I20260809 09:26:06.119979 29159 ts_manager.cc:194] Registered new tserver with Master: dc7687ff7b64478eac60bbc4b1602703 (127.11.99.194:41953)
I20260809 09:26:06.120237 29386 raft_consensus.cc:348] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } } peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } }
I20260809 09:26:06.120637 29386 raft_consensus.cc:729] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc7687ff7b64478eac60bbc4b1602703, State: Initialized, Role: FOLLOWER
I20260809 09:26:06.121088 29386 consensus_queue.cc:260] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } } peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } }
I20260809 09:26:06.121492 29159 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.194@KRBTEST.COM'} at 127.11.99.194:49733
I20260809 09:26:06.121987 29386 ts_tablet_manager.cc:1428] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260809 09:26:06.123744 29500 heartbeater.cc:503] Master 127.11.99.254:34617 was elected leader, sending a full tablet report...
I20260809 09:26:06.126423 29360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:06.122005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:41953 (local address 127.0.0.1:55560)
0809 09:26:06.122129 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:06.122144 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:06.122231 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:06.123117 (+ 886us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:06.123121 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:06.123147 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:06.123281 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:06.123292 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.124421 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.124427 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:06.125324 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:06.125334 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.126016 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.126020 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:06.126102 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:06.126148 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 09:26:06.126240 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 09:26:06.126314 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 09:26:06.126427 29506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:06.122344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55560 (local address 127.11.99.194:41953)
0809 09:26:06.122642 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:06.122673 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:06.122694 (+ 21us) server_negotiation.cc:407] Connection header received
0809 09:26:06.122759 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:06.122764 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:06.122928 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:06.123071 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:06.123431 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.124321 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.125432 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.125905 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.126007 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:06.126120 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:06.126265 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 09:26:06.126337 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":122,"threads_started":1}
I20260809 09:26:06.127363 29432 tablet_service.cc:1514] Processing DeleteTablet for tablet 99bbc8d802934d4ba954d84fc3f4dcbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:25:45 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:55560
I20260809 09:26:06.128216 29507 tablet_replica.cc:330] stopping tablet replica
I20260809 09:26:06.128484 29507 raft_consensus.cc:2229] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:26:06.128685 29507 raft_consensus.cc:2258] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:26:06.129472 29507 ts_tablet_manager.cc:1905] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:26:06.132776 29507 ts_tablet_manager.cc:1918] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:26:06.132880 29507 log.cc:1196] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/99bbc8d802934d4ba954d84fc3f4dcbc
I20260809 09:26:06.133134 29507 ts_tablet_manager.cc:1939] T 99bbc8d802934d4ba954d84fc3f4dcbc P dc7687ff7b64478eac60bbc4b1602703: Deleting consensus metadata
I20260809 09:26:06.134492 29145 catalog_manager.cc:4841] TS dc7687ff7b64478eac60bbc4b1602703 (127.11.99.194:41953): tablet 99bbc8d802934d4ba954d84fc3f4dcbc (table test-table [id=5b01421c0fb9471e84dc5a66ae5468fb]) successfully deleted
W20260809 09:26:06.224876 29504 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:06.225152 29504 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:06.225220 29504 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:06.229184 29504 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:06.229240 29504 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:06.229347 29504 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:26:06.234086 29504 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:36061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:37347
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=34373
--tserver_master_addrs=127.11.99.254:34617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29504
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:06.235193 29504 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:06.236162 29504 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:06.245071 29514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:06.245057 29513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:06.245062 29516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:06.245357 29504 server_base.cc:1034] running on GCE node
I20260809 09:26:06.245850 29504 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:06.246484 29504 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:06.247648 29504 hybrid_clock.cc:648] HybridClock initialized: now 1786267566247528 us; error 122 us; skew 500 ppm
Aug 09 09:26:06 dist-test-slave-pgkr krb5kdc[28555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267566, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:26:06.250193 29504 init.cc:377] Logged in from keytab as kudu/127.11.99.195@KRBTEST.COM (short username kudu)
I20260809 09:26:06.251019 29504 webserver.cc:460] Webserver started at http://127.11.99.195:34373/ using document root <none> and password file <none>
I20260809 09:26:06.251523 29504 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:06.251622 29504 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:06.255064 29504 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260809 09:26:06.256821 29524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:06.257965 29504 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:26:06.258097 29504 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "f625dea395cb46479ace142069d562c3"
format_stamp: "Formatted at 2026-08-09 09:25:45 on dist-test-slave-pgkr"
server_key: "368d76247e84254869250db2d263f675"
server_key_iv: "c886b3adddf5c6e5ce851678090c37b5"
server_key_version: "encryptionkey@0"
I20260809 09:26:06.258607 29504 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:06.277442 29504 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:06.280301 29504 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:06.280503 29504 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:06.281067 29504 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:26:06.281837 29504 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:26:06.281904 29504 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:06.281971 29504 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:26:06.282021 29504 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:06.292325 29504 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:37347
I20260809 09:26:06.292348 29641 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:37347 every 8 connection(s)
I20260809 09:26:06.293290 29504 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:26:06.298213 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 29504
Aug 09 09:26:06 dist-test-slave-pgkr krb5kdc[28555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267566, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:26:06.306454 29645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:06.298900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55304 (local address 127.11.99.254:34617)
0809 09:26:06.299113 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:06.299117 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:06.299297 (+ 180us) server_negotiation.cc:407] Connection header received
0809 09:26:06.299431 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:06.299434 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:06.299480 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:06.299569 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:06.300281 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.300778 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.301585 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.301804 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.301901 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:06.303319 (+ 1418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:06.303322 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:06.303323 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:06.303372 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:06.304874 (+ 1502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:06.305345 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:06.305348 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:06.305350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:06.305422 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:06.305695 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:06.305698 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:06.305700 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:06.305856 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:06.306027 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:06.306209 (+ 182us) server_negotiation.cc:299] Negotiation successful
0809 09:26:06.306301 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":76,"threads_started":1}
I20260809 09:26:06.307582 29644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:06.295428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.195:59847)
0809 09:26:06.296088 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:06.296124 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:06.296895 (+ 771us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:06.297442 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:06.297448 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:06.297797 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:26:06.298312 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:06.298330 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.299292 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.299296 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:06.300124 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:06.300133 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.300626 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.300630 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:06.300783 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:06.301337 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:26:06.301352 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:26:06.302790 (+ 1438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:26:06.304748 (+ 1958us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:06.304753 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:06.304762 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:06.305086 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:06.305343 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:06.305348 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:06.305354 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:06.305521 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:06.305945 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:26:06.305950 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:26:06.306237 (+ 287us) client_negotiation.cc:769] Sending connection context
0809 09:26:06.306437 (+ 200us) client_negotiation.cc:240] Negotiation successful
0809 09:26:06.306806 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":135,"threads_started":1}
I20260809 09:26:06.308279 29355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:06.295053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:59847 (local address 127.11.99.254:34617)
0809 09:26:06.295188 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:06.295192 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:06.296223 (+ 1031us) server_negotiation.cc:407] Connection header received
0809 09:26:06.297106 (+ 883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:06.297110 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:06.297167 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:06.297260 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:06.298457 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.299160 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.300246 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.300481 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.300584 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:06.302938 (+ 2354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:06.302942 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:06.302944 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:06.302969 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:06.304625 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:06.305177 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:06.305179 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:06.305180 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:06.305249 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:06.305612 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:06.305614 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:06.305615 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:06.305834 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:06.305929 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:06.308072 (+ 2143us) server_negotiation.cc:299] Negotiation successful
0809 09:26:06.308161 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 09:26:06.309033 29642 heartbeater.cc:347] Connected to a master server at 127.11.99.254:34617
I20260809 09:26:06.309219 29642 heartbeater.cc:464] Registering TS with master...
I20260809 09:26:06.309617 29642 heartbeater.cc:511] Master 127.11.99.254:34617 requested a full tablet report, sending...
I20260809 09:26:06.310422 29159 ts_manager.cc:194] Registered new tserver with Master: f625dea395cb46479ace142069d562c3 (127.11.99.195:37347)
I20260809 09:26:06.311028 29159 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.195@KRBTEST.COM'} at 127.11.99.195:59847
I20260809 09:26:06.319690 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 09:26:06.323129 29355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:06.320204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55320 (local address 127.11.99.254:34617)
0809 09:26:06.320322 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:06.320328 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:06.320468 (+ 140us) server_negotiation.cc:407] Connection header received
0809 09:26:06.320577 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:06.320579 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:06.320672 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:06.320748 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:26:06.320933 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.321379 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.322157 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.322345 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.322412 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:06.322744 (+ 332us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:26:06.322856 (+ 112us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0809 09:26:06.323026 (+ 170us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55320: token expired
Metrics: {"server-negotiator.queue_time_us":52}
W20260809 09:26:06.323201 29355 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55320: token expired
W20260809 09:26:06.323496 29087 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.11.99.254:34617)
I20260809 09:26:06.330055 29355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:06.323792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55322 (local address 127.11.99.254:34617)
0809 09:26:06.323906 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:06.323910 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:06.323921 (+ 11us) server_negotiation.cc:407] Connection header received
0809 09:26:06.324016 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:06.324018 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:06.324062 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:06.324156 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:06.324726 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.325174 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.325935 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.326159 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.326253 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:06.327466 (+ 1213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:06.327469 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:06.327471 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:06.327493 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:06.328521 (+ 1028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:06.328924 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:06.328928 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:06.328930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:06.329009 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:06.329267 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:06.329271 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:06.329273 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:06.329434 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:06.329570 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:06.329801 (+ 231us) server_negotiation.cc:299] Negotiation successful
0809 09:26:06.329905 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 09:26:06.332162 29159 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55322:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 09:26:06.335266 29159 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:26:06.342288 29284 tablet_service.cc:1467] Processing CreateTablet for tablet fa34048952b04677b46fdd0fa42897d3 (DEFAULT_TABLE table=test-table [id=3e8382ca2c4149b1a3d8d498b2d6a59d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:26:06.342288 29432 tablet_service.cc:1467] Processing CreateTablet for tablet fa34048952b04677b46fdd0fa42897d3 (DEFAULT_TABLE table=test-table [id=3e8382ca2c4149b1a3d8d498b2d6a59d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:26:06.342916 29432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa34048952b04677b46fdd0fa42897d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:06.342916 29284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa34048952b04677b46fdd0fa42897d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:06.345700 29386 tablet_bootstrap.cc:492] T fa34048952b04677b46fdd0fa42897d3 P dc7687ff7b64478eac60bbc4b1602703: Bootstrap starting.
I20260809 09:26:06.346081 29360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:06.341456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:37347 (local address 127.0.0.1:55092)
0809 09:26:06.341579 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:06.341595 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:06.341689 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:06.342592 (+ 903us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:06.342595 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:06.342668 (+ 73us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:06.342770 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:06.342776 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.343890 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.343897 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:06.344748 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:06.344757 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.345695 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.345699 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:06.345812 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:06.345839 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 09:26:06.345892 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 09:26:06.345967 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 09:26:06.346415 29241 tablet_bootstrap.cc:492] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455: Bootstrap starting.
I20260809 09:26:06.346647 29386 tablet_bootstrap.cc:654] T fa34048952b04677b46fdd0fa42897d3 P dc7687ff7b64478eac60bbc4b1602703: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:06.346772 29653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:06.341719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55092 (local address 127.11.99.195:37347)
0809 09:26:06.342172 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:06.342180 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:06.342200 (+ 20us) server_negotiation.cc:407] Connection header received
0809 09:26:06.342263 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:06.342267 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:06.342419 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:06.342900 (+ 481us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:06.343072 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.343772 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.344883 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.345535 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.346270 (+ 735us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:06.346415 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:06.346467 (+ 52us) server_negotiation.cc:299] Negotiation successful
0809 09:26:06.346586 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":134,"threads_started":1}
I20260809 09:26:06.347319 29241 tablet_bootstrap.cc:654] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:06.348649 29386 tablet_bootstrap.cc:492] T fa34048952b04677b46fdd0fa42897d3 P dc7687ff7b64478eac60bbc4b1602703: No bootstrap required, opened a new log
I20260809 09:26:06.348724 29241 tablet_bootstrap.cc:492] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455: No bootstrap required, opened a new log
I20260809 09:26:06.348762 29386 ts_tablet_manager.cc:1397] T fa34048952b04677b46fdd0fa42897d3 P dc7687ff7b64478eac60bbc4b1602703: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 09:26:06.348820 29241 ts_tablet_manager.cc:1397] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 09:26:06.349151 29386 raft_consensus.cc:348] T fa34048952b04677b46fdd0fa42897d3 P dc7687ff7b64478eac60bbc4b1602703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } } peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } }
I20260809 09:26:06.349263 29386 raft_consensus.cc:374] T fa34048952b04677b46fdd0fa42897d3 P dc7687ff7b64478eac60bbc4b1602703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:06.349221 29241 raft_consensus.cc:348] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } } peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } }
I20260809 09:26:06.349308 29386 raft_consensus.cc:729] T fa34048952b04677b46fdd0fa42897d3 P dc7687ff7b64478eac60bbc4b1602703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc7687ff7b64478eac60bbc4b1602703, State: Initialized, Role: FOLLOWER
I20260809 09:26:06.349319 29241 raft_consensus.cc:374] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:06.349351 29241 raft_consensus.cc:729] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42e19074b9cf4a8f8a37a80ef0657455, State: Initialized, Role: FOLLOWER
I20260809 09:26:06.349459 29386 consensus_queue.cc:260] T fa34048952b04677b46fdd0fa42897d3 P dc7687ff7b64478eac60bbc4b1602703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } } peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } }
I20260809 09:26:06.349468 29241 consensus_queue.cc:260] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } } peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } }
I20260809 09:26:06.349709 29241 ts_tablet_manager.cc:1428] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 09:26:06.350320 29386 ts_tablet_manager.cc:1428] T fa34048952b04677b46fdd0fa42897d3 P dc7687ff7b64478eac60bbc4b1602703: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 09:26:06.350611 29573 tablet_service.cc:1467] Processing CreateTablet for tablet fa34048952b04677b46fdd0fa42897d3 (DEFAULT_TABLE table=test-table [id=3e8382ca2c4149b1a3d8d498b2d6a59d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260809 09:26:06.351217 29501 tablet.cc:2369] T fa34048952b04677b46fdd0fa42897d3 P dc7687ff7b64478eac60bbc4b1602703: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:26:06.351828 29573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa34048952b04677b46fdd0fa42897d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:06.358258 29656 tablet_bootstrap.cc:492] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3: Bootstrap starting.
I20260809 09:26:06.360930 29656 tablet_bootstrap.cc:654] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:06.361932 29656 log.cc:824] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:06.363793 29656 tablet_bootstrap.cc:492] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3: No bootstrap required, opened a new log
I20260809 09:26:06.363958 29656 ts_tablet_manager.cc:1397] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 09:26:06.366808 29656 raft_consensus.cc:348] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } } peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } }
I20260809 09:26:06.367141 29656 raft_consensus.cc:374] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:06.367204 29656 raft_consensus.cc:729] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f625dea395cb46479ace142069d562c3, State: Initialized, Role: FOLLOWER
I20260809 09:26:06.367637 29656 consensus_queue.cc:260] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } } peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } }
I20260809 09:26:06.368254 29642 heartbeater.cc:503] Master 127.11.99.254:34617 was elected leader, sending a full tablet report...
I20260809 09:26:06.368501 29656 ts_tablet_manager.cc:1428] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260809 09:26:06.394665 29658 raft_consensus.cc:482] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:26:06.394853 29658 raft_consensus.cc:504] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } } peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } }
I20260809 09:26:06.395928 29658 leader_election.cc:288] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc7687ff7b64478eac60bbc4b1602703 (127.11.99.194:41953), 42e19074b9cf4a8f8a37a80ef0657455 (127.11.99.193:46799)
I20260809 09:26:06.400537 29506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:06.396221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:45511 (local address 127.11.99.194:41953)
0809 09:26:06.396338 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:06.396343 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:06.396356 (+ 13us) server_negotiation.cc:407] Connection header received
0809 09:26:06.396481 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:06.396484 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:06.396525 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:06.396585 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:06.396941 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.397728 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.399254 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.399895 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.400034 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:06.400083 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:06.400346 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 09:26:06.400420 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 09:26:06.400558 29361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:06.396267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:59841 (local address 127.11.99.193:46799)
0809 09:26:06.396376 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:06.396386 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:06.396650 (+ 264us) server_negotiation.cc:407] Connection header received
0809 09:26:06.396726 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:06.396728 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:06.396801 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:06.396875 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:06.397134 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.397879 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.399254 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.399925 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.400029 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:06.400163 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:06.400346 (+ 183us) server_negotiation.cc:299] Negotiation successful
0809 09:26:06.400414 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 09:26:06.400588 29644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:06.396094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:41953 (local address 127.11.99.195:45511)
0809 09:26:06.396265 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:06.396282 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:06.396363 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:06.396638 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:06.396641 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:06.396654 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:06.396814 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:06.396819 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.397836 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.397838 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:06.399137 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:06.399148 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.400027 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.400030 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:06.400210 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:06.400247 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 09:26:06.400321 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 09:26:06.400431 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87,"mutex_wait_us":128}
I20260809 09:26:06.400815 29659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:06.396138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:46799 (local address 127.11.99.195:59841)
0809 09:26:06.396527 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:06.396537 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:06.396649 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:06.396921 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:06.396924 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:06.396945 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:06.397036 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:06.397040 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.397978 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.397981 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:06.399137 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:06.399148 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.400027 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.400030 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:06.400181 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:06.400240 (+ 59us) client_negotiation.cc:769] Sending connection context
0809 09:26:06.400321 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 09:26:06.400429 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"mutex_wait_us":77,"thread_start_us":92,"threads_started":1}
I20260809 09:26:06.401191 29453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa34048952b04677b46fdd0fa42897d3" candidate_uuid: "f625dea395cb46479ace142069d562c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc7687ff7b64478eac60bbc4b1602703" is_pre_election: true
I20260809 09:26:06.401329 29305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa34048952b04677b46fdd0fa42897d3" candidate_uuid: "f625dea395cb46479ace142069d562c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42e19074b9cf4a8f8a37a80ef0657455" is_pre_election: true
I20260809 09:26:06.401526 29453 raft_consensus.cc:2454] T fa34048952b04677b46fdd0fa42897d3 P dc7687ff7b64478eac60bbc4b1602703 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f625dea395cb46479ace142069d562c3 in term 0.
I20260809 09:26:06.401616 29305 raft_consensus.cc:2454] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f625dea395cb46479ace142069d562c3 in term 0.
I20260809 09:26:06.402029 29527 leader_election.cc:302] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc7687ff7b64478eac60bbc4b1602703, f625dea395cb46479ace142069d562c3; no voters:
I20260809 09:26:06.402315 29658 raft_consensus.cc:2781] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:26:06.402400 29658 raft_consensus.cc:482] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:26:06.402441 29658 raft_consensus.cc:3037] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:06.403441 29658 raft_consensus.cc:504] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } } peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } }
I20260809 09:26:06.403806 29658 leader_election.cc:288] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3 [CANDIDATE]: Term 1 election: Requested vote from peers dc7687ff7b64478eac60bbc4b1602703 (127.11.99.194:41953), 42e19074b9cf4a8f8a37a80ef0657455 (127.11.99.193:46799)
I20260809 09:26:06.404073 29453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa34048952b04677b46fdd0fa42897d3" candidate_uuid: "f625dea395cb46479ace142069d562c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc7687ff7b64478eac60bbc4b1602703"
I20260809 09:26:06.404135 29305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa34048952b04677b46fdd0fa42897d3" candidate_uuid: "f625dea395cb46479ace142069d562c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42e19074b9cf4a8f8a37a80ef0657455"
I20260809 09:26:06.404189 29453 raft_consensus.cc:3037] T fa34048952b04677b46fdd0fa42897d3 P dc7687ff7b64478eac60bbc4b1602703 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:06.404271 29305 raft_consensus.cc:3037] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:06.405282 29453 raft_consensus.cc:2454] T fa34048952b04677b46fdd0fa42897d3 P dc7687ff7b64478eac60bbc4b1602703 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f625dea395cb46479ace142069d562c3 in term 1.
I20260809 09:26:06.405289 29305 raft_consensus.cc:2454] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f625dea395cb46479ace142069d562c3 in term 1.
I20260809 09:26:06.405563 29528 leader_election.cc:302] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42e19074b9cf4a8f8a37a80ef0657455, f625dea395cb46479ace142069d562c3; no voters:
I20260809 09:26:06.405933 29658 raft_consensus.cc:2781] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:26:06.406154 29658 raft_consensus.cc:686] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3 [term 1 LEADER]: Becoming Leader. State: Replica: f625dea395cb46479ace142069d562c3, State: Running, Role: LEADER
I20260809 09:26:06.406574 29658 consensus_queue.cc:237] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } } peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } }
I20260809 09:26:06.409508 29158 catalog_manager.cc:5495] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f625dea395cb46479ace142069d562c3 (127.11.99.195). New cstate: current_term: 1 leader_uuid: "f625dea395cb46479ace142069d562c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } health_report { overall_health: UNKNOWN } } }
W20260809 09:26:06.414311 29354 tablet.cc:2369] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:26:06.428987 29653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:06.425926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55098 (local address 127.11.99.195:37347)
0809 09:26:06.426027 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:06.426030 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:06.426043 (+ 13us) server_negotiation.cc:407] Connection header received
0809 09:26:06.426137 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:06.426139 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:06.426186 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:06.426274 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:26:06.426463 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.427013 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.427790 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:06.427986 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:06.428060 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:06.428332 (+ 272us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:26:06.428683 (+ 351us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:26:06.428768 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:06.428828 (+ 60us) server_negotiation.cc:299] Negotiation successful
0809 09:26:06.428873 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 09:26:06.434372 29305 raft_consensus.cc:1261] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [term 1 FOLLOWER]: Refusing update from remote peer f625dea395cb46479ace142069d562c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:26:06.434373 29453 raft_consensus.cc:1261] T fa34048952b04677b46fdd0fa42897d3 P dc7687ff7b64478eac60bbc4b1602703 [term 1 FOLLOWER]: Refusing update from remote peer f625dea395cb46479ace142069d562c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:26:06.435140 29658 consensus_queue.cc:1035] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:26:06.435348 29660 consensus_queue.cc:1035] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:26:06.441910 29665 mvcc.cc:205] Tried to move back new op lower bound from 7316551952108417024 to 7316551952003817472. Current Snapshot: MvccSnapshot[applied={T|T < 7316551952108417024}]
I20260809 09:26:06.443918 29663 mvcc.cc:205] Tried to move back new op lower bound from 7316551952108417024 to 7316551952003817472. Current Snapshot: MvccSnapshot[applied={T|T < 7316551952108417024 or (T in {7316551952108417024})}]
I20260809 09:26:06.448680 29158 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55322:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:26:06.448812 29158 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55322:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:26:06.450942 29158 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc: Sending DeleteTablet for 3 replicas of tablet fa34048952b04677b46fdd0fa42897d3
I20260809 09:26:06.451496 29432 tablet_service.cc:1514] Processing DeleteTablet for tablet fa34048952b04677b46fdd0fa42897d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:26:06 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:55560
I20260809 09:26:06.451529 29284 tablet_service.cc:1514] Processing DeleteTablet for tablet fa34048952b04677b46fdd0fa42897d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:26:06 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:60648
I20260809 09:26:06.451659 29507 tablet_replica.cc:330] T fa34048952b04677b46fdd0fa42897d3 P dc7687ff7b64478eac60bbc4b1602703: stopping tablet replica
I20260809 09:26:06.451663 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 29198
I20260809 09:26:06.451800 29507 raft_consensus.cc:2229] T fa34048952b04677b46fdd0fa42897d3 P dc7687ff7b64478eac60bbc4b1602703 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:26:06.451767 29573 tablet_service.cc:1514] Processing DeleteTablet for tablet fa34048952b04677b46fdd0fa42897d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:26:06 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:55092
I20260809 09:26:06.451920 29507 raft_consensus.cc:2258] T fa34048952b04677b46fdd0fa42897d3 P dc7687ff7b64478eac60bbc4b1602703 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:26:06.454067 29507 ts_tablet_manager.cc:1905] T fa34048952b04677b46fdd0fa42897d3 P dc7687ff7b64478eac60bbc4b1602703: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:26:06.456703 29507 ts_tablet_manager.cc:1918] T fa34048952b04677b46fdd0fa42897d3 P dc7687ff7b64478eac60bbc4b1602703: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:26:06.456825 29507 log.cc:1196] T fa34048952b04677b46fdd0fa42897d3 P dc7687ff7b64478eac60bbc4b1602703: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/fa34048952b04677b46fdd0fa42897d3
I20260809 09:26:06.457067 29507 ts_tablet_manager.cc:1939] T fa34048952b04677b46fdd0fa42897d3 P dc7687ff7b64478eac60bbc4b1602703: Deleting consensus metadata
I20260809 09:26:06.457643 29145 catalog_manager.cc:4841] TS dc7687ff7b64478eac60bbc4b1602703 (127.11.99.194:41953): tablet fa34048952b04677b46fdd0fa42897d3 (table test-table [id=3e8382ca2c4149b1a3d8d498b2d6a59d]) successfully deleted
I20260809 09:26:06.458806 29672 tablet_replica.cc:330] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3: stopping tablet replica
I20260809 09:26:06.459075 29672 raft_consensus.cc:2229] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3 [term 1 LEADER]: Raft consensus shutting down.
I20260809 09:26:06.459370 29672 raft_consensus.cc:2258] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:26:06.460434 29672 ts_tablet_manager.cc:1905] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 09:26:06.461199 29146 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.99.193:46799 (error 108)
I20260809 09:26:06.462092 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 29358
I20260809 09:26:06.463330 29672 ts_tablet_manager.cc:1918] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:26:06.463420 29672 log.cc:1196] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/fa34048952b04677b46fdd0fa42897d3
I20260809 09:26:06.463757 29672 ts_tablet_manager.cc:1939] T fa34048952b04677b46fdd0fa42897d3 P f625dea395cb46479ace142069d562c3: Deleting consensus metadata
I20260809 09:26:06.464805 29146 catalog_manager.cc:4841] TS f625dea395cb46479ace142069d562c3 (127.11.99.195:37347): tablet fa34048952b04677b46fdd0fa42897d3 (table test-table [id=3e8382ca2c4149b1a3d8d498b2d6a59d]) successfully deleted
I20260809 09:26:06.467337 29360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:06.467085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:46799 (local address 127.0.0.1:60660)
0809 09:26:06.467204 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:06.467274 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.193:46799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 09:26:06.467530 29146 catalog_manager.cc:4584] TS 42e19074b9cf4a8f8a37a80ef0657455 (127.11.99.193:46799): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fa34048952b04677b46fdd0fa42897d3: Network error: Client connection negotiation failed: client connection to 127.11.99.193:46799: connect: Connection refused (error 111)
I20260809 09:26:06.471352 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 29504
I20260809 09:26:06.477443 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 29126
I20260809 09:26:26.484894 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:34617
--webserver_interface=127.11.99.254
--webserver_port=43685
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:36061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:34617
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:26:26.589583 29674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:26.589893 29674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:26.589974 29674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:26.593887 29674 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 09:26:26.593972 29674 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 09:26:26.594002 29674 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 09:26:26.594031 29674 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:26:26.594072 29674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:26.594110 29674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:26.594141 29674 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:26:26.594174 29674 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:26:26.599231 29674 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:36061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:34617
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:34617
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=43685
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29674
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:26.600317 29674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:26.601320 29674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:26.609468 29679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:26.609536 29680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:26.609477 29682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:26.609843 29674 server_base.cc:1034] running on GCE node
I20260809 09:26:26.610379 29674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:26.611465 29674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:26.612649 29674 hybrid_clock.cc:648] HybridClock initialized: now 1786267586612623 us; error 40 us; skew 500 ppm
Aug 09 09:26:26 dist-test-slave-pgkr krb5kdc[28555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267586, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:26:26.615240 29674 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:26:26.616063 29674 webserver.cc:460] Webserver started at http://127.11.99.254:43685/ using document root <none> and password file <none>
I20260809 09:26:26.616585 29674 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:26.616683 29674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:26.620268 29674 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:26:26.622290 29689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:26.623522 29674 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:26:26.623667 29674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "34ea624d5232413682c17a67ecfe52dc"
format_stamp: "Formatted at 2026-08-09 09:25:44 on dist-test-slave-pgkr"
server_key: "1b37c003e3899c69af43b1c8d016e199"
server_key_iv: "6f615591a07f03e9b86b99eb98adaf45"
server_key_version: "encryptionkey@0"
I20260809 09:26:26.624156 29674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:26.640719 29674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:26.643333 29674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:26.643519 29674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:26.650875 29674 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:34617
I20260809 09:26:26.651151 29743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:34617 every 8 connection(s)
I20260809 09:26:26.651939 29674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:26:26.655817 29744 sys_catalog.cc:263] Verifying existing consensus state
I20260809 09:26:26.657326 29744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc: Bootstrap starting.
I20260809 09:26:26.661840 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 29674
I20260809 09:26:26.662300 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:46799
--local_ip_for_outbound_sockets=127.11.99.193
--tserver_master_addrs=127.11.99.254:34617
--webserver_port=44101
--webserver_interface=127.11.99.193
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:36061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 09:26:26.673743 29744 log.cc:824] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:26.684042 29744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 09:26:26.684408 29744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc: Bootstrap complete.
I20260809 09:26:26.688349 29744 raft_consensus.cc:348] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34ea624d5232413682c17a67ecfe52dc" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34617 } }
I20260809 09:26:26.688757 29744 raft_consensus.cc:729] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34ea624d5232413682c17a67ecfe52dc, State: Initialized, Role: FOLLOWER
I20260809 09:26:26.689221 29744 consensus_queue.cc:260] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34ea624d5232413682c17a67ecfe52dc" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34617 } }
I20260809 09:26:26.689358 29744 raft_consensus.cc:388] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:26:26.689460 29744 raft_consensus.cc:482] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:26:26.689590 29744 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [term 2 FOLLOWER]: Advancing to term 3
I20260809 09:26:26.691355 29744 raft_consensus.cc:504] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34ea624d5232413682c17a67ecfe52dc" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34617 } }
I20260809 09:26:26.691695 29744 leader_election.cc:302] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 34ea624d5232413682c17a67ecfe52dc; no voters:
I20260809 09:26:26.692000 29744 leader_election.cc:288] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 09:26:26.692081 29748 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [term 3 FOLLOWER]: Leader election won for term 3
I20260809 09:26:26.692267 29748 raft_consensus.cc:686] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [term 3 LEADER]: Becoming Leader. State: Replica: 34ea624d5232413682c17a67ecfe52dc, State: Running, Role: LEADER
I20260809 09:26:26.692589 29748 consensus_queue.cc:237] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34ea624d5232413682c17a67ecfe52dc" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34617 } }
I20260809 09:26:26.693140 29744 sys_catalog.cc:564] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:26:26.693418 29748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 34ea624d5232413682c17a67ecfe52dc. Latest consensus state: current_term: 3 leader_uuid: "34ea624d5232413682c17a67ecfe52dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34ea624d5232413682c17a67ecfe52dc" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34617 } } }
I20260809 09:26:26.693533 29748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [sys.catalog]: This master's current role is: LEADER
I20260809 09:26:26.693871 29752 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:26:26.693910 29749 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "34ea624d5232413682c17a67ecfe52dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34ea624d5232413682c17a67ecfe52dc" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34617 } } }
I20260809 09:26:26.694108 29749 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc [sys.catalog]: This master's current role is: LEADER
I20260809 09:26:26.698441 29752 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:26:26.699210 29752 catalog_manager.cc:1259] Loaded cluster ID: a776969024d44649bb2508bf4c2bdf61
I20260809 09:26:26.699280 29752 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:26:26.701579 29752 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:26:26.702250 29752 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc: Loaded TSK: 0
I20260809 09:26:26.702327 29752 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 34ea624d5232413682c17a67ecfe52dc: Loaded TSK: 1
F20260809 09:26:26.703023 29752 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f12267349ad google::LogMessage::Fail() at ??:0
@ 0x7f122673788a google::LogMessage::SendToLog() at ??:0
@ 0x7f12267344de google::LogMessage::Flush() at ??:0
@ 0x7f1226735a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f12293f818d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f12293f0f0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f123109d7bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f123107799c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f1231078178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f12310b9df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f12310d882b std::function<>::operator()() at ??:0
@ 0x7f1231077b4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f1231078f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f1231075579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f12310b9640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f12289863d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f1228986c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f12289883f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f1228977512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f1229fbb6db start_thread at ??:0
@ 0x7f122523261f clone at ??:0
W20260809 09:26:26.788213 29746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:26.788513 29746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:26.788599 29746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:26.794710 29746 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:26.794770 29746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:26.794855 29746 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:26:26.802160 29746 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:36061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:46799
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=44101
--tserver_master_addrs=127.11.99.254:34617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29746
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:26.803392 29746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:26.804598 29746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:26.814996 29798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:26.815039 29796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:26.815414 29795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:26.815444 29746 server_base.cc:1034] running on GCE node
I20260809 09:26:26.815858 29746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:26.816512 29746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:26.817713 29746 hybrid_clock.cc:648] HybridClock initialized: now 1786267586817678 us; error 45 us; skew 500 ppm
Aug 09 09:26:26 dist-test-slave-pgkr krb5kdc[28555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267586, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:26:26.820869 29746 init.cc:377] Logged in from keytab as kudu/127.11.99.193@KRBTEST.COM (short username kudu)
I20260809 09:26:26.821655 29746 webserver.cc:460] Webserver started at http://127.11.99.193:44101/ using document root <none> and password file <none>
I20260809 09:26:26.822162 29746 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:26.822221 29746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:26.825889 29746 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:26:26.828095 29806 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:26.829342 29746 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 09:26:26.829468 29746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "42e19074b9cf4a8f8a37a80ef0657455"
format_stamp: "Formatted at 2026-08-09 09:25:44 on dist-test-slave-pgkr"
server_key: "ba0de19193944a058c37dbbf077ee39b"
server_key_iv: "be8d10956e6e6d832454273c7b0a31bf"
server_key_version: "encryptionkey@0"
I20260809 09:26:26.829972 29746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:26.856520 29746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:26.859699 29746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:26.859906 29746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:26.860466 29746 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:26:26.861532 29813 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 09:26:26.866734 29746 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 09:26:26.866801 29746 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260809 09:26:26.866873 29746 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 09:26:26.868377 29746 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 09:26:26.868443 29746 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260809 09:26:26.868749 29813 tablet_bootstrap.cc:492] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455: Bootstrap starting.
I20260809 09:26:26.879117 29746 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:46799
I20260809 09:26:26.879408 29924 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:46799 every 8 connection(s)
I20260809 09:26:26.880105 29746 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:26:26.889420 29813 log.cc:824] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:26.889729 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 29746
I20260809 09:26:26.890143 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:41953
--local_ip_for_outbound_sockets=127.11.99.194
--tserver_master_addrs=127.11.99.254:34617
--webserver_port=35481
--webserver_interface=127.11.99.194
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:36061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 09:26:26.898844 29813 tablet_bootstrap.cc:492] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 09:26:26.899333 29813 tablet_bootstrap.cc:492] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455: Bootstrap complete.
I20260809 09:26:26.900705 29813 ts_tablet_manager.cc:1397] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455: Time spent bootstrapping tablet: real 0.032s user 0.021s sys 0.008s
I20260809 09:26:26.903728 29813 raft_consensus.cc:348] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } } peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } }
I20260809 09:26:26.904235 29813 raft_consensus.cc:729] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42e19074b9cf4a8f8a37a80ef0657455, State: Initialized, Role: FOLLOWER
I20260809 09:26:26.904731 29813 consensus_queue.cc:260] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } } peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } }
I20260809 09:26:26.905721 29813 ts_tablet_manager.cc:1428] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455: Time spent starting tablet: real 0.005s user 0.006s sys 0.001s
W20260809 09:26:26.938823 29928 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:26:26.881887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.193:36845)
0809 09:26:26.882314 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:26.882379 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:26.883128 (+ 749us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:26.937881 (+ 54753us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":133,"threads_started":1}
W20260809 09:26:26.939349 29926 heartbeater.cc:644] Failed to heartbeat to 127.11.99.254:34617 (0 consecutive failures): Network error: Failed to ping master at 127.11.99.254:34617: Client connection negotiation failed: client connection to 127.11.99.254:34617: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 09:26:26.940124 29928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:26.939827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.193:47885)
0809 09:26:26.939966 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:26.940061 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260809 09:26:26.940806 29928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:26.940591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.193:54031)
0809 09:26:26.940705 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:26.940754 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 09:26:26.940986 29926 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 09:26:26.996448 29930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:26.996660 29930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:26.996699 29930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:27.000296 29930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:27.000336 29930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:27.000403 29930 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:26:27.005105 29930 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:36061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:41953
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=35481
--tserver_master_addrs=127.11.99.254:34617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29930
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:27.005945 29930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:27.006935 29930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:27.015993 29937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:27.016000 29940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:27.016016 29938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:27.016204 29930 server_base.cc:1034] running on GCE node
I20260809 09:26:27.016645 29930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:27.017234 29930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:27.018410 29930 hybrid_clock.cc:648] HybridClock initialized: now 1786267587018386 us; error 39 us; skew 500 ppm
Aug 09 09:26:27 dist-test-slave-pgkr krb5kdc[28555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267587, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:26:27.021024 29930 init.cc:377] Logged in from keytab as kudu/127.11.99.194@KRBTEST.COM (short username kudu)
I20260809 09:26:27.021797 29930 webserver.cc:460] Webserver started at http://127.11.99.194:35481/ using document root <none> and password file <none>
I20260809 09:26:27.022327 29930 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:27.022416 29930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:27.025942 29930 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:26:27.028543 29948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:27.029996 29930 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260809 09:26:27.030110 29930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "dc7687ff7b64478eac60bbc4b1602703"
format_stamp: "Formatted at 2026-08-09 09:25:44 on dist-test-slave-pgkr"
server_key: "2672fdf36f15e52de1e391fe751312dd"
server_key_iv: "db107370dd0e50143a92297ba2f87952"
server_key_version: "encryptionkey@0"
I20260809 09:26:27.030604 29930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:27.061537 29930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:27.064489 29930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:27.064682 29930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:27.065233 29930 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:26:27.066006 29930 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:26:27.066074 29930 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:27.066138 29930 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:26:27.066182 29930 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:27.075003 29930 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:41953
I20260809 09:26:27.075053 30068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:41953 every 8 connection(s)
I20260809 09:26:27.075932 29930 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:26:27.077293 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 29930
I20260809 09:26:27.077776 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:37347
--local_ip_for_outbound_sockets=127.11.99.195
--tserver_master_addrs=127.11.99.254:34617
--webserver_port=34373
--webserver_interface=127.11.99.195
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:36061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 09:26:27.079674 30071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:27.078105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.194:57097)
0809 09:26:27.078866 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:27.078987 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":157,"threads_started":1}
W20260809 09:26:27.080242 30069 heartbeater.cc:644] Failed to heartbeat to 127.11.99.254:34617 (0 consecutive failures): Network error: Failed to ping master at 127.11.99.254:34617: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
I20260809 09:26:27.080828 30071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:27.080611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.194:59517)
0809 09:26:27.080712 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:27.080773 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 09:26:27.081542 30071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:27.081321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.194:46969)
0809 09:26:27.081434 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:27.081492 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 09:26:27.081717 30069 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 09:26:27.181735 30072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:27.181993 30072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:27.182071 30072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:27.185813 30072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:27.185891 30072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:27.185974 30072 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:26:27.190481 30072 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:36061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:37347
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=34373
--tserver_master_addrs=127.11.99.254:34617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30072
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:27.191386 30072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:27.192329 30072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:27.201066 30080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:27.201103 30078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:27.201130 30077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:27.201257 30072 server_base.cc:1034] running on GCE node
I20260809 09:26:27.201670 30072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:27.202173 30072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:27.203321 30072 hybrid_clock.cc:648] HybridClock initialized: now 1786267587203293 us; error 42 us; skew 500 ppm
Aug 09 09:26:27 dist-test-slave-pgkr krb5kdc[28555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267587, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:26:27.205838 30072 init.cc:377] Logged in from keytab as kudu/127.11.99.195@KRBTEST.COM (short username kudu)
I20260809 09:26:27.206705 30072 webserver.cc:460] Webserver started at http://127.11.99.195:34373/ using document root <none> and password file <none>
I20260809 09:26:27.207271 30072 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:27.207332 30072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:27.210891 30072 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260809 09:26:27.212864 30088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:27.213984 30072 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:26:27.214109 30072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "f625dea395cb46479ace142069d562c3"
format_stamp: "Formatted at 2026-08-09 09:25:45 on dist-test-slave-pgkr"
server_key: "368d76247e84254869250db2d263f675"
server_key_iv: "c886b3adddf5c6e5ce851678090c37b5"
server_key_version: "encryptionkey@0"
I20260809 09:26:27.214598 30072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:27.232208 30072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:27.235383 30072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:27.235523 30072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:27.235991 30072 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:26:27.236651 30072 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:26:27.236694 30072 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:27.236728 30072 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:26:27.236742 30072 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:27.244522 30072 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:37347
I20260809 09:26:27.244563 30206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:37347 every 8 connection(s)
I20260809 09:26:27.245821 30072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:26:27.250387 30209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:27.248105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.195:36999)
0809 09:26:27.249443 (+ 1338us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:27.249575 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1141,"thread_start_us":117,"threads_started":1}
W20260809 09:26:27.250957 30207 heartbeater.cc:644] Failed to heartbeat to 127.11.99.254:34617 (0 consecutive failures): Network error: Failed to ping master at 127.11.99.254:34617: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
I20260809 09:26:27.251663 30209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:27.251359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.195:45833)
0809 09:26:27.251497 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:27.251581 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260809 09:26:27.252265 30209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:27.252062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.195:55683)
0809 09:26:27.252159 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:27.252202 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 09:26:27.252525 30207 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 09:26:27.254769 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 30072
I20260809 09:26:27.941888 30211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:27.941524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.193:54015)
0809 09:26:27.941739 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:27.941786 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":69,"threads_started":1}
I20260809 09:26:28.082728 30212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:28.082204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.194:59961)
0809 09:26:28.082528 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:28.082577 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":62,"threads_started":1}
I20260809 09:26:28.253371 30213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:28.253012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.195:39835)
0809 09:26:28.253232 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:28.253280 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":81,"threads_started":1}
I20260809 09:26:28.627326 30214 raft_consensus.cc:482] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:26:28.627499 30214 raft_consensus.cc:504] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } } peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } }
I20260809 09:26:28.628517 30214 leader_election.cc:288] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f625dea395cb46479ace142069d562c3 (127.11.99.195:37347), dc7687ff7b64478eac60bbc4b1602703 (127.11.99.194:41953)
Aug 09 09:26:28 dist-test-slave-pgkr krb5kdc[28555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267586, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for kudu/127.11.99.194@KRBTEST.COM
Aug 09 09:26:28 dist-test-slave-pgkr krb5kdc[28555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267586, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for kudu/127.11.99.195@KRBTEST.COM
I20260809 09:26:28.646260 30215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:28.628709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:41953 (local address 127.11.99.193:57413)
0809 09:26:28.629039 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:28.629055 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:28.629172 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:28.630736 (+ 1564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:28.630742 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:28.631262 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:26:28.631687 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:28.631701 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:28.632944 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:28.632946 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:28.633865 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:28.633874 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:28.634619 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:28.634622 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:28.634811 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:28.639821 (+ 5010us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:26:28.639848 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:26:28.641508 (+ 1660us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:26:28.643653 (+ 2145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:28.643659 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:28.643671 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:28.643925 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:28.644310 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:28.644316 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:28.644320 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:28.644495 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:28.645085 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:26:28.645089 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:26:28.645324 (+ 235us) client_negotiation.cc:769] Sending connection context
0809 09:26:28.645525 (+ 201us) client_negotiation.cc:240] Negotiation successful
0809 09:26:28.645830 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"mutex_wait_us":99,"spinlock_wait_cycles":15488,"thread_start_us":55,"threads_started":1}
I20260809 09:26:28.646313 30218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:28.628904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:57413 (local address 127.11.99.194:41953)
0809 09:26:28.629422 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:28.629433 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:28.629465 (+ 32us) server_negotiation.cc:407] Connection header received
0809 09:26:28.630069 (+ 604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:28.630074 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:28.630360 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:28.630686 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:28.631871 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:28.632800 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:28.633993 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:28.634476 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:28.634701 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:28.641742 (+ 7041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:28.641747 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:28.641758 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:28.641785 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:28.643529 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:28.644050 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:28.644056 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:28.644059 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:28.644167 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:28.644602 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:28.644605 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:28.644606 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:28.644979 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:28.645087 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:28.645847 (+ 760us) server_negotiation.cc:299] Negotiation successful
0809 09:26:28.646120 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":122,"threads_started":1}
I20260809 09:26:28.646521 30216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:28.628709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:37347 (local address 127.11.99.193:53361)
0809 09:26:28.629039 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:28.629055 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:28.629172 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:28.630737 (+ 1565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:28.630742 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:28.631263 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:26:28.631687 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:28.631700 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:28.632948 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:28.632953 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:28.633910 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:28.633920 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:28.634976 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:28.634980 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:28.635077 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:28.639853 (+ 4776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:26:28.639865 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:26:28.641872 (+ 2007us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:26:28.644021 (+ 2149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:28.644025 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:28.644028 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:28.644233 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:28.645128 (+ 895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:28.645131 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:28.645132 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:28.645202 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:28.645997 (+ 795us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:26:28.646000 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:26:28.646086 (+ 86us) client_negotiation.cc:769] Sending connection context
0809 09:26:28.646183 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 09:26:28.646323 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"mutex_wait_us":91,"spinlock_wait_cycles":30592,"thread_start_us":84,"threads_started":1}
I20260809 09:26:28.646921 30217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:28.628904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:53361 (local address 127.11.99.195:37347)
0809 09:26:28.629334 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:28.629357 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:28.629394 (+ 37us) server_negotiation.cc:407] Connection header received
0809 09:26:28.630041 (+ 647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:28.630046 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:28.630360 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:28.630705 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:28.631871 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:28.632820 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:28.634015 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:28.634694 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:28.634884 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:28.642083 (+ 7199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:28.642091 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:28.642106 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:28.642140 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:28.643902 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:28.644370 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:28.644377 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:28.644382 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:28.644507 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:28.645297 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:28.645300 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:28.645302 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:28.645832 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:28.645949 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:28.646328 (+ 379us) server_negotiation.cc:299] Negotiation successful
0809 09:26:28.646742 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":121,"threads_started":1}
W20260809 09:26:28.649036 29810 leader_election.cc:341] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f625dea395cb46479ace142069d562c3 (127.11.99.195:37347): Not found: Tablet not found: fa34048952b04677b46fdd0fa42897d3
W20260809 09:26:28.649186 29809 leader_election.cc:341] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dc7687ff7b64478eac60bbc4b1602703 (127.11.99.194:41953): Not found: Tablet not found: fa34048952b04677b46fdd0fa42897d3
I20260809 09:26:28.649277 29809 leader_election.cc:302] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42e19074b9cf4a8f8a37a80ef0657455; no voters: dc7687ff7b64478eac60bbc4b1602703, f625dea395cb46479ace142069d562c3
I20260809 09:26:28.649488 30214 raft_consensus.cc:2726] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 09:26:28.942911 30215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:28.942654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.193:38837)
0809 09:26:28.942780 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:28.942837 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260809 09:26:29.083739 30219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:29.083378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.194:51903)
0809 09:26:29.083599 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:29.083647 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":64,"threads_started":1}
I20260809 09:26:29.254465 30220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:29.254063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.195:48417)
0809 09:26:29.254334 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:29.254388 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":90,"threads_started":1}
I20260809 09:26:29.944056 30221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:29.943666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.193:46489)
0809 09:26:29.943904 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:29.943967 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":70,"threads_started":1}
I20260809 09:26:30.084824 30222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:30.084434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.194:44557)
0809 09:26:30.084692 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:30.084741 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":91,"threads_started":1}
I20260809 09:26:30.209002 30223 raft_consensus.cc:482] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:26:30.209172 30223 raft_consensus.cc:504] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } } peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } }
I20260809 09:26:30.209771 30223 leader_election.cc:288] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f625dea395cb46479ace142069d562c3 (127.11.99.195:37347), dc7687ff7b64478eac60bbc4b1602703 (127.11.99.194:41953)
W20260809 09:26:30.210649 29810 leader_election.cc:341] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f625dea395cb46479ace142069d562c3 (127.11.99.195:37347): Not found: Tablet not found: fa34048952b04677b46fdd0fa42897d3
W20260809 09:26:30.210748 29809 leader_election.cc:341] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dc7687ff7b64478eac60bbc4b1602703 (127.11.99.194:41953): Not found: Tablet not found: fa34048952b04677b46fdd0fa42897d3
I20260809 09:26:30.210848 29809 leader_election.cc:302] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42e19074b9cf4a8f8a37a80ef0657455; no voters: dc7687ff7b64478eac60bbc4b1602703, f625dea395cb46479ace142069d562c3
I20260809 09:26:30.211097 30223 raft_consensus.cc:2726] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 09:26:30.255443 30224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:30.255102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.195:46849)
0809 09:26:30.255321 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:30.255371 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":72,"threads_started":1}
I20260809 09:26:30.945163 30225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:30.944761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.193:40907)
0809 09:26:30.945022 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:30.945072 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":110,"threads_started":1}
I20260809 09:26:31.085897 30226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:31.085496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.194:58445)
0809 09:26:31.085760 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:31.085812 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":76,"threads_started":1}
I20260809 09:26:31.256464 30227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:31.256093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.195:55291)
0809 09:26:31.256327 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:31.256378 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":78,"threads_started":1}
I20260809 09:26:31.946578 30228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:31.946138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.193:55903)
0809 09:26:31.946435 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:31.946486 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":71,"threads_started":1}
I20260809 09:26:32.087147 30229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:32.086746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.194:38649)
0809 09:26:32.086991 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:32.087055 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":72,"threads_started":1}
I20260809 09:26:32.257565 30230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:32.257199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.195:50149)
0809 09:26:32.257431 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:32.257483 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":69,"threads_started":1}
I20260809 09:26:32.947621 30231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:32.947251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.193:49747)
0809 09:26:32.947475 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:32.947532 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":74,"threads_started":1}
I20260809 09:26:33.088299 30232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:33.087901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.194:34753)
0809 09:26:33.088163 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:33.088215 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":94,"threads_started":1}
I20260809 09:26:33.258780 30234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:33.258263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.195:57945)
0809 09:26:33.258635 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:33.258693 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":212,"threads_started":1}
I20260809 09:26:33.517007 30235 raft_consensus.cc:482] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:26:33.517196 30235 raft_consensus.cc:504] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } } peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } }
I20260809 09:26:33.517629 30235 leader_election.cc:288] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f625dea395cb46479ace142069d562c3 (127.11.99.195:37347), dc7687ff7b64478eac60bbc4b1602703 (127.11.99.194:41953)
W20260809 09:26:33.518378 29810 leader_election.cc:341] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f625dea395cb46479ace142069d562c3 (127.11.99.195:37347): Not found: Tablet not found: fa34048952b04677b46fdd0fa42897d3
W20260809 09:26:33.518461 29809 leader_election.cc:341] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dc7687ff7b64478eac60bbc4b1602703 (127.11.99.194:41953): Not found: Tablet not found: fa34048952b04677b46fdd0fa42897d3
I20260809 09:26:33.518546 29809 leader_election.cc:302] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42e19074b9cf4a8f8a37a80ef0657455; no voters: dc7687ff7b64478eac60bbc4b1602703, f625dea395cb46479ace142069d562c3
I20260809 09:26:33.518714 30235 raft_consensus.cc:2726] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 09:26:33.948773 30236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:33.948316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.193:38731)
0809 09:26:33.948552 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:33.948637 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":73,"threads_started":1}
I20260809 09:26:34.089407 30237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:34.088999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.194:59787)
0809 09:26:34.089258 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:34.089309 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":62,"threads_started":1}
I20260809 09:26:34.259874 30238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:34.259398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.195:57667)
0809 09:26:34.259717 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:34.259776 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":88,"threads_started":1}
I20260809 09:26:34.949986 30239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:34.949615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.193:59743)
0809 09:26:34.949844 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:34.949895 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":71,"threads_started":1}
I20260809 09:26:35.090754 30240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:35.090120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.194:51603)
0809 09:26:35.090538 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:35.090603 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":69,"threads_started":1}
I20260809 09:26:35.261123 30242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:35.260614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.195:38013)
0809 09:26:35.260938 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:35.261000 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":78,"threads_started":1}
I20260809 09:26:35.951269 30243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:35.950811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.193:57175)
0809 09:26:35.951117 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:35.951173 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":123,"threads_started":1}
I20260809 09:26:36.091810 30244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:36.091432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.194:35305)
0809 09:26:36.091679 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:36.091729 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":72,"threads_started":1}
I20260809 09:26:36.262223 30245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:36.261825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.195:59019)
0809 09:26:36.262072 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:36.262127 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":77,"threads_started":1}
I20260809 09:26:36.952539 30246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:36.952133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.193:60705)
0809 09:26:36.952397 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:36.952448 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":106,"threads_started":1}
I20260809 09:26:37.092847 30247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:37.092467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.194:45709)
0809 09:26:37.092710 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:37.092763 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":79,"threads_started":1}
I20260809 09:26:37.254737 30248 raft_consensus.cc:482] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:26:37.254887 30248 raft_consensus.cc:504] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f625dea395cb46479ace142069d562c3" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 37347 } } peers { permanent_uuid: "dc7687ff7b64478eac60bbc4b1602703" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 41953 } } peers { permanent_uuid: "42e19074b9cf4a8f8a37a80ef0657455" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 46799 } }
I20260809 09:26:37.255362 30248 leader_election.cc:288] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f625dea395cb46479ace142069d562c3 (127.11.99.195:37347), dc7687ff7b64478eac60bbc4b1602703 (127.11.99.194:41953)
W20260809 09:26:37.256086 29810 leader_election.cc:341] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f625dea395cb46479ace142069d562c3 (127.11.99.195:37347): Not found: Tablet not found: fa34048952b04677b46fdd0fa42897d3
W20260809 09:26:37.256296 29809 leader_election.cc:341] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dc7687ff7b64478eac60bbc4b1602703 (127.11.99.194:41953): Not found: Tablet not found: fa34048952b04677b46fdd0fa42897d3
I20260809 09:26:37.256383 29809 leader_election.cc:302] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42e19074b9cf4a8f8a37a80ef0657455; no voters: dc7687ff7b64478eac60bbc4b1602703, f625dea395cb46479ace142069d562c3
I20260809 09:26:37.256579 30248 raft_consensus.cc:2726] T fa34048952b04677b46fdd0fa42897d3 P 42e19074b9cf4a8f8a37a80ef0657455 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 09:26:37.263281 30249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:37.262935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.195:37219)
0809 09:26:37.263151 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:37.263201 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":75,"threads_started":1}
I20260809 09:26:37.953615 30250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:37.953233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.193:39305)
0809 09:26:37.953474 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:37.953524 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":76,"threads_started":1}
I20260809 09:26:38.093982 30251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:38.093578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.194:55887)
0809 09:26:38.093825 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:38.093878 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":69,"threads_started":1}
I20260809 09:26:38.264371 30252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:38.263988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.195:33167)
0809 09:26:38.264234 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:38.264289 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":80,"threads_started":1}
I20260809 09:26:38.954767 30253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:38.954332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.193:42239)
0809 09:26:38.954573 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:38.954674 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":73,"threads_started":1}
I20260809 09:26:39.095074 30254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:39.094685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.194:37923)
0809 09:26:39.094927 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:39.094979 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":76,"threads_started":1}
I20260809 09:26:39.265450 30255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:39.265074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.195:60497)
0809 09:26:39.265297 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:39.265346 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":70,"threads_started":1}
I20260809 09:26:39.955818 30256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:39.955452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.193:43473)
0809 09:26:39.955681 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:39.955729 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":86,"threads_started":1}
I20260809 09:26:40.096153 30257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:40.095786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.194:40677)
0809 09:26:40.096017 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:40.096069 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":66,"threads_started":1}
I20260809 09:26:40.266515 30258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:40.266127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.195:51023)
0809 09:26:40.266375 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:40.266426 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":86,"threads_started":1}
I20260809 09:26:40.957100 30259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:40.956721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.193:54825)
0809 09:26:40.956955 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:40.957006 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":73,"threads_started":1}
I20260809 09:26:41.097260 30260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:41.096828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.194:48455)
0809 09:26:41.097082 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:41.097134 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":73,"threads_started":1}
I20260809 09:26:41.267645 30261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:41.267268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.195:42279)
0809 09:26:41.267501 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:41.267555 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":76,"threads_started":1}
I20260809 09:26:41.958400 30262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:41.957953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.193:44981)
0809 09:26:41.958255 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:41.958308 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":80,"threads_started":1}
I20260809 09:26:42.098678 30263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:42.098256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.194:38083)
0809 09:26:42.098494 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:42.098543 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":88,"threads_started":1}
I20260809 09:26:42.261473 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 29746
I20260809 09:26:42.268777 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 29930
I20260809 09:26:42.269013 30264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:42.268529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34617 (local address 127.11.99.195:48929)
0809 09:26:42.268788 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:42.268873 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.254:34617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":96,"threads_started":1}
I20260809 09:26:42.275187 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 30072
2026-08-09T09:26:42Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59252 ms)
[----------] 30 tests from SecurityITest (239210 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:26:42 dist-test-slave-pgkr krb5kdc[30267](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:26:42 dist-test-slave-pgkr krb5kdc[30267](info): set up 2 sockets
Aug 09 09:26:42 dist-test-slave-pgkr krb5kdc[30267](info): commencing operation
krb5kdc: starting...
W20260809 09:26:43.327528 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.028s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:26:43 dist-test-slave-pgkr krb5kdc[30267](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267603, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:26:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:26:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:26:43.445849 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:37015
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:34963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:37015
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:26:43.552402 30281 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:43.552706 30281 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:43.552795 30281 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:43.556429 30281 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:26:43.556505 30281 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:43.556541 30281 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:43.556602 30281 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:26:43.556635 30281 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:26:43.561354 30281 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:34963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:37015
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:37015
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30281
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:43.562290 30281 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:43.563248 30281 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:43.571494 30287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:43.571497 30286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:43.571497 30289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:43.571861 30281 server_base.cc:1034] running on GCE node
I20260809 09:26:43.572376 30281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:43.573321 30281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:43.574517 30281 hybrid_clock.cc:648] HybridClock initialized: now 1786267603574489 us; error 37 us; skew 500 ppm
Aug 09 09:26:43 dist-test-slave-pgkr krb5kdc[30267](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267603, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:26:43.577214 30281 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:26:43.577998 30281 webserver.cc:460] Webserver started at http://127.11.99.254:40565/ using document root <none> and password file <none>
I20260809 09:26:43.578511 30281 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:43.578569 30281 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:43.578799 30281 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:43.580761 30281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "96851a107df84c7fa451280f58be012f"
format_stamp: "Formatted at 2026-08-09 09:26:43 on dist-test-slave-pgkr"
server_key: "30888e5b17846b4a37915fda77e8dbec"
server_key_iv: "b9ff8b00a37077868011ff56711ebe65"
server_key_version: "encryptionkey@0"
I20260809 09:26:43.581350 30281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "96851a107df84c7fa451280f58be012f"
format_stamp: "Formatted at 2026-08-09 09:26:43 on dist-test-slave-pgkr"
server_key: "30888e5b17846b4a37915fda77e8dbec"
server_key_iv: "b9ff8b00a37077868011ff56711ebe65"
server_key_version: "encryptionkey@0"
I20260809 09:26:43.584756 30281 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 09:26:43.586971 30296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:43.588044 30281 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:26:43.588184 30281 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "96851a107df84c7fa451280f58be012f"
format_stamp: "Formatted at 2026-08-09 09:26:43 on dist-test-slave-pgkr"
server_key: "30888e5b17846b4a37915fda77e8dbec"
server_key_iv: "b9ff8b00a37077868011ff56711ebe65"
server_key_version: "encryptionkey@0"
I20260809 09:26:43.588282 30281 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:43.624364 30281 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:43.627285 30281 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:43.627503 30281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:43.634511 30281 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:37015
I20260809 09:26:43.634573 30356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:37015 every 8 connection(s)
I20260809 09:26:43.635506 30281 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:26:43.638134 30357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:43.642266 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 30281
I20260809 09:26:43.642413 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:26:43.642740 11663 external_mini_cluster.cc:1428] Setting key 1aa2a4713dae41601dbb75f05dc2f1c6
I20260809 09:26:43.643360 30357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96851a107df84c7fa451280f58be012f: Bootstrap starting.
I20260809 09:26:43.645449 30357 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 96851a107df84c7fa451280f58be012f: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:43.646160 30357 log.cc:824] T 00000000000000000000000000000000 P 96851a107df84c7fa451280f58be012f: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:43.647957 30357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96851a107df84c7fa451280f58be012f: No bootstrap required, opened a new log
Aug 09 09:26:43 dist-test-slave-pgkr krb5kdc[30267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267603, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:26:43.651415 30357 raft_consensus.cc:348] T 00000000000000000000000000000000 P 96851a107df84c7fa451280f58be012f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96851a107df84c7fa451280f58be012f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 37015 } }
I20260809 09:26:43.651700 30357 raft_consensus.cc:374] T 00000000000000000000000000000000 P 96851a107df84c7fa451280f58be012f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:43.651794 30357 raft_consensus.cc:729] T 00000000000000000000000000000000 P 96851a107df84c7fa451280f58be012f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96851a107df84c7fa451280f58be012f, State: Initialized, Role: FOLLOWER
I20260809 09:26:43.652262 30357 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96851a107df84c7fa451280f58be012f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96851a107df84c7fa451280f58be012f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 37015 } }
I20260809 09:26:43.652410 30357 raft_consensus.cc:388] T 00000000000000000000000000000000 P 96851a107df84c7fa451280f58be012f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:26:43.652477 30357 raft_consensus.cc:482] T 00000000000000000000000000000000 P 96851a107df84c7fa451280f58be012f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:26:43.652580 30357 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 96851a107df84c7fa451280f58be012f [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:43.653422 30357 raft_consensus.cc:504] T 00000000000000000000000000000000 P 96851a107df84c7fa451280f58be012f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96851a107df84c7fa451280f58be012f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 37015 } }
I20260809 09:26:43.653755 30357 leader_election.cc:302] T 00000000000000000000000000000000 P 96851a107df84c7fa451280f58be012f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 96851a107df84c7fa451280f58be012f; no voters:
I20260809 09:26:43.654101 30357 leader_election.cc:288] T 00000000000000000000000000000000 P 96851a107df84c7fa451280f58be012f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:26:43.654244 30362 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 96851a107df84c7fa451280f58be012f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:26:43.654495 30362 raft_consensus.cc:686] T 00000000000000000000000000000000 P 96851a107df84c7fa451280f58be012f [term 1 LEADER]: Becoming Leader. State: Replica: 96851a107df84c7fa451280f58be012f, State: Running, Role: LEADER
I20260809 09:26:43.654865 30362 consensus_queue.cc:237] T 00000000000000000000000000000000 P 96851a107df84c7fa451280f58be012f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96851a107df84c7fa451280f58be012f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 37015 } }
I20260809 09:26:43.655309 30357 sys_catalog.cc:564] T 00000000000000000000000000000000 P 96851a107df84c7fa451280f58be012f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:26:43.656093 30362 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96851a107df84c7fa451280f58be012f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 96851a107df84c7fa451280f58be012f. Latest consensus state: current_term: 1 leader_uuid: "96851a107df84c7fa451280f58be012f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96851a107df84c7fa451280f58be012f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 37015 } } }
I20260809 09:26:43.656296 30362 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96851a107df84c7fa451280f58be012f [sys.catalog]: This master's current role is: LEADER
I20260809 09:26:43.656723 30371 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:26:43.656677 30364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96851a107df84c7fa451280f58be012f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "96851a107df84c7fa451280f58be012f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96851a107df84c7fa451280f58be012f" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 37015 } } }
I20260809 09:26:43.656912 30364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96851a107df84c7fa451280f58be012f [sys.catalog]: This master's current role is: LEADER
I20260809 09:26:43.657397 30360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:43.643991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37446 (local address 127.11.99.254:37015)
0809 09:26:43.644415 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:43.644429 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:43.644461 (+ 32us) server_negotiation.cc:407] Connection header received
0809 09:26:43.645006 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:43.645030 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:43.645309 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:43.645600 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:43.646421 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:43.647567 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:43.648467 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:43.648925 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:43.649112 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:43.651803 (+ 2691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:43.651826 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:43.651842 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:43.651874 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:43.653798 (+ 1924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:43.654387 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:43.654393 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:43.654399 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:43.654551 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:43.654955 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:43.654960 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:43.654965 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:43.655458 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:43.655663 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:43.655965 (+ 302us) server_negotiation.cc:299] Negotiation successful
0809 09:26:43.656454 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":116,"threads_started":1}
I20260809 09:26:43.659709 30371 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:26:43.664968 30371 catalog_manager.cc:1347] Generated new cluster ID: 8a6f5a927afb497396eb77dabe7923f0
I20260809 09:26:43.665061 30371 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:26:43.688867 30371 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:26:43.690415 30371 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:26:43.694499 30371 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 96851a107df84c7fa451280f58be012f: Generated new TSK 0
I20260809 09:26:43.695084 30371 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.99.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
I20260809 09:26:43.723129 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:0
--local_ip_for_outbound_sockets=127.11.99.193
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:37015
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:34963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:26:43.830158 30383 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:43.830395 30383 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:43.830433 30383 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:43.834234 30383 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:43.834277 30383 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:43.834347 30383 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:26:43.839319 30383 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:34963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:37015
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30383
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:43.840138 30383 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:43.841010 30383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:43.849737 30391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:43.849722 30389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:43.849785 30383 server_base.cc:1034] running on GCE node
W20260809 09:26:43.849741 30388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:43.850374 30383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:43.851022 30383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:43.852203 30383 hybrid_clock.cc:648] HybridClock initialized: now 1786267603852183 us; error 42 us; skew 500 ppm
Aug 09 09:26:43 dist-test-slave-pgkr krb5kdc[30267](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267603, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:26:43.854846 30383 init.cc:377] Logged in from keytab as kudu/127.11.99.193@KRBTEST.COM (short username kudu)
I20260809 09:26:43.855608 30383 webserver.cc:460] Webserver started at http://127.11.99.193:44141/ using document root <none> and password file <none>
I20260809 09:26:43.856179 30383 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:43.856240 30383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:43.856390 30383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:43.858392 30383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-0/data/instance:
uuid: "623971f5baf7418e8529ce45e48ceaf6"
format_stamp: "Formatted at 2026-08-09 09:26:43 on dist-test-slave-pgkr"
server_key: "f01acb40bc97f6c6ea0476778ed770de"
server_key_iv: "b753e93ec01e362a3199b93c858503e9"
server_key_version: "encryptionkey@0"
I20260809 09:26:43.858964 30383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance:
uuid: "623971f5baf7418e8529ce45e48ceaf6"
format_stamp: "Formatted at 2026-08-09 09:26:43 on dist-test-slave-pgkr"
server_key: "f01acb40bc97f6c6ea0476778ed770de"
server_key_iv: "b753e93ec01e362a3199b93c858503e9"
server_key_version: "encryptionkey@0"
I20260809 09:26:43.862353 30383 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 09:26:43.864595 30398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:43.865752 30383 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:26:43.865877 30383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "623971f5baf7418e8529ce45e48ceaf6"
format_stamp: "Formatted at 2026-08-09 09:26:43 on dist-test-slave-pgkr"
server_key: "f01acb40bc97f6c6ea0476778ed770de"
server_key_iv: "b753e93ec01e362a3199b93c858503e9"
server_key_version: "encryptionkey@0"
I20260809 09:26:43.865978 30383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:43.897444 30383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:43.900336 30383 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:43.900538 30383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:43.901077 30383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:26:43.901962 30383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:26:43.902009 30383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:43.902045 30383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:26:43.902060 30383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:43.910727 30383 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:39373
I20260809 09:26:43.910765 30516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:39373 every 8 connection(s)
I20260809 09:26:43.911558 30383 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:26:43.919474 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 30383
I20260809 09:26:43.919610 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance
I20260809 09:26:43.920208 11663 external_mini_cluster.cc:1428] Setting key da30e16a96bddcecc02e5c5da4fd5af4
Aug 09 09:26:43 dist-test-slave-pgkr krb5kdc[30267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267603, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:26:43.925765 30360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:43.913338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:49819 (local address 127.11.99.254:37015)
0809 09:26:43.913474 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:43.913478 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:43.914250 (+ 772us) server_negotiation.cc:407] Connection header received
0809 09:26:43.915617 (+ 1367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:43.915620 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:43.915676 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:43.915762 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:43.916872 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:43.917398 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:43.918558 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:43.918873 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:43.918990 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:43.921700 (+ 2710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:43.921704 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:43.921707 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:43.921737 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:43.923374 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:43.924030 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:43.924035 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:43.924040 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:43.924155 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:43.924500 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:43.924506 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:43.924509 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:43.924780 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:43.924912 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:43.925367 (+ 455us) server_negotiation.cc:299] Negotiation successful
0809 09:26:43.925514 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 09:26:43.926288 30519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:43.913682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:37015 (local address 127.11.99.193:49819)
0809 09:26:43.914112 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:43.914152 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:43.915409 (+ 1257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:43.915933 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:43.915939 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:43.916264 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:26:43.916731 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:43.916743 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:43.917542 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:43.917545 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:43.918421 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:43.918430 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:43.919036 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:43.919041 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:43.919226 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:43.919849 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:26:43.919865 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:26:43.921498 (+ 1633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:26:43.923496 (+ 1998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:43.923505 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:43.923520 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:43.923894 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:43.924271 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:43.924273 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:43.924274 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:43.924405 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:43.924909 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:26:43.924913 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:26:43.925128 (+ 215us) client_negotiation.cc:769] Sending connection context
0809 09:26:43.925273 (+ 145us) client_negotiation.cc:240] Negotiation successful
0809 09:26:43.925496 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":113,"threads_started":1}
I20260809 09:26:43.927531 30517 heartbeater.cc:347] Connected to a master server at 127.11.99.254:37015
I20260809 09:26:43.927779 30517 heartbeater.cc:464] Registering TS with master...
I20260809 09:26:43.928392 30517 heartbeater.cc:511] Master 127.11.99.254:37015 requested a full tablet report, sending...
I20260809 09:26:43.929973 30316 ts_manager.cc:194] Registered new tserver with Master: 623971f5baf7418e8529ce45e48ceaf6 (127.11.99.193:39373)
I20260809 09:26:43.931190 30316 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.193@KRBTEST.COM'} at 127.11.99.193:49819
WARNING: no policy specified for kudu/127.11.99.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
I20260809 09:26:43.948796 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:0
--local_ip_for_outbound_sockets=127.11.99.194
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:37015
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:34963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:26:44.055195 30522 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:44.055517 30522 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:44.055603 30522 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:44.059824 30522 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:44.059881 30522 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:44.059985 30522 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:26:44.064898 30522 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:34963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:37015
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30522
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:44.065833 30522 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:44.066820 30522 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:44.076063 30529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:44.076114 30528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:44.076114 30531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:44.076292 30522 server_base.cc:1034] running on GCE node
I20260809 09:26:44.076772 30522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:44.077319 30522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:44.078467 30522 hybrid_clock.cc:648] HybridClock initialized: now 1786267604078435 us; error 44 us; skew 500 ppm
Aug 09 09:26:44 dist-test-slave-pgkr krb5kdc[30267](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267604, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:26:44.081156 30522 init.cc:377] Logged in from keytab as kudu/127.11.99.194@KRBTEST.COM (short username kudu)
I20260809 09:26:44.081934 30522 webserver.cc:460] Webserver started at http://127.11.99.194:44519/ using document root <none> and password file <none>
I20260809 09:26:44.082417 30522 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:44.082472 30522 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:44.082691 30522 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:44.084578 30522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-1/data/instance:
uuid: "1fc2c6fc307f4084aa6dcd17e2517ad0"
format_stamp: "Formatted at 2026-08-09 09:26:44 on dist-test-slave-pgkr"
server_key: "0e5a9c3e246082ee08c4e8865647f348"
server_key_iv: "ed37e857d11c91b21564c20aa476cbe3"
server_key_version: "encryptionkey@0"
I20260809 09:26:44.085049 30522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance:
uuid: "1fc2c6fc307f4084aa6dcd17e2517ad0"
format_stamp: "Formatted at 2026-08-09 09:26:44 on dist-test-slave-pgkr"
server_key: "0e5a9c3e246082ee08c4e8865647f348"
server_key_iv: "ed37e857d11c91b21564c20aa476cbe3"
server_key_version: "encryptionkey@0"
I20260809 09:26:44.088492 30522 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 09:26:44.091735 30538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:44.093089 30522 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 09:26:44.093246 30522 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "1fc2c6fc307f4084aa6dcd17e2517ad0"
format_stamp: "Formatted at 2026-08-09 09:26:44 on dist-test-slave-pgkr"
server_key: "0e5a9c3e246082ee08c4e8865647f348"
server_key_iv: "ed37e857d11c91b21564c20aa476cbe3"
server_key_version: "encryptionkey@0"
I20260809 09:26:44.093340 30522 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:44.118813 30522 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:44.121614 30522 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:44.121802 30522 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:44.122362 30522 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:26:44.123174 30522 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:26:44.123220 30522 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:44.123291 30522 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:26:44.123327 30522 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:44.131606 30522 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:46641
I20260809 09:26:44.131650 30658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:46641 every 8 connection(s)
I20260809 09:26:44.132416 30522 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:26:44.134974 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 30522
I20260809 09:26:44.135104 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance
I20260809 09:26:44.135434 11663 external_mini_cluster.cc:1428] Setting key 2470b6140e4aa8c422eec2ac7c6dd962
Aug 09 09:26:44 dist-test-slave-pgkr krb5kdc[30267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267604, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.99.195@KRBTEST.COM; defaulting to no policy
I20260809 09:26:44.146159 30360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:44.134142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:45921 (local address 127.11.99.254:37015)
0809 09:26:44.134313 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:44.134319 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:44.135309 (+ 990us) server_negotiation.cc:407] Connection header received
0809 09:26:44.136708 (+ 1399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:44.136711 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:44.136764 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:44.136864 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:44.137900 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.138400 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.140122 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.140361 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.140458 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:44.142797 (+ 2339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:44.142805 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:44.142807 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:44.142829 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:44.144261 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:44.144745 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:44.144749 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:44.144750 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:44.144818 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:44.145141 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:44.145144 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:44.145146 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:44.145312 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:44.145418 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:44.145880 (+ 462us) server_negotiation.cc:299] Negotiation successful
0809 09:26:44.146000 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 09:26:44.146930 30661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:44.134518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:37015 (local address 127.11.99.194:45921)
0809 09:26:44.135139 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:44.135194 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:44.136513 (+ 1319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:44.137030 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:44.137036 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:44.137345 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:26:44.137767 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:44.137778 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.138519 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.138523 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:44.139976 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:44.139990 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.140495 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.140498 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:44.140677 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:44.141232 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:26:44.141247 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:26:44.142598 (+ 1351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:26:44.144374 (+ 1776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:44.144379 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:44.144391 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:44.144633 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:44.144905 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:44.144909 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:44.144911 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:44.145043 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:44.145427 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:26:44.145435 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:26:44.145651 (+ 216us) client_negotiation.cc:769] Sending connection context
0809 09:26:44.145816 (+ 165us) client_negotiation.cc:240] Negotiation successful
0809 09:26:44.146109 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":164,"threads_started":1}
I20260809 09:26:44.148088 30659 heartbeater.cc:347] Connected to a master server at 127.11.99.254:37015
I20260809 09:26:44.148365 30659 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.195@KRBTEST.COM" created.
I20260809 09:26:44.148869 30659 heartbeater.cc:511] Master 127.11.99.254:37015 requested a full tablet report, sending...
I20260809 09:26:44.149880 30316 ts_manager.cc:194] Registered new tserver with Master: 1fc2c6fc307f4084aa6dcd17e2517ad0 (127.11.99.194:46641)
I20260809 09:26:44.150604 30316 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.194@KRBTEST.COM'} at 127.11.99.194:45921
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
I20260809 09:26:44.164081 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:0
--local_ip_for_outbound_sockets=127.11.99.195
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:37015
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:34963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:26:44.270366 30664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:44.270583 30664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:44.270684 30664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:44.274427 30664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:44.274474 30664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:44.274560 30664 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:26:44.279439 30664 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:34963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:37015
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30664
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:44.280382 30664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:44.281340 30664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:44.290714 30670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:44.290761 30669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:44.290953 30664 server_base.cc:1034] running on GCE node
W20260809 09:26:44.290756 30673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:44.291579 30664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:44.292243 30664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:44.293419 30664 hybrid_clock.cc:648] HybridClock initialized: now 1786267604293392 us; error 45 us; skew 500 ppm
Aug 09 09:26:44 dist-test-slave-pgkr krb5kdc[30267](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267604, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:26:44.296209 30664 init.cc:377] Logged in from keytab as kudu/127.11.99.195@KRBTEST.COM (short username kudu)
I20260809 09:26:44.297111 30664 webserver.cc:460] Webserver started at http://127.11.99.195:43391/ using document root <none> and password file <none>
I20260809 09:26:44.297601 30664 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:44.297658 30664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:44.297868 30664 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:44.299821 30664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-2/data/instance:
uuid: "02f11fa52d614a46916c121c21b70f7b"
format_stamp: "Formatted at 2026-08-09 09:26:44 on dist-test-slave-pgkr"
server_key: "4ac2a2d84c827acad83889065cdf237f"
server_key_iv: "5acd405cb64ff849a127b45d564ab144"
server_key_version: "encryptionkey@0"
I20260809 09:26:44.300295 30664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance:
uuid: "02f11fa52d614a46916c121c21b70f7b"
format_stamp: "Formatted at 2026-08-09 09:26:44 on dist-test-slave-pgkr"
server_key: "4ac2a2d84c827acad83889065cdf237f"
server_key_iv: "5acd405cb64ff849a127b45d564ab144"
server_key_version: "encryptionkey@0"
I20260809 09:26:44.303781 30664 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 09:26:44.305868 30680 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:44.307035 30664 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:26:44.307121 30664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "02f11fa52d614a46916c121c21b70f7b"
format_stamp: "Formatted at 2026-08-09 09:26:44 on dist-test-slave-pgkr"
server_key: "4ac2a2d84c827acad83889065cdf237f"
server_key_iv: "5acd405cb64ff849a127b45d564ab144"
server_key_version: "encryptionkey@0"
I20260809 09:26:44.307194 30664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:44.329733 30664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:44.332715 30664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:44.332849 30664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:44.333298 30664 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:26:44.333972 30664 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:26:44.334015 30664 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:44.334059 30664 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:26:44.334079 30664 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:44.342746 30664 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:44917
I20260809 09:26:44.342804 30799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:44917 every 8 connection(s)
I20260809 09:26:44.343483 30664 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:26:44.350062 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 30664
I20260809 09:26:44.350178 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance
I20260809 09:26:44.350512 11663 external_mini_cluster.cc:1428] Setting key 60e888f266a850e0f212a32c76f50955
Aug 09 09:26:44 dist-test-slave-pgkr krb5kdc[30267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267604, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:26:44.356169 30360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:44.345096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:45671 (local address 127.11.99.254:37015)
0809 09:26:44.345239 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:44.345243 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:44.346003 (+ 760us) server_negotiation.cc:407] Connection header received
0809 09:26:44.347200 (+ 1197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:44.347202 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:44.347250 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:44.347323 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:44.348268 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.348770 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.349817 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.350143 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.350253 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:44.352815 (+ 2562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:44.352819 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:44.352821 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:44.352846 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:44.354053 (+ 1207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:44.354578 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:44.354581 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:44.354582 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:44.354712 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:44.355110 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:44.355113 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:44.355115 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:44.355305 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:44.355407 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:44.355894 (+ 487us) server_negotiation.cc:299] Negotiation successful
0809 09:26:44.356007 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 09:26:44.356997 30802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:44.345462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:37015 (local address 127.11.99.195:45671)
0809 09:26:44.345869 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:44.345904 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:44.347016 (+ 1112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:44.347458 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:44.347463 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:44.347774 (+ 311us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:26:44.348158 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:44.348169 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.348904 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.348907 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:44.349723 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:44.349731 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.350295 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.350298 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:44.350457 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:44.351027 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:26:44.351049 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:26:44.352654 (+ 1605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:26:44.354187 (+ 1533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:44.354192 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:44.354205 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:44.354468 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:44.354811 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:44.354832 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:44.354834 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:44.354979 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:44.355420 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:26:44.355428 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:26:44.355637 (+ 209us) client_negotiation.cc:769] Sending connection context
0809 09:26:44.355841 (+ 204us) client_negotiation.cc:240] Negotiation successful
0809 09:26:44.356130 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":131,"threads_started":1}
I20260809 09:26:44.357939 30800 heartbeater.cc:347] Connected to a master server at 127.11.99.254:37015
I20260809 09:26:44.358176 30800 heartbeater.cc:464] Registering TS with master...
I20260809 09:26:44.358690 30800 heartbeater.cc:511] Master 127.11.99.254:37015 requested a full tablet report, sending...
I20260809 09:26:44.359647 30316 ts_manager.cc:194] Registered new tserver with Master: 02f11fa52d614a46916c121c21b70f7b (127.11.99.195:44917)
I20260809 09:26:44.360230 30316 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.195@KRBTEST.COM'} at 127.11.99.195:45671
I20260809 09:26:44.364301 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 09:26:44.373847 30360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:44.366341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37460 (local address 127.11.99.254:37015)
0809 09:26:44.366481 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:44.366513 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:44.366763 (+ 250us) server_negotiation.cc:407] Connection header received
0809 09:26:44.366862 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:44.366864 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:44.366902 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:44.367000 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:44.367638 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.368124 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.368896 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.369159 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.369247 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:44.370695 (+ 1448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:44.370701 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:44.370703 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:44.370740 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:44.372097 (+ 1357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:44.372669 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:44.372674 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:44.372677 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:44.372782 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:44.373033 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:44.373036 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:44.373037 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:44.373235 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:44.373340 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:44.373541 (+ 201us) server_negotiation.cc:299] Negotiation successful
0809 09:26:44.373634 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 09:26:44.376355 30316 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37460:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 09:26:44.379246 30316 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:26:44.392895 30812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:44.387324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:46641 (local address 127.0.0.1:52958)
0809 09:26:44.387871 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:44.387884 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:44.387974 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:44.388582 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:44.388589 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:44.388614 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:44.388752 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:44.388758 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.389940 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.389946 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:44.391285 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:44.391295 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.392346 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.392350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:44.392468 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:44.392512 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 09:26:44.392628 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 09:26:44.392745 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":95,"threads_started":1}
I20260809 09:26:44.393129 30813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:44.387301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50194 (local address 127.11.99.193:39373)
0809 09:26:44.388216 (+ 915us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:44.388232 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:44.388253 (+ 21us) server_negotiation.cc:407] Connection header received
0809 09:26:44.388327 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:44.388333 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:44.388517 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:44.388984 (+ 467us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:44.389122 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.390211 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.391539 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.392544 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.392649 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:44.392780 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:44.392903 (+ 123us) server_negotiation.cc:299] Negotiation successful
0809 09:26:44.393006 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":814,"thread_start_us":132,"threads_started":1}
I20260809 09:26:44.393086 30811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:44.387129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:39373 (local address 127.0.0.1:50194)
0809 09:26:44.387620 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:44.387662 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:44.387804 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:44.388683 (+ 879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:44.388688 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:44.388710 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:44.388832 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:44.388840 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.390360 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.390364 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:44.391426 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:44.391434 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.392666 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.392669 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:44.392759 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:44.392781 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 09:26:44.392877 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 09:26:44.392959 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":66,"threads_started":1}
I20260809 09:26:44.393546 30815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:44.387863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:44917 (local address 127.0.0.1:34076)
0809 09:26:44.388674 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:44.388686 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:44.388764 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:44.389452 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:44.389455 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:44.389473 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:44.389561 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:44.389566 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.390844 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.390847 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:44.391937 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:44.391948 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.393190 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.393193 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:44.393280 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:44.393299 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 09:26:44.393366 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 09:26:44.393431 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":738,"mutex_wait_us":1,"spinlock_wait_cycles":11136,"thread_start_us":101,"threads_started":1}
I20260809 09:26:44.393705 30814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:44.387813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52958 (local address 127.11.99.194:46641)
0809 09:26:44.388100 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:44.388112 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:44.388135 (+ 23us) server_negotiation.cc:407] Connection header received
0809 09:26:44.388213 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:44.388218 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:44.388410 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:44.388873 (+ 463us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:44.388984 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.389832 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.391417 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.392181 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.392330 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:44.392464 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:44.393428 (+ 964us) server_negotiation.cc:299] Negotiation successful
0809 09:26:44.393548 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":106,"threads_started":1}
I20260809 09:26:44.394013 30816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:44.388292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34076 (local address 127.11.99.195:44917)
0809 09:26:44.389006 (+ 714us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:44.389021 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:44.389040 (+ 19us) server_negotiation.cc:407] Connection header received
0809 09:26:44.389109 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:44.389114 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:44.389299 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:44.389455 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:44.389688 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.390696 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.392069 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.392909 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.392997 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:44.393126 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:44.393752 (+ 626us) server_negotiation.cc:299] Negotiation successful
0809 09:26:44.393855 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":621,"thread_start_us":133,"threads_started":1}
I20260809 09:26:44.395983 30448 tablet_service.cc:1467] Processing CreateTablet for tablet 9d9d924638924892a0793bba9dbb29b3 (DEFAULT_TABLE table=test-table [id=f723d7bb2b254d3c8004a5d0ac41126d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:26:44.397027 30448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d9d924638924892a0793bba9dbb29b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:44.396638 30731 tablet_service.cc:1467] Processing CreateTablet for tablet 9d9d924638924892a0793bba9dbb29b3 (DEFAULT_TABLE table=test-table [id=f723d7bb2b254d3c8004a5d0ac41126d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:26:44.396639 30588 tablet_service.cc:1467] Processing CreateTablet for tablet 9d9d924638924892a0793bba9dbb29b3 (DEFAULT_TABLE table=test-table [id=f723d7bb2b254d3c8004a5d0ac41126d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:26:44.397595 30731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d9d924638924892a0793bba9dbb29b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:44.397594 30588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d9d924638924892a0793bba9dbb29b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:44.403672 30817 tablet_bootstrap.cc:492] T 9d9d924638924892a0793bba9dbb29b3 P 623971f5baf7418e8529ce45e48ceaf6: Bootstrap starting.
I20260809 09:26:44.404603 30818 tablet_bootstrap.cc:492] T 9d9d924638924892a0793bba9dbb29b3 P 02f11fa52d614a46916c121c21b70f7b: Bootstrap starting.
I20260809 09:26:44.404933 30819 tablet_bootstrap.cc:492] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0: Bootstrap starting.
I20260809 09:26:44.405699 30817 tablet_bootstrap.cc:654] T 9d9d924638924892a0793bba9dbb29b3 P 623971f5baf7418e8529ce45e48ceaf6: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:44.406515 30819 tablet_bootstrap.cc:654] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:44.406735 30817 log.cc:824] T 9d9d924638924892a0793bba9dbb29b3 P 623971f5baf7418e8529ce45e48ceaf6: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:44.407717 30819 log.cc:824] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:44.408756 30817 tablet_bootstrap.cc:492] T 9d9d924638924892a0793bba9dbb29b3 P 623971f5baf7418e8529ce45e48ceaf6: No bootstrap required, opened a new log
I20260809 09:26:44.408937 30817 ts_tablet_manager.cc:1397] T 9d9d924638924892a0793bba9dbb29b3 P 623971f5baf7418e8529ce45e48ceaf6: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 09:26:44.409976 30818 tablet_bootstrap.cc:654] T 9d9d924638924892a0793bba9dbb29b3 P 02f11fa52d614a46916c121c21b70f7b: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:44.411190 30818 log.cc:824] T 9d9d924638924892a0793bba9dbb29b3 P 02f11fa52d614a46916c121c21b70f7b: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:44.411984 30819 tablet_bootstrap.cc:492] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0: No bootstrap required, opened a new log
I20260809 09:26:44.412182 30819 ts_tablet_manager.cc:1397] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260809 09:26:44.412292 30817 raft_consensus.cc:348] T 9d9d924638924892a0793bba9dbb29b3 P 623971f5baf7418e8529ce45e48ceaf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623971f5baf7418e8529ce45e48ceaf6" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 39373 } } peers { permanent_uuid: "1fc2c6fc307f4084aa6dcd17e2517ad0" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 46641 } } peers { permanent_uuid: "02f11fa52d614a46916c121c21b70f7b" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44917 } }
I20260809 09:26:44.412614 30817 raft_consensus.cc:374] T 9d9d924638924892a0793bba9dbb29b3 P 623971f5baf7418e8529ce45e48ceaf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:44.412715 30817 raft_consensus.cc:729] T 9d9d924638924892a0793bba9dbb29b3 P 623971f5baf7418e8529ce45e48ceaf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 623971f5baf7418e8529ce45e48ceaf6, State: Initialized, Role: FOLLOWER
I20260809 09:26:44.413113 30818 tablet_bootstrap.cc:492] T 9d9d924638924892a0793bba9dbb29b3 P 02f11fa52d614a46916c121c21b70f7b: No bootstrap required, opened a new log
I20260809 09:26:44.413146 30817 consensus_queue.cc:260] T 9d9d924638924892a0793bba9dbb29b3 P 623971f5baf7418e8529ce45e48ceaf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623971f5baf7418e8529ce45e48ceaf6" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 39373 } } peers { permanent_uuid: "1fc2c6fc307f4084aa6dcd17e2517ad0" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 46641 } } peers { permanent_uuid: "02f11fa52d614a46916c121c21b70f7b" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44917 } }
I20260809 09:26:44.413277 30818 ts_tablet_manager.cc:1397] T 9d9d924638924892a0793bba9dbb29b3 P 02f11fa52d614a46916c121c21b70f7b: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.003s
I20260809 09:26:44.413820 30517 heartbeater.cc:503] Master 127.11.99.254:37015 was elected leader, sending a full tablet report...
I20260809 09:26:44.414074 30817 ts_tablet_manager.cc:1428] T 9d9d924638924892a0793bba9dbb29b3 P 623971f5baf7418e8529ce45e48ceaf6: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 09:26:44.415880 30819 raft_consensus.cc:348] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623971f5baf7418e8529ce45e48ceaf6" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 39373 } } peers { permanent_uuid: "1fc2c6fc307f4084aa6dcd17e2517ad0" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 46641 } } peers { permanent_uuid: "02f11fa52d614a46916c121c21b70f7b" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44917 } }
I20260809 09:26:44.416132 30819 raft_consensus.cc:374] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:44.416222 30819 raft_consensus.cc:729] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fc2c6fc307f4084aa6dcd17e2517ad0, State: Initialized, Role: FOLLOWER
I20260809 09:26:44.416258 30818 raft_consensus.cc:348] T 9d9d924638924892a0793bba9dbb29b3 P 02f11fa52d614a46916c121c21b70f7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623971f5baf7418e8529ce45e48ceaf6" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 39373 } } peers { permanent_uuid: "1fc2c6fc307f4084aa6dcd17e2517ad0" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 46641 } } peers { permanent_uuid: "02f11fa52d614a46916c121c21b70f7b" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44917 } }
I20260809 09:26:44.416500 30818 raft_consensus.cc:374] T 9d9d924638924892a0793bba9dbb29b3 P 02f11fa52d614a46916c121c21b70f7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:44.416554 30818 raft_consensus.cc:729] T 9d9d924638924892a0793bba9dbb29b3 P 02f11fa52d614a46916c121c21b70f7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02f11fa52d614a46916c121c21b70f7b, State: Initialized, Role: FOLLOWER
I20260809 09:26:44.416625 30819 consensus_queue.cc:260] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623971f5baf7418e8529ce45e48ceaf6" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 39373 } } peers { permanent_uuid: "1fc2c6fc307f4084aa6dcd17e2517ad0" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 46641 } } peers { permanent_uuid: "02f11fa52d614a46916c121c21b70f7b" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44917 } }
I20260809 09:26:44.416931 30818 consensus_queue.cc:260] T 9d9d924638924892a0793bba9dbb29b3 P 02f11fa52d614a46916c121c21b70f7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623971f5baf7418e8529ce45e48ceaf6" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 39373 } } peers { permanent_uuid: "1fc2c6fc307f4084aa6dcd17e2517ad0" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 46641 } } peers { permanent_uuid: "02f11fa52d614a46916c121c21b70f7b" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44917 } }
I20260809 09:26:44.417460 30659 heartbeater.cc:503] Master 127.11.99.254:37015 was elected leader, sending a full tablet report...
I20260809 09:26:44.417493 30819 ts_tablet_manager.cc:1428] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 09:26:44.417529 30800 heartbeater.cc:503] Master 127.11.99.254:37015 was elected leader, sending a full tablet report...
I20260809 09:26:44.418717 30818 ts_tablet_manager.cc:1428] T 9d9d924638924892a0793bba9dbb29b3 P 02f11fa52d614a46916c121c21b70f7b: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260809 09:26:44.466245 30825 raft_consensus.cc:482] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:26:44.466461 30825 raft_consensus.cc:504] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623971f5baf7418e8529ce45e48ceaf6" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 39373 } } peers { permanent_uuid: "1fc2c6fc307f4084aa6dcd17e2517ad0" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 46641 } } peers { permanent_uuid: "02f11fa52d614a46916c121c21b70f7b" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44917 } }
I20260809 09:26:44.467610 30825 leader_election.cc:288] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 623971f5baf7418e8529ce45e48ceaf6 (127.11.99.193:39373), 02f11fa52d614a46916c121c21b70f7b (127.11.99.195:44917)
I20260809 09:26:44.471522 30813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:44.467905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:47289 (local address 127.11.99.193:39373)
0809 09:26:44.468042 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:44.468049 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:44.468160 (+ 111us) server_negotiation.cc:407] Connection header received
0809 09:26:44.468241 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:44.468244 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:44.468295 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:44.468372 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:44.468679 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.469243 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.470407 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.470942 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.471039 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:44.471079 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:44.471322 (+ 243us) server_negotiation.cc:299] Negotiation successful
0809 09:26:44.471399 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 09:26:44.471525 30661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:44.467792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:39373 (local address 127.11.99.194:47289)
0809 09:26:44.468034 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:44.468049 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:44.468138 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:44.468391 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:44.468393 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:44.468409 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:44.468543 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:44.468549 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.469340 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.469344 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:44.470279 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:44.470288 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.471051 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.471057 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:44.471173 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:44.471195 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 09:26:44.471287 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 09:26:44.471391 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"mutex_wait_us":1}
I20260809 09:26:44.471525 30816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:44.468155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:53409 (local address 127.11.99.195:44917)
0809 09:26:44.468288 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:44.468291 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:44.468301 (+ 10us) server_negotiation.cc:407] Connection header received
0809 09:26:44.468363 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:44.468365 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:44.468411 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:44.468482 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:44.468787 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.469363 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.470489 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.471033 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.471156 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:44.471203 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:44.471362 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 09:26:44.471428 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 09:26:44.471565 30827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:44.467857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:44917 (local address 127.11.99.194:53409)
0809 09:26:44.468172 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:44.468185 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:44.468264 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:44.468506 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:44.468508 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:44.468527 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:44.468667 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:44.468673 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.469461 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.469464 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:44.470357 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:44.470369 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.471157 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.471160 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:44.471227 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:44.471244 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 09:26:44.471335 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 09:26:44.471423 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":24,"thread_start_us":153,"threads_started":1}
I20260809 09:26:44.472184 30752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d9d924638924892a0793bba9dbb29b3" candidate_uuid: "1fc2c6fc307f4084aa6dcd17e2517ad0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02f11fa52d614a46916c121c21b70f7b" is_pre_election: true
I20260809 09:26:44.472198 30468 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d9d924638924892a0793bba9dbb29b3" candidate_uuid: "1fc2c6fc307f4084aa6dcd17e2517ad0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "623971f5baf7418e8529ce45e48ceaf6" is_pre_election: true
I20260809 09:26:44.472501 30468 raft_consensus.cc:2454] T 9d9d924638924892a0793bba9dbb29b3 P 623971f5baf7418e8529ce45e48ceaf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fc2c6fc307f4084aa6dcd17e2517ad0 in term 0.
I20260809 09:26:44.472513 30752 raft_consensus.cc:2454] T 9d9d924638924892a0793bba9dbb29b3 P 02f11fa52d614a46916c121c21b70f7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fc2c6fc307f4084aa6dcd17e2517ad0 in term 0.
I20260809 09:26:44.473008 30539 leader_election.cc:302] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 02f11fa52d614a46916c121c21b70f7b, 1fc2c6fc307f4084aa6dcd17e2517ad0, 623971f5baf7418e8529ce45e48ceaf6; no voters:
I20260809 09:26:44.473258 30825 raft_consensus.cc:2781] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:26:44.473351 30825 raft_consensus.cc:482] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:26:44.473409 30825 raft_consensus.cc:3037] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:44.474423 30825 raft_consensus.cc:504] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623971f5baf7418e8529ce45e48ceaf6" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 39373 } } peers { permanent_uuid: "1fc2c6fc307f4084aa6dcd17e2517ad0" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 46641 } } peers { permanent_uuid: "02f11fa52d614a46916c121c21b70f7b" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44917 } }
I20260809 09:26:44.474795 30825 leader_election.cc:288] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0 [CANDIDATE]: Term 1 election: Requested vote from peers 623971f5baf7418e8529ce45e48ceaf6 (127.11.99.193:39373), 02f11fa52d614a46916c121c21b70f7b (127.11.99.195:44917)
I20260809 09:26:44.475266 30468 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d9d924638924892a0793bba9dbb29b3" candidate_uuid: "1fc2c6fc307f4084aa6dcd17e2517ad0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "623971f5baf7418e8529ce45e48ceaf6"
I20260809 09:26:44.475299 30752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d9d924638924892a0793bba9dbb29b3" candidate_uuid: "1fc2c6fc307f4084aa6dcd17e2517ad0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02f11fa52d614a46916c121c21b70f7b"
I20260809 09:26:44.475389 30752 raft_consensus.cc:3037] T 9d9d924638924892a0793bba9dbb29b3 P 02f11fa52d614a46916c121c21b70f7b [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:44.475389 30468 raft_consensus.cc:3037] T 9d9d924638924892a0793bba9dbb29b3 P 623971f5baf7418e8529ce45e48ceaf6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:44.476649 30752 raft_consensus.cc:2454] T 9d9d924638924892a0793bba9dbb29b3 P 02f11fa52d614a46916c121c21b70f7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fc2c6fc307f4084aa6dcd17e2517ad0 in term 1.
I20260809 09:26:44.476649 30468 raft_consensus.cc:2454] T 9d9d924638924892a0793bba9dbb29b3 P 623971f5baf7418e8529ce45e48ceaf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fc2c6fc307f4084aa6dcd17e2517ad0 in term 1.
I20260809 09:26:44.476980 30539 leader_election.cc:302] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02f11fa52d614a46916c121c21b70f7b, 1fc2c6fc307f4084aa6dcd17e2517ad0; no voters:
I20260809 09:26:44.477192 30825 raft_consensus.cc:2781] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:26:44.477451 30825 raft_consensus.cc:686] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0 [term 1 LEADER]: Becoming Leader. State: Replica: 1fc2c6fc307f4084aa6dcd17e2517ad0, State: Running, Role: LEADER
I20260809 09:26:44.477818 30825 consensus_queue.cc:237] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623971f5baf7418e8529ce45e48ceaf6" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 39373 } } peers { permanent_uuid: "1fc2c6fc307f4084aa6dcd17e2517ad0" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 46641 } } peers { permanent_uuid: "02f11fa52d614a46916c121c21b70f7b" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44917 } }
I20260809 09:26:44.481236 30315 catalog_manager.cc:5495] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1fc2c6fc307f4084aa6dcd17e2517ad0 (127.11.99.194). New cstate: current_term: 1 leader_uuid: "1fc2c6fc307f4084aa6dcd17e2517ad0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "623971f5baf7418e8529ce45e48ceaf6" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 39373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fc2c6fc307f4084aa6dcd17e2517ad0" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 46641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02f11fa52d614a46916c121c21b70f7b" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44917 } health_report { overall_health: UNKNOWN } } }
I20260809 09:26:44.513054 30814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:44.509591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52968 (local address 127.11.99.194:46641)
0809 09:26:44.509703 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:44.509707 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:44.509720 (+ 13us) server_negotiation.cc:407] Connection header received
0809 09:26:44.509841 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:44.509843 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:44.509897 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:44.509986 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:26:44.510223 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.510803 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.511698 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.511901 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.511979 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:44.512284 (+ 305us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:26:44.512705 (+ 421us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:26:44.512798 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:44.512881 (+ 83us) server_negotiation.cc:299] Negotiation successful
0809 09:26:44.512929 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 09:26:44.518778 30468 raft_consensus.cc:1261] T 9d9d924638924892a0793bba9dbb29b3 P 623971f5baf7418e8529ce45e48ceaf6 [term 1 FOLLOWER]: Refusing update from remote peer 1fc2c6fc307f4084aa6dcd17e2517ad0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:26:44.518776 30752 raft_consensus.cc:1261] T 9d9d924638924892a0793bba9dbb29b3 P 02f11fa52d614a46916c121c21b70f7b [term 1 FOLLOWER]: Refusing update from remote peer 1fc2c6fc307f4084aa6dcd17e2517ad0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:26:44.519503 30828 consensus_queue.cc:1035] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "623971f5baf7418e8529ce45e48ceaf6" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 39373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:26:44.519706 30825 consensus_queue.cc:1035] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02f11fa52d614a46916c121c21b70f7b" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 44917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:26:44.526585 30831 mvcc.cc:205] Tried to move back new op lower bound from 7316552108101824512 to 7316552107944009728. Current Snapshot: MvccSnapshot[applied={T|T < 7316552108101824512}]
I20260809 09:26:44.536211 30315 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37460:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:26:44.536350 30315 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37460:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:26:44.538729 30315 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 96851a107df84c7fa451280f58be012f: Sending DeleteTablet for 3 replicas of tablet 9d9d924638924892a0793bba9dbb29b3
I20260809 09:26:44.539539 30731 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d9d924638924892a0793bba9dbb29b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:26:44 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:34076
I20260809 09:26:44.539569 30448 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d9d924638924892a0793bba9dbb29b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:26:44 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:50194
I20260809 09:26:44.539629 30588 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d9d924638924892a0793bba9dbb29b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:26:44 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:52958
I20260809 09:26:44.539995 30842 tablet_replica.cc:330] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0: stopping tablet replica
I20260809 09:26:44.540180 30841 tablet_replica.cc:330] T 9d9d924638924892a0793bba9dbb29b3 P 02f11fa52d614a46916c121c21b70f7b: stopping tablet replica
I20260809 09:26:44.540350 30842 raft_consensus.cc:2229] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0 [term 1 LEADER]: Raft consensus shutting down.
I20260809 09:26:44.540448 30841 raft_consensus.cc:2229] T 9d9d924638924892a0793bba9dbb29b3 P 02f11fa52d614a46916c121c21b70f7b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:26:44.540596 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 30383
I20260809 09:26:44.540747 30841 raft_consensus.cc:2258] T 9d9d924638924892a0793bba9dbb29b3 P 02f11fa52d614a46916c121c21b70f7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:26:44.540747 30842 raft_consensus.cc:2258] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:26:44.542404 30841 ts_tablet_manager.cc:1905] T 9d9d924638924892a0793bba9dbb29b3 P 02f11fa52d614a46916c121c21b70f7b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:26:44.544447 30842 ts_tablet_manager.cc:1905] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:26:44.545091 30841 ts_tablet_manager.cc:1918] T 9d9d924638924892a0793bba9dbb29b3 P 02f11fa52d614a46916c121c21b70f7b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:26:44.545264 30841 log.cc:1196] T 9d9d924638924892a0793bba9dbb29b3 P 02f11fa52d614a46916c121c21b70f7b: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/9d9d924638924892a0793bba9dbb29b3
I20260809 09:26:44.545660 30841 ts_tablet_manager.cc:1939] T 9d9d924638924892a0793bba9dbb29b3 P 02f11fa52d614a46916c121c21b70f7b: Deleting consensus metadata
I20260809 09:26:44.546905 30298 catalog_manager.cc:4841] TS 02f11fa52d614a46916c121c21b70f7b (127.11.99.195:44917): tablet 9d9d924638924892a0793bba9dbb29b3 (table test-table [id=f723d7bb2b254d3c8004a5d0ac41126d]) successfully deleted
I20260809 09:26:44.547150 30842 ts_tablet_manager.cc:1918] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:26:44.547286 30842 log.cc:1196] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/9d9d924638924892a0793bba9dbb29b3
I20260809 09:26:44.547587 30842 ts_tablet_manager.cc:1939] T 9d9d924638924892a0793bba9dbb29b3 P 1fc2c6fc307f4084aa6dcd17e2517ad0: Deleting consensus metadata
I20260809 09:26:44.548462 30300 catalog_manager.cc:4841] TS 1fc2c6fc307f4084aa6dcd17e2517ad0 (127.11.99.194:46641): tablet 9d9d924638924892a0793bba9dbb29b3 (table test-table [id=f723d7bb2b254d3c8004a5d0ac41126d]) successfully deleted
W20260809 09:26:44.551460 30302 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.99.193:39373 (error 108)
I20260809 09:26:44.552264 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 30522
I20260809 09:26:44.552433 30812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:44.552102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:39373 (local address 127.0.0.1:50196)
0809 09:26:44.552221 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:44.552336 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.193:39373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 09:26:44.553794 30302 catalog_manager.cc:4584] TS 623971f5baf7418e8529ce45e48ceaf6 (127.11.99.193:39373): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9d9d924638924892a0793bba9dbb29b3: Network error: Client connection negotiation failed: client connection to 127.11.99.193:39373: connect: Connection refused (error 111)
I20260809 09:26:44.558928 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 30664
I20260809 09:26:44.565907 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 30281
2026-08-09T09:26:44Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2290 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-09T09:26:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:26:44Z Disabled control of system clock
I20260809 09:26:44.597821 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:36259
--webserver_interface=127.11.99.254
--webserver_port=0
--builtin_ntp_servers=127.11.99.212:41843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:36259
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 09:26:44.704874 30849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:44.705123 30849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:44.705176 30849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:44.709092 30849 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:26:44.709141 30849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:44.709156 30849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:44.709172 30849 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:26:44.709187 30849 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:26:44.713753 30849 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:41843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:36259
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:36259
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30849
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:44.714720 30849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:44.715941 30849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:44.724061 30855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:44.724097 30854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:44.724063 30857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:44.724272 30849 server_base.cc:1034] running on GCE node
I20260809 09:26:44.724979 30849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:44.726024 30849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:44.727280 30849 hybrid_clock.cc:648] HybridClock initialized: now 1786267604727272 us; error 41 us; skew 500 ppm
I20260809 09:26:44.729133 30849 webserver.cc:460] Webserver started at http://127.11.99.254:36597/ using document root <none> and password file <none>
I20260809 09:26:44.729707 30849 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:44.729808 30849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:44.730084 30849 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:44.732086 30849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "14db3e043f46400ebabdcc43443f1445"
format_stamp: "Formatted at 2026-08-09 09:26:44 on dist-test-slave-pgkr"
server_key: "89a54a3a71eb94ed4557a0a309f300c1"
server_key_iv: "866370b875cf35286800a65b7f4ae74d"
server_key_version: "encryptionkey@0"
I20260809 09:26:44.732844 30849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "14db3e043f46400ebabdcc43443f1445"
format_stamp: "Formatted at 2026-08-09 09:26:44 on dist-test-slave-pgkr"
server_key: "89a54a3a71eb94ed4557a0a309f300c1"
server_key_iv: "866370b875cf35286800a65b7f4ae74d"
server_key_version: "encryptionkey@0"
I20260809 09:26:44.736352 30849 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:26:44.738737 30863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:44.739925 30849 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:26:44.740062 30849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "14db3e043f46400ebabdcc43443f1445"
format_stamp: "Formatted at 2026-08-09 09:26:44 on dist-test-slave-pgkr"
server_key: "89a54a3a71eb94ed4557a0a309f300c1"
server_key_iv: "866370b875cf35286800a65b7f4ae74d"
server_key_version: "encryptionkey@0"
I20260809 09:26:44.740175 30849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:44.757845 30849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:44.758504 30849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:44.758744 30849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:44.765851 30849 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:36259
I20260809 09:26:44.765859 30917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:36259 every 8 connection(s)
I20260809 09:26:44.766839 30849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:26:44.769794 30918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:44.773370 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 30849
I20260809 09:26:44.773527 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:26:44.773785 11663 external_mini_cluster.cc:1428] Setting key a38f60105bc1bec76f7d8a8923d92aeb
I20260809 09:26:44.775628 30918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14db3e043f46400ebabdcc43443f1445: Bootstrap starting.
I20260809 09:26:44.778173 30918 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 14db3e043f46400ebabdcc43443f1445: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:44.779042 30918 log.cc:824] T 00000000000000000000000000000000 P 14db3e043f46400ebabdcc43443f1445: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:44.780834 30918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14db3e043f46400ebabdcc43443f1445: No bootstrap required, opened a new log
I20260809 09:26:44.783370 30921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:44.775164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56764 (local address 127.11.99.254:36259)
0809 09:26:44.775806 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:44.775826 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:44.775869 (+ 43us) server_negotiation.cc:407] Connection header received
0809 09:26:44.776642 (+ 773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:44.776667 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:44.777167 (+ 500us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:44.777488 (+ 321us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:44.777919 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.779375 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.780237 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:44.780695 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:44.780880 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:44.781765 (+ 885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:44.781770 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:44.781780 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:26:44.782124 (+ 344us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:44.782174 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:26:44.782193 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:44.782299 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:44.782460 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 09:26:44.782741 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":103,"threads_started":1}
I20260809 09:26:44.784240 30918 raft_consensus.cc:348] T 00000000000000000000000000000000 P 14db3e043f46400ebabdcc43443f1445 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14db3e043f46400ebabdcc43443f1445" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 36259 } }
I20260809 09:26:44.784456 30918 raft_consensus.cc:374] T 00000000000000000000000000000000 P 14db3e043f46400ebabdcc43443f1445 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:44.784530 30918 raft_consensus.cc:729] T 00000000000000000000000000000000 P 14db3e043f46400ebabdcc43443f1445 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14db3e043f46400ebabdcc43443f1445, State: Initialized, Role: FOLLOWER
I20260809 09:26:44.784961 30918 consensus_queue.cc:260] T 00000000000000000000000000000000 P 14db3e043f46400ebabdcc43443f1445 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14db3e043f46400ebabdcc43443f1445" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 36259 } }
I20260809 09:26:44.785104 30918 raft_consensus.cc:388] T 00000000000000000000000000000000 P 14db3e043f46400ebabdcc43443f1445 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:26:44.785166 30918 raft_consensus.cc:482] T 00000000000000000000000000000000 P 14db3e043f46400ebabdcc43443f1445 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:26:44.785261 30918 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 14db3e043f46400ebabdcc43443f1445 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:44.786003 30918 raft_consensus.cc:504] T 00000000000000000000000000000000 P 14db3e043f46400ebabdcc43443f1445 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14db3e043f46400ebabdcc43443f1445" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 36259 } }
I20260809 09:26:44.786262 30918 leader_election.cc:302] T 00000000000000000000000000000000 P 14db3e043f46400ebabdcc43443f1445 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 14db3e043f46400ebabdcc43443f1445; no voters:
I20260809 09:26:44.786468 30918 leader_election.cc:288] T 00000000000000000000000000000000 P 14db3e043f46400ebabdcc43443f1445 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:26:44.786594 30923 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 14db3e043f46400ebabdcc43443f1445 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:26:44.786849 30923 raft_consensus.cc:686] T 00000000000000000000000000000000 P 14db3e043f46400ebabdcc43443f1445 [term 1 LEADER]: Becoming Leader. State: Replica: 14db3e043f46400ebabdcc43443f1445, State: Running, Role: LEADER
I20260809 09:26:44.787173 30923 consensus_queue.cc:237] T 00000000000000000000000000000000 P 14db3e043f46400ebabdcc43443f1445 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14db3e043f46400ebabdcc43443f1445" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 36259 } }
I20260809 09:26:44.787552 30918 sys_catalog.cc:564] T 00000000000000000000000000000000 P 14db3e043f46400ebabdcc43443f1445 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:26:44.788748 30925 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14db3e043f46400ebabdcc43443f1445 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 14db3e043f46400ebabdcc43443f1445. Latest consensus state: current_term: 1 leader_uuid: "14db3e043f46400ebabdcc43443f1445" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14db3e043f46400ebabdcc43443f1445" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 36259 } } }
I20260809 09:26:44.788897 30925 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14db3e043f46400ebabdcc43443f1445 [sys.catalog]: This master's current role is: LEADER
I20260809 09:26:44.789216 30924 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14db3e043f46400ebabdcc43443f1445 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "14db3e043f46400ebabdcc43443f1445" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14db3e043f46400ebabdcc43443f1445" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 36259 } } }
I20260809 09:26:44.789288 30932 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:26:44.789316 30924 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14db3e043f46400ebabdcc43443f1445 [sys.catalog]: This master's current role is: LEADER
I20260809 09:26:44.792146 30932 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:26:44.797075 30932 catalog_manager.cc:1347] Generated new cluster ID: 3c2ffffeac2b4bd4820a4d01b7220fed
I20260809 09:26:44.797137 30932 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:26:44.810859 30932 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:26:44.811635 30932 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:26:44.822017 30932 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 14db3e043f46400ebabdcc43443f1445: Generated new TSK 0
I20260809 09:26:44.822691 30932 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:26:44.834807 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:0
--local_ip_for_outbound_sockets=127.11.99.193
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:36259
--builtin_ntp_servers=127.11.99.212:41843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 09:26:44.945330 30942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:44.945601 30942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:44.945639 30942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:44.949731 30942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:44.949785 30942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:44.949841 30942 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:26:44.954512 30942 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:41843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:36259
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30942
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:44.955509 30942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:44.956784 30942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:44.965989 30947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:44.966012 30948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:44.966042 30951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:44.966307 30942 server_base.cc:1034] running on GCE node
I20260809 09:26:44.966789 30942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:44.967411 30942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:44.968567 30942 hybrid_clock.cc:648] HybridClock initialized: now 1786267604968549 us; error 29 us; skew 500 ppm
I20260809 09:26:44.970204 30942 webserver.cc:460] Webserver started at http://127.11.99.193:43541/ using document root <none> and password file <none>
I20260809 09:26:44.970880 30942 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:44.970943 30942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:44.971167 30942 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:44.973104 30942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-0/data/instance:
uuid: "ab54980feef24a85b19bfe84be02711c"
format_stamp: "Formatted at 2026-08-09 09:26:44 on dist-test-slave-pgkr"
server_key: "c8d51e3cfb7a2373395a484d5cd1a528"
server_key_iv: "080a4e4f8d6340e55be556072eb39e9a"
server_key_version: "encryptionkey@0"
I20260809 09:26:44.973629 30942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance:
uuid: "ab54980feef24a85b19bfe84be02711c"
format_stamp: "Formatted at 2026-08-09 09:26:44 on dist-test-slave-pgkr"
server_key: "c8d51e3cfb7a2373395a484d5cd1a528"
server_key_iv: "080a4e4f8d6340e55be556072eb39e9a"
server_key_version: "encryptionkey@0"
I20260809 09:26:44.977125 30942 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 09:26:44.979363 30957 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:44.980458 30942 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:26:44.980587 30942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "ab54980feef24a85b19bfe84be02711c"
format_stamp: "Formatted at 2026-08-09 09:26:44 on dist-test-slave-pgkr"
server_key: "c8d51e3cfb7a2373395a484d5cd1a528"
server_key_iv: "080a4e4f8d6340e55be556072eb39e9a"
server_key_version: "encryptionkey@0"
I20260809 09:26:44.980690 30942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:45.006894 30942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:45.007539 30942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:45.007735 30942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:45.008270 30942 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:26:45.009166 30942 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:26:45.009241 30942 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:45.009307 30942 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:26:45.009361 30942 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:45.018064 30942 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:32825
I20260809 09:26:45.018105 31075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:32825 every 8 connection(s)
I20260809 09:26:45.018908 30942 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:26:45.021664 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 30942
I20260809 09:26:45.021797 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance
I20260809 09:26:45.022046 11663 external_mini_cluster.cc:1428] Setting key e2ff3416d15009591370626776fb8f02
I20260809 09:26:45.024029 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:0
--local_ip_for_outbound_sockets=127.11.99.194
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:36259
--builtin_ntp_servers=127.11.99.212:41843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 09:26:45.028702 30921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:45.020536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:56125 (local address 127.11.99.254:36259)
0809 09:26:45.020675 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:45.020679 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:45.021623 (+ 944us) server_negotiation.cc:407] Connection header received
0809 09:26:45.023198 (+ 1575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:45.023200 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:45.023243 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:45.023339 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:45.024320 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.025148 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.026685 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.026909 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.026992 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:45.028240 (+ 1248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:45.028243 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:45.028245 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:26:45.028256 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:45.028274 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:26:45.028281 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:45.028332 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:45.028550 (+ 218us) server_negotiation.cc:299] Negotiation successful
0809 09:26:45.028598 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 09:26:45.029891 31078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:45.020890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:36259 (local address 127.11.99.193:56125)
0809 09:26:45.021472 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:45.021509 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:45.022996 (+ 1487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:45.023533 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:45.023542 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:45.023647 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:26:45.024101 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:45.024113 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.025267 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.025269 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:45.026507 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:45.026519 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.027064 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.027071 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:45.027290 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:45.027926 (+ 636us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 09:26:45.027930 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:26:45.027981 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 09:26:45.028087 (+ 106us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:26:45.028364 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:26:45.028375 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:26:45.028384 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 09:26:45.028540 (+ 156us) client_negotiation.cc:240] Negotiation successful
0809 09:26:45.028833 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":119,"threads_started":1}
I20260809 09:26:45.031117 31076 heartbeater.cc:347] Connected to a master server at 127.11.99.254:36259
I20260809 09:26:45.031349 31076 heartbeater.cc:464] Registering TS with master...
I20260809 09:26:45.031841 31076 heartbeater.cc:511] Master 127.11.99.254:36259 requested a full tablet report, sending...
I20260809 09:26:45.033427 30881 ts_manager.cc:194] Registered new tserver with Master: ab54980feef24a85b19bfe84be02711c (127.11.99.193:32825)
I20260809 09:26:45.035218 30881 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.99.193:56125
W20260809 09:26:45.132251 31079 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:45.132462 31079 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:45.132496 31079 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:45.136404 31079 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:45.136447 31079 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:45.136497 31079 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:26:45.140735 31079 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:41843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:36259
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31079
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:45.141544 31079 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:45.142701 31079 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:45.151409 31087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:45.151424 31084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:45.151424 31085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:45.151664 31079 server_base.cc:1034] running on GCE node
I20260809 09:26:45.152079 31079 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:45.152637 31079 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:45.153789 31079 hybrid_clock.cc:648] HybridClock initialized: now 1786267605153765 us; error 35 us; skew 500 ppm
I20260809 09:26:45.155380 31079 webserver.cc:460] Webserver started at http://127.11.99.194:40663/ using document root <none> and password file <none>
I20260809 09:26:45.155876 31079 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:45.155932 31079 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:45.156162 31079 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:45.157897 31079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-1/data/instance:
uuid: "aa9875d81bd143a58ce6fad9bc8f94a5"
format_stamp: "Formatted at 2026-08-09 09:26:45 on dist-test-slave-pgkr"
server_key: "ef54b290c5caf683fb7c4b467f7a5641"
server_key_iv: "8ef3c22331345dcbf93d04467660d3a7"
server_key_version: "encryptionkey@0"
I20260809 09:26:45.158416 31079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance:
uuid: "aa9875d81bd143a58ce6fad9bc8f94a5"
format_stamp: "Formatted at 2026-08-09 09:26:45 on dist-test-slave-pgkr"
server_key: "ef54b290c5caf683fb7c4b467f7a5641"
server_key_iv: "8ef3c22331345dcbf93d04467660d3a7"
server_key_version: "encryptionkey@0"
I20260809 09:26:45.161651 31079 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s
I20260809 09:26:45.163837 31094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:45.164891 31079 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 09:26:45.165016 31079 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "aa9875d81bd143a58ce6fad9bc8f94a5"
format_stamp: "Formatted at 2026-08-09 09:26:45 on dist-test-slave-pgkr"
server_key: "ef54b290c5caf683fb7c4b467f7a5641"
server_key_iv: "8ef3c22331345dcbf93d04467660d3a7"
server_key_version: "encryptionkey@0"
I20260809 09:26:45.165127 31079 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:45.190862 31079 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:45.191423 31079 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:45.191613 31079 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:45.192107 31079 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:26:45.192919 31079 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:26:45.192986 31079 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:45.193058 31079 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:26:45.193099 31079 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:45.201458 31079 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:36153
I20260809 09:26:45.201545 31214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:36153 every 8 connection(s)
I20260809 09:26:45.202312 31079 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:26:45.210954 30921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:45.204010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:38331 (local address 127.11.99.254:36259)
0809 09:26:45.204152 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:45.204156 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:45.205072 (+ 916us) server_negotiation.cc:407] Connection header received
0809 09:26:45.206469 (+ 1397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:45.206473 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:45.206530 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:45.206606 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:45.207428 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.207952 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.208993 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.209224 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.209342 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:45.210403 (+ 1061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:45.210407 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:45.210410 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:26:45.210435 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:45.210453 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:26:45.210461 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:45.210541 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:45.210744 (+ 203us) server_negotiation.cc:299] Negotiation successful
0809 09:26:45.210816 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 09:26:45.211804 31217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:45.204355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:36259 (local address 127.11.99.194:38331)
0809 09:26:45.204933 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:45.204969 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:45.206271 (+ 1302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:45.206779 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:45.206785 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:45.206857 (+ 72us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:26:45.207288 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:45.207300 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.208077 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.208080 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:45.208870 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:45.208879 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.209374 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.209379 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:45.209537 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:45.210130 (+ 593us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 09:26:45.210131 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:26:45.210166 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 09:26:45.210222 (+ 56us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:26:45.210543 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:26:45.210555 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:26:45.210564 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 09:26:45.210736 (+ 172us) client_negotiation.cc:240] Negotiation successful
0809 09:26:45.210990 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":112,"threads_started":1}
I20260809 09:26:45.211812 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 31079
I20260809 09:26:45.211930 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance
I20260809 09:26:45.212252 11663 external_mini_cluster.cc:1428] Setting key c57e98baefe0dca9d156616c55507c6b
I20260809 09:26:45.212955 31215 heartbeater.cc:347] Connected to a master server at 127.11.99.254:36259
I20260809 09:26:45.213193 31215 heartbeater.cc:464] Registering TS with master...
I20260809 09:26:45.213755 31215 heartbeater.cc:511] Master 127.11.99.254:36259 requested a full tablet report, sending...
I20260809 09:26:45.214334 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:0
--local_ip_for_outbound_sockets=127.11.99.195
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:36259
--builtin_ntp_servers=127.11.99.212:41843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 09:26:45.214856 30881 ts_manager.cc:194] Registered new tserver with Master: aa9875d81bd143a58ce6fad9bc8f94a5 (127.11.99.194:36153)
I20260809 09:26:45.215607 30881 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.99.194:38331
W20260809 09:26:45.325138 31218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:45.325384 31218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:45.325448 31218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:45.329154 31218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:45.329221 31218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:45.329319 31218 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:26:45.333940 31218 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:41843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:36259
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31218
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:45.334920 31218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:45.336081 31218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:45.344810 31226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:45.344866 31224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:45.344839 31223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:45.344951 31218 server_base.cc:1034] running on GCE node
I20260809 09:26:45.345404 31218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:45.346051 31218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:45.347234 31218 hybrid_clock.cc:648] HybridClock initialized: now 1786267605347213 us; error 28 us; skew 500 ppm
I20260809 09:26:45.349017 31218 webserver.cc:460] Webserver started at http://127.11.99.195:45693/ using document root <none> and password file <none>
I20260809 09:26:45.349536 31218 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:45.349625 31218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:45.349850 31218 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:45.351877 31218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-2/data/instance:
uuid: "334333b52912481ba2371c88b7a982b5"
format_stamp: "Formatted at 2026-08-09 09:26:45 on dist-test-slave-pgkr"
server_key: "dca2aa0f16c1923d83511486787abab3"
server_key_iv: "1dee44f13c4a0956f5e04b6339f42c72"
server_key_version: "encryptionkey@0"
I20260809 09:26:45.352452 31218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance:
uuid: "334333b52912481ba2371c88b7a982b5"
format_stamp: "Formatted at 2026-08-09 09:26:45 on dist-test-slave-pgkr"
server_key: "dca2aa0f16c1923d83511486787abab3"
server_key_iv: "1dee44f13c4a0956f5e04b6339f42c72"
server_key_version: "encryptionkey@0"
I20260809 09:26:45.355847 31218 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 09:26:45.358198 31232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:45.359356 31218 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:26:45.359491 31218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "334333b52912481ba2371c88b7a982b5"
format_stamp: "Formatted at 2026-08-09 09:26:45 on dist-test-slave-pgkr"
server_key: "dca2aa0f16c1923d83511486787abab3"
server_key_iv: "1dee44f13c4a0956f5e04b6339f42c72"
server_key_version: "encryptionkey@0"
I20260809 09:26:45.359601 31218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:45.373952 31218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:45.374590 31218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:45.374810 31218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:45.375358 31218 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:26:45.376274 31218 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:26:45.376350 31218 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:45.376422 31218 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:26:45.376467 31218 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:45.385378 31218 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:45753
I20260809 09:26:45.385402 31352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:45753 every 8 connection(s)
I20260809 09:26:45.386206 31218 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:26:45.391173 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 31218
I20260809 09:26:45.391287 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance
I20260809 09:26:45.391582 11663 external_mini_cluster.cc:1428] Setting key f68880253cebb817a97b3eac52509099
I20260809 09:26:45.395399 30921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:45.387997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:33093 (local address 127.11.99.254:36259)
0809 09:26:45.388161 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:45.388167 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:45.389197 (+ 1030us) server_negotiation.cc:407] Connection header received
0809 09:26:45.390511 (+ 1314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:45.390513 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:45.390562 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:45.390702 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:45.391756 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.392490 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.393627 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.393879 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.393961 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:45.395018 (+ 1057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:45.395020 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:45.395022 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:26:45.395033 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:45.395050 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:26:45.395057 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:45.395114 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:45.395250 (+ 136us) server_negotiation.cc:299] Negotiation successful
0809 09:26:45.395296 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 09:26:45.396221 31355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:45.388396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:36259 (local address 127.11.99.195:33093)
0809 09:26:45.388997 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:45.389036 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:45.390317 (+ 1281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:45.390832 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:45.390838 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:45.390940 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:26:45.391602 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:45.391622 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.392619 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.392622 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:45.393511 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:45.393521 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.394018 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.394021 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:45.394158 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:45.394795 (+ 637us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 09:26:45.394796 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:26:45.394834 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 09:26:45.394890 (+ 56us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:26:45.395129 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:26:45.395135 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:26:45.395139 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 09:26:45.395225 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 09:26:45.395415 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":112,"threads_started":1}
I20260809 09:26:45.397253 31353 heartbeater.cc:347] Connected to a master server at 127.11.99.254:36259
I20260809 09:26:45.397460 31353 heartbeater.cc:464] Registering TS with master...
I20260809 09:26:45.397948 31353 heartbeater.cc:511] Master 127.11.99.254:36259 requested a full tablet report, sending...
I20260809 09:26:45.398953 30881 ts_manager.cc:194] Registered new tserver with Master: 334333b52912481ba2371c88b7a982b5 (127.11.99.195:45753)
I20260809 09:26:45.399513 30881 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.99.195:33093
I20260809 09:26:45.405185 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 09:26:45.410351 30921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:45.407088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35760 (local address 127.11.99.254:36259)
0809 09:26:45.407203 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:45.407206 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:45.407375 (+ 169us) server_negotiation.cc:407] Connection header received
0809 09:26:45.407446 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:45.407447 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:45.407497 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:45.407571 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:45.407806 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.408252 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.408993 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.409327 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.409406 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:45.410048 (+ 642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:45.410052 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:45.410054 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:26:45.410064 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:45.410081 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:26:45.410088 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:45.410143 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:45.410214 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 09:26:45.410255 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 09:26:45.412997 30881 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35760:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 09:26:45.415931 30881 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:26:45.429734 31365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:45.423790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:36153 (local address 127.0.0.1:39480)
0809 09:26:45.424161 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:45.424211 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:45.424355 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:45.425154 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:45.425159 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:45.425182 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:45.425334 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:45.425339 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.426916 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.426920 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:45.428162 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:45.428172 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.429207 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.429213 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:45.429313 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:45.429348 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 09:26:45.429463 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 09:26:45.429573 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"mutex_wait_us":50,"thread_start_us":112,"threads_started":1}
I20260809 09:26:45.429798 31366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:45.423929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39480 (local address 127.11.99.194:36153)
0809 09:26:45.424672 (+ 743us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:45.424684 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:45.424707 (+ 23us) server_negotiation.cc:407] Connection header received
0809 09:26:45.424783 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:45.424789 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:45.424979 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:45.425458 (+ 479us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:45.425559 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.426798 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.428286 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.429079 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.429183 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:45.429354 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:45.429500 (+ 146us) server_negotiation.cc:299] Negotiation successful
0809 09:26:45.429607 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":627,"thread_start_us":152,"threads_started":1}
I20260809 09:26:45.430195 31369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:45.424567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44056 (local address 127.11.99.195:45753)
0809 09:26:45.425296 (+ 729us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:45.425308 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:45.425328 (+ 20us) server_negotiation.cc:407] Connection header received
0809 09:26:45.425395 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:45.425399 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:45.425563 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:45.425736 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:45.425999 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.426818 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.428380 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.429072 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.429183 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:45.429354 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:45.429991 (+ 637us) server_negotiation.cc:299] Negotiation successful
0809 09:26:45.430084 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":638,"thread_start_us":83,"threads_started":1}
I20260809 09:26:45.430192 31368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:45.424511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:32825 (local address 127.0.0.1:53304)
0809 09:26:45.424944 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:45.424958 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:45.425066 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:45.425886 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:45.425890 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:45.425907 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:45.426033 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:45.426044 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.427464 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.427467 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:45.428487 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:45.428494 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.429499 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.429502 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:45.429612 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:45.429635 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 09:26:45.429700 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 09:26:45.430075 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":371,"mutex_wait_us":299,"thread_start_us":79,"threads_started":1}
I20260809 09:26:45.430694 31370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:45.424888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53304 (local address 127.11.99.193:32825)
0809 09:26:45.425296 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:45.425308 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:45.425329 (+ 21us) server_negotiation.cc:407] Connection header received
0809 09:26:45.425395 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:45.425399 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:45.425574 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:45.425736 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:45.426175 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.427330 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.428606 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.429113 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.429251 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:45.429437 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:45.429802 (+ 365us) server_negotiation.cc:299] Negotiation successful
0809 09:26:45.430492 (+ 690us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":135,"threads_started":1}
I20260809 09:26:45.431028 31367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:45.424035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:45753 (local address 127.0.0.1:44056)
0809 09:26:45.424349 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:45.424361 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:45.424585 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:45.425745 (+ 1160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:45.425748 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:45.425767 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:45.425853 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:45.425860 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.426954 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.426957 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:45.428262 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:45.428273 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.429460 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.429464 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:45.429560 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:45.429628 (+ 68us) client_negotiation.cc:769] Sending connection context
0809 09:26:45.429701 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 09:26:45.429795 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":74,"thread_start_us":107,"threads_started":1}
I20260809 09:26:45.432636 31145 tablet_service.cc:1467] Processing CreateTablet for tablet f57a710053244d8a87679c1e55810ab6 (DEFAULT_TABLE table=test-table [id=4227cb40843641b7b724c4c38dd67903]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:26:45.433578 31145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f57a710053244d8a87679c1e55810ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:45.433624 31008 tablet_service.cc:1467] Processing CreateTablet for tablet f57a710053244d8a87679c1e55810ab6 (DEFAULT_TABLE table=test-table [id=4227cb40843641b7b724c4c38dd67903]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:26:45.433624 31282 tablet_service.cc:1467] Processing CreateTablet for tablet f57a710053244d8a87679c1e55810ab6 (DEFAULT_TABLE table=test-table [id=4227cb40843641b7b724c4c38dd67903]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:26:45.434684 31008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f57a710053244d8a87679c1e55810ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:45.434684 31282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f57a710053244d8a87679c1e55810ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:45.439608 31371 tablet_bootstrap.cc:492] T f57a710053244d8a87679c1e55810ab6 P aa9875d81bd143a58ce6fad9bc8f94a5: Bootstrap starting.
I20260809 09:26:45.441409 31373 tablet_bootstrap.cc:492] T f57a710053244d8a87679c1e55810ab6 P ab54980feef24a85b19bfe84be02711c: Bootstrap starting.
I20260809 09:26:45.441854 31371 tablet_bootstrap.cc:654] T f57a710053244d8a87679c1e55810ab6 P aa9875d81bd143a58ce6fad9bc8f94a5: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:45.442242 31374 tablet_bootstrap.cc:492] T f57a710053244d8a87679c1e55810ab6 P 334333b52912481ba2371c88b7a982b5: Bootstrap starting.
I20260809 09:26:45.442811 31371 log.cc:824] T f57a710053244d8a87679c1e55810ab6 P aa9875d81bd143a58ce6fad9bc8f94a5: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:45.443459 31373 tablet_bootstrap.cc:654] T f57a710053244d8a87679c1e55810ab6 P ab54980feef24a85b19bfe84be02711c: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:45.444262 31374 tablet_bootstrap.cc:654] T f57a710053244d8a87679c1e55810ab6 P 334333b52912481ba2371c88b7a982b5: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:45.444310 31373 log.cc:824] T f57a710053244d8a87679c1e55810ab6 P ab54980feef24a85b19bfe84be02711c: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:45.445019 31371 tablet_bootstrap.cc:492] T f57a710053244d8a87679c1e55810ab6 P aa9875d81bd143a58ce6fad9bc8f94a5: No bootstrap required, opened a new log
I20260809 09:26:45.445001 31374 log.cc:824] T f57a710053244d8a87679c1e55810ab6 P 334333b52912481ba2371c88b7a982b5: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:45.445232 31371 ts_tablet_manager.cc:1397] T f57a710053244d8a87679c1e55810ab6 P aa9875d81bd143a58ce6fad9bc8f94a5: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 09:26:45.446365 31373 tablet_bootstrap.cc:492] T f57a710053244d8a87679c1e55810ab6 P ab54980feef24a85b19bfe84be02711c: No bootstrap required, opened a new log
I20260809 09:26:45.446537 31373 ts_tablet_manager.cc:1397] T f57a710053244d8a87679c1e55810ab6 P ab54980feef24a85b19bfe84be02711c: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 09:26:45.446717 31374 tablet_bootstrap.cc:492] T f57a710053244d8a87679c1e55810ab6 P 334333b52912481ba2371c88b7a982b5: No bootstrap required, opened a new log
I20260809 09:26:45.446909 31374 ts_tablet_manager.cc:1397] T f57a710053244d8a87679c1e55810ab6 P 334333b52912481ba2371c88b7a982b5: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 09:26:45.449730 31371 raft_consensus.cc:348] T f57a710053244d8a87679c1e55810ab6 P aa9875d81bd143a58ce6fad9bc8f94a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa9875d81bd143a58ce6fad9bc8f94a5" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 36153 } } peers { permanent_uuid: "ab54980feef24a85b19bfe84be02711c" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 32825 } } peers { permanent_uuid: "334333b52912481ba2371c88b7a982b5" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 45753 } }
I20260809 09:26:45.449986 31371 raft_consensus.cc:374] T f57a710053244d8a87679c1e55810ab6 P aa9875d81bd143a58ce6fad9bc8f94a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:45.450039 31371 raft_consensus.cc:729] T f57a710053244d8a87679c1e55810ab6 P aa9875d81bd143a58ce6fad9bc8f94a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa9875d81bd143a58ce6fad9bc8f94a5, State: Initialized, Role: FOLLOWER
I20260809 09:26:45.450106 31374 raft_consensus.cc:348] T f57a710053244d8a87679c1e55810ab6 P 334333b52912481ba2371c88b7a982b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa9875d81bd143a58ce6fad9bc8f94a5" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 36153 } } peers { permanent_uuid: "ab54980feef24a85b19bfe84be02711c" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 32825 } } peers { permanent_uuid: "334333b52912481ba2371c88b7a982b5" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 45753 } }
I20260809 09:26:45.450350 31374 raft_consensus.cc:374] T f57a710053244d8a87679c1e55810ab6 P 334333b52912481ba2371c88b7a982b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:45.450407 31374 raft_consensus.cc:729] T f57a710053244d8a87679c1e55810ab6 P 334333b52912481ba2371c88b7a982b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 334333b52912481ba2371c88b7a982b5, State: Initialized, Role: FOLLOWER
I20260809 09:26:45.450450 31371 consensus_queue.cc:260] T f57a710053244d8a87679c1e55810ab6 P aa9875d81bd143a58ce6fad9bc8f94a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa9875d81bd143a58ce6fad9bc8f94a5" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 36153 } } peers { permanent_uuid: "ab54980feef24a85b19bfe84be02711c" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 32825 } } peers { permanent_uuid: "334333b52912481ba2371c88b7a982b5" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 45753 } }
I20260809 09:26:45.450416 31373 raft_consensus.cc:348] T f57a710053244d8a87679c1e55810ab6 P ab54980feef24a85b19bfe84be02711c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa9875d81bd143a58ce6fad9bc8f94a5" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 36153 } } peers { permanent_uuid: "ab54980feef24a85b19bfe84be02711c" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 32825 } } peers { permanent_uuid: "334333b52912481ba2371c88b7a982b5" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 45753 } }
I20260809 09:26:45.450692 31373 raft_consensus.cc:374] T f57a710053244d8a87679c1e55810ab6 P ab54980feef24a85b19bfe84be02711c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:45.450762 31373 raft_consensus.cc:729] T f57a710053244d8a87679c1e55810ab6 P ab54980feef24a85b19bfe84be02711c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab54980feef24a85b19bfe84be02711c, State: Initialized, Role: FOLLOWER
I20260809 09:26:45.450911 31374 consensus_queue.cc:260] T f57a710053244d8a87679c1e55810ab6 P 334333b52912481ba2371c88b7a982b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa9875d81bd143a58ce6fad9bc8f94a5" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 36153 } } peers { permanent_uuid: "ab54980feef24a85b19bfe84be02711c" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 32825 } } peers { permanent_uuid: "334333b52912481ba2371c88b7a982b5" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 45753 } }
I20260809 09:26:45.451186 31373 consensus_queue.cc:260] T f57a710053244d8a87679c1e55810ab6 P ab54980feef24a85b19bfe84be02711c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa9875d81bd143a58ce6fad9bc8f94a5" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 36153 } } peers { permanent_uuid: "ab54980feef24a85b19bfe84be02711c" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 32825 } } peers { permanent_uuid: "334333b52912481ba2371c88b7a982b5" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 45753 } }
I20260809 09:26:45.451385 31379 raft_consensus.cc:482] T f57a710053244d8a87679c1e55810ab6 P ab54980feef24a85b19bfe84be02711c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:26:45.451470 31371 ts_tablet_manager.cc:1428] T f57a710053244d8a87679c1e55810ab6 P aa9875d81bd143a58ce6fad9bc8f94a5: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 09:26:45.451599 31379 raft_consensus.cc:504] T f57a710053244d8a87679c1e55810ab6 P ab54980feef24a85b19bfe84be02711c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa9875d81bd143a58ce6fad9bc8f94a5" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 36153 } } peers { permanent_uuid: "ab54980feef24a85b19bfe84be02711c" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 32825 } } peers { permanent_uuid: "334333b52912481ba2371c88b7a982b5" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 45753 } }
I20260809 09:26:45.451797 31215 heartbeater.cc:503] Master 127.11.99.254:36259 was elected leader, sending a full tablet report...
I20260809 09:26:45.451819 31374 ts_tablet_manager.cc:1428] T f57a710053244d8a87679c1e55810ab6 P 334333b52912481ba2371c88b7a982b5: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260809 09:26:45.452034 31373 ts_tablet_manager.cc:1428] T f57a710053244d8a87679c1e55810ab6 P ab54980feef24a85b19bfe84be02711c: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 09:26:45.452102 31353 heartbeater.cc:503] Master 127.11.99.254:36259 was elected leader, sending a full tablet report...
I20260809 09:26:45.452338 31076 heartbeater.cc:503] Master 127.11.99.254:36259 was elected leader, sending a full tablet report...
I20260809 09:26:45.453002 31379 leader_election.cc:288] T f57a710053244d8a87679c1e55810ab6 P ab54980feef24a85b19bfe84be02711c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa9875d81bd143a58ce6fad9bc8f94a5 (127.11.99.194:36153), 334333b52912481ba2371c88b7a982b5 (127.11.99.195:45753)
W20260809 09:26:45.453266 31216 tablet.cc:2369] T f57a710053244d8a87679c1e55810ab6 P aa9875d81bd143a58ce6fad9bc8f94a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:26:45.458452 31369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:45.454248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:51371 (local address 127.11.99.195:45753)
0809 09:26:45.454362 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:45.454368 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:45.454385 (+ 17us) server_negotiation.cc:407] Connection header received
0809 09:26:45.454441 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:45.454446 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:45.454487 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:45.454558 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:45.454996 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.455720 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.457346 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.457935 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.458040 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:45.458084 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:45.458314 (+ 230us) server_negotiation.cc:299] Negotiation successful
0809 09:26:45.458368 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 09:26:45.458472 31078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:45.453449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:45753 (local address 127.11.99.193:51371)
0809 09:26:45.453937 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:45.453951 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:45.454025 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:45.454721 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:45.454734 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:45.454752 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:45.454862 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:45.454872 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.456129 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.456153 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:45.457211 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:45.457220 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.458044 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.458056 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:45.458153 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:45.458202 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 09:26:45.458280 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 09:26:45.458346 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418,"mutex_wait_us":20,"thread_start_us":92,"threads_started":1}
I20260809 09:26:45.459154 31302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f57a710053244d8a87679c1e55810ab6" candidate_uuid: "ab54980feef24a85b19bfe84be02711c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "334333b52912481ba2371c88b7a982b5" is_pre_election: true
I20260809 09:26:45.459295 31366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:45.454725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:33403 (local address 127.11.99.194:36153)
0809 09:26:45.454956 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:45.454962 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:45.454975 (+ 13us) server_negotiation.cc:407] Connection header received
0809 09:26:45.455013 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:45.455015 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:45.455054 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:45.455118 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:45.455464 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.456063 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.458216 (+ 2153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.458820 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.458932 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:45.458976 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:45.459154 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 09:26:45.459201 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144}
I20260809 09:26:45.459395 31302 raft_consensus.cc:2454] T f57a710053244d8a87679c1e55810ab6 P 334333b52912481ba2371c88b7a982b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab54980feef24a85b19bfe84be02711c in term 0.
I20260809 09:26:45.459445 31382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:45.453170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:36153 (local address 127.11.99.193:33403)
0809 09:26:45.453679 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:45.453697 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:45.453811 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:45.455214 (+ 1403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:45.455217 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:45.455246 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:45.455346 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:45.455351 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.456196 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.456199 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:45.458084 (+ 1885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:45.458095 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.458946 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.458949 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:45.459043 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:45.459065 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 09:26:45.459144 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 09:26:45.459212 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":438,"mutex_wait_us":3}
I20260809 09:26:45.459805 30960 leader_election.cc:302] T f57a710053244d8a87679c1e55810ab6 P ab54980feef24a85b19bfe84be02711c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 334333b52912481ba2371c88b7a982b5, ab54980feef24a85b19bfe84be02711c; no voters:
I20260809 09:26:45.459928 31167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f57a710053244d8a87679c1e55810ab6" candidate_uuid: "ab54980feef24a85b19bfe84be02711c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa9875d81bd143a58ce6fad9bc8f94a5" is_pre_election: true
I20260809 09:26:45.460067 31381 raft_consensus.cc:2781] T f57a710053244d8a87679c1e55810ab6 P ab54980feef24a85b19bfe84be02711c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:26:45.460151 31381 raft_consensus.cc:482] T f57a710053244d8a87679c1e55810ab6 P ab54980feef24a85b19bfe84be02711c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:26:45.460203 31381 raft_consensus.cc:3037] T f57a710053244d8a87679c1e55810ab6 P ab54980feef24a85b19bfe84be02711c [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:45.460188 31167 raft_consensus.cc:2454] T f57a710053244d8a87679c1e55810ab6 P aa9875d81bd143a58ce6fad9bc8f94a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab54980feef24a85b19bfe84be02711c in term 0.
I20260809 09:26:45.461177 31381 raft_consensus.cc:504] T f57a710053244d8a87679c1e55810ab6 P ab54980feef24a85b19bfe84be02711c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa9875d81bd143a58ce6fad9bc8f94a5" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 36153 } } peers { permanent_uuid: "ab54980feef24a85b19bfe84be02711c" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 32825 } } peers { permanent_uuid: "334333b52912481ba2371c88b7a982b5" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 45753 } }
I20260809 09:26:45.461464 31381 leader_election.cc:288] T f57a710053244d8a87679c1e55810ab6 P ab54980feef24a85b19bfe84be02711c [CANDIDATE]: Term 1 election: Requested vote from peers aa9875d81bd143a58ce6fad9bc8f94a5 (127.11.99.194:36153), 334333b52912481ba2371c88b7a982b5 (127.11.99.195:45753)
I20260809 09:26:45.461741 31167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f57a710053244d8a87679c1e55810ab6" candidate_uuid: "ab54980feef24a85b19bfe84be02711c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa9875d81bd143a58ce6fad9bc8f94a5"
I20260809 09:26:45.461833 31302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f57a710053244d8a87679c1e55810ab6" candidate_uuid: "ab54980feef24a85b19bfe84be02711c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "334333b52912481ba2371c88b7a982b5"
I20260809 09:26:45.461839 31167 raft_consensus.cc:3037] T f57a710053244d8a87679c1e55810ab6 P aa9875d81bd143a58ce6fad9bc8f94a5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:45.461941 31302 raft_consensus.cc:3037] T f57a710053244d8a87679c1e55810ab6 P 334333b52912481ba2371c88b7a982b5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:45.462881 31167 raft_consensus.cc:2454] T f57a710053244d8a87679c1e55810ab6 P aa9875d81bd143a58ce6fad9bc8f94a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab54980feef24a85b19bfe84be02711c in term 1.
I20260809 09:26:45.463025 31302 raft_consensus.cc:2454] T f57a710053244d8a87679c1e55810ab6 P 334333b52912481ba2371c88b7a982b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab54980feef24a85b19bfe84be02711c in term 1.
I20260809 09:26:45.463181 30961 leader_election.cc:302] T f57a710053244d8a87679c1e55810ab6 P ab54980feef24a85b19bfe84be02711c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa9875d81bd143a58ce6fad9bc8f94a5, ab54980feef24a85b19bfe84be02711c; no voters:
I20260809 09:26:45.463333 31381 raft_consensus.cc:2781] T f57a710053244d8a87679c1e55810ab6 P ab54980feef24a85b19bfe84be02711c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:26:45.463449 31381 raft_consensus.cc:686] T f57a710053244d8a87679c1e55810ab6 P ab54980feef24a85b19bfe84be02711c [term 1 LEADER]: Becoming Leader. State: Replica: ab54980feef24a85b19bfe84be02711c, State: Running, Role: LEADER
I20260809 09:26:45.463721 31381 consensus_queue.cc:237] T f57a710053244d8a87679c1e55810ab6 P ab54980feef24a85b19bfe84be02711c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa9875d81bd143a58ce6fad9bc8f94a5" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 36153 } } peers { permanent_uuid: "ab54980feef24a85b19bfe84be02711c" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 32825 } } peers { permanent_uuid: "334333b52912481ba2371c88b7a982b5" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 45753 } }
I20260809 09:26:45.466779 30881 catalog_manager.cc:5495] T f57a710053244d8a87679c1e55810ab6 P ab54980feef24a85b19bfe84be02711c reported cstate change: term changed from 0 to 1, leader changed from <none> to ab54980feef24a85b19bfe84be02711c (127.11.99.193). New cstate: current_term: 1 leader_uuid: "ab54980feef24a85b19bfe84be02711c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa9875d81bd143a58ce6fad9bc8f94a5" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 36153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab54980feef24a85b19bfe84be02711c" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 32825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "334333b52912481ba2371c88b7a982b5" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 45753 } health_report { overall_health: UNKNOWN } } }
I20260809 09:26:45.483103 31370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:45.479470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53306 (local address 127.11.99.193:32825)
0809 09:26:45.479607 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:45.479613 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:45.479629 (+ 16us) server_negotiation.cc:407] Connection header received
0809 09:26:45.479800 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:45.479804 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:45.479867 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:45.479973 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:26:45.480258 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.480803 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.481666 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:45.481885 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:45.481994 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:45.482294 (+ 300us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:26:45.482715 (+ 421us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:26:45.482840 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:45.482901 (+ 61us) server_negotiation.cc:299] Negotiation successful
0809 09:26:45.482951 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 09:26:45.488144 31302 raft_consensus.cc:1261] T f57a710053244d8a87679c1e55810ab6 P 334333b52912481ba2371c88b7a982b5 [term 1 FOLLOWER]: Refusing update from remote peer ab54980feef24a85b19bfe84be02711c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:26:45.488132 31167 raft_consensus.cc:1261] T f57a710053244d8a87679c1e55810ab6 P aa9875d81bd143a58ce6fad9bc8f94a5 [term 1 FOLLOWER]: Refusing update from remote peer ab54980feef24a85b19bfe84be02711c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:26:45.488883 31381 consensus_queue.cc:1035] T f57a710053244d8a87679c1e55810ab6 P ab54980feef24a85b19bfe84be02711c [LEADER]: Connected to new peer: Peer: permanent_uuid: "334333b52912481ba2371c88b7a982b5" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 45753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:26:45.489073 31379 consensus_queue.cc:1035] T f57a710053244d8a87679c1e55810ab6 P ab54980feef24a85b19bfe84be02711c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa9875d81bd143a58ce6fad9bc8f94a5" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 36153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:26:45.494540 31385 mvcc.cc:205] Tried to move back new op lower bound from 7316552112072982528 to 7316552111981985792. Current Snapshot: MvccSnapshot[applied={T|T < 7316552112072982528}]
I20260809 09:26:45.496027 31386 mvcc.cc:205] Tried to move back new op lower bound from 7316552112072982528 to 7316552111981985792. Current Snapshot: MvccSnapshot[applied={T|T < 7316552112072982528}]
I20260809 09:26:45.497522 31387 mvcc.cc:205] Tried to move back new op lower bound from 7316552112072982528 to 7316552111981985792. Current Snapshot: MvccSnapshot[applied={T|T < 7316552112072982528}]
I20260809 09:26:45.502857 30880 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35760:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:26:45.503013 30880 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35760:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:26:45.505350 30880 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 14db3e043f46400ebabdcc43443f1445: Sending DeleteTablet for 3 replicas of tablet f57a710053244d8a87679c1e55810ab6
I20260809 09:26:45.506052 31282 tablet_service.cc:1514] Processing DeleteTablet for tablet f57a710053244d8a87679c1e55810ab6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:26:45 UTC) from {username='slave'} at 127.0.0.1:44056
I20260809 09:26:45.506244 31008 tablet_service.cc:1514] Processing DeleteTablet for tablet f57a710053244d8a87679c1e55810ab6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:26:45 UTC) from {username='slave'} at 127.0.0.1:53304
I20260809 09:26:45.506487 31145 tablet_service.cc:1514] Processing DeleteTablet for tablet f57a710053244d8a87679c1e55810ab6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:26:45 UTC) from {username='slave'} at 127.0.0.1:39480
I20260809 09:26:45.506819 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 30942
I20260809 09:26:45.507330 31397 tablet_replica.cc:330] T f57a710053244d8a87679c1e55810ab6 P aa9875d81bd143a58ce6fad9bc8f94a5: stopping tablet replica
I20260809 09:26:45.507613 31397 raft_consensus.cc:2229] T f57a710053244d8a87679c1e55810ab6 P aa9875d81bd143a58ce6fad9bc8f94a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:26:45.507954 31397 raft_consensus.cc:2258] T f57a710053244d8a87679c1e55810ab6 P aa9875d81bd143a58ce6fad9bc8f94a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:26:45.509869 31394 tablet_replica.cc:330] T f57a710053244d8a87679c1e55810ab6 P 334333b52912481ba2371c88b7a982b5: stopping tablet replica
I20260809 09:26:45.510123 31394 raft_consensus.cc:2229] T f57a710053244d8a87679c1e55810ab6 P 334333b52912481ba2371c88b7a982b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:26:45.510382 31394 raft_consensus.cc:2258] T f57a710053244d8a87679c1e55810ab6 P 334333b52912481ba2371c88b7a982b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:26:45.510426 31397 ts_tablet_manager.cc:1905] T f57a710053244d8a87679c1e55810ab6 P aa9875d81bd143a58ce6fad9bc8f94a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:26:45.511626 31394 ts_tablet_manager.cc:1905] T f57a710053244d8a87679c1e55810ab6 P 334333b52912481ba2371c88b7a982b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:26:45.513120 31397 ts_tablet_manager.cc:1918] T f57a710053244d8a87679c1e55810ab6 P aa9875d81bd143a58ce6fad9bc8f94a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:26:45.513216 31397 log.cc:1196] T f57a710053244d8a87679c1e55810ab6 P aa9875d81bd143a58ce6fad9bc8f94a5: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/f57a710053244d8a87679c1e55810ab6
I20260809 09:26:45.513520 31397 ts_tablet_manager.cc:1939] T f57a710053244d8a87679c1e55810ab6 P aa9875d81bd143a58ce6fad9bc8f94a5: Deleting consensus metadata
I20260809 09:26:45.514218 31394 ts_tablet_manager.cc:1918] T f57a710053244d8a87679c1e55810ab6 P 334333b52912481ba2371c88b7a982b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:26:45.514305 31394 log.cc:1196] T f57a710053244d8a87679c1e55810ab6 P 334333b52912481ba2371c88b7a982b5: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/f57a710053244d8a87679c1e55810ab6
I20260809 09:26:45.514600 31394 ts_tablet_manager.cc:1939] T f57a710053244d8a87679c1e55810ab6 P 334333b52912481ba2371c88b7a982b5: Deleting consensus metadata
I20260809 09:26:45.514678 30868 catalog_manager.cc:4841] TS aa9875d81bd143a58ce6fad9bc8f94a5 (127.11.99.194:36153): tablet f57a710053244d8a87679c1e55810ab6 (table test-table [id=4227cb40843641b7b724c4c38dd67903]) successfully deleted
I20260809 09:26:45.515489 30867 catalog_manager.cc:4841] TS 334333b52912481ba2371c88b7a982b5 (127.11.99.195:45753): tablet f57a710053244d8a87679c1e55810ab6 (table test-table [id=4227cb40843641b7b724c4c38dd67903]) successfully deleted
W20260809 09:26:45.516357 30868 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.99.193:32825 (error 108)
I20260809 09:26:45.516489 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 31079
I20260809 09:26:45.517910 31367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:45.517642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:32825 (local address 127.0.0.1:53316)
0809 09:26:45.517794 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:45.517848 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.193:32825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
W20260809 09:26:45.518044 30868 catalog_manager.cc:4584] TS ab54980feef24a85b19bfe84be02711c (127.11.99.193:32825): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f57a710053244d8a87679c1e55810ab6: Network error: Client connection negotiation failed: client connection to 127.11.99.193:32825: connect: Connection refused (error 111)
I20260809 09:26:45.523840 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 31218
I20260809 09:26:45.530539 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 30849
2026-08-09T09:26:45Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (963 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:26:45 dist-test-slave-pgkr krb5kdc[31402](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:26:45 dist-test-slave-pgkr krb5kdc[31402](info): set up 2 sockets
Aug 09 09:26:45 dist-test-slave-pgkr krb5kdc[31402](info): commencing operation
krb5kdc: starting...
W20260809 09:26:46.572777 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.020s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:26:46 dist-test-slave-pgkr krb5kdc[31402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:26:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:26:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:26:46.685559 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:45721
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:32935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:45721
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:26:46.787087 31416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:46.787308 31416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:46.787344 31416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:46.791190 31416 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:26:46.791236 31416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:46.791255 31416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:46.791271 31416 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:26:46.791335 31416 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:26:46.796217 31416 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:32935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:45721
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:45721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:46.797035 31416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:46.797883 31416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:46.805680 31424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:46.805774 31416 server_base.cc:1034] running on GCE node
W20260809 09:26:46.805694 31422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:46.805704 31421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:46.806341 31416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:46.807302 31416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:46.808461 31416 hybrid_clock.cc:648] HybridClock initialized: now 1786267606808439 us; error 41 us; skew 500 ppm
Aug 09 09:26:46 dist-test-slave-pgkr krb5kdc[31402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267606, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:26:46.811053 31416 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:26:46.811856 31416 webserver.cc:460] Webserver started at http://127.11.99.254:37975/ using document root <none> and password file <none>
I20260809 09:26:46.812474 31416 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:46.812556 31416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:46.812768 31416 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:46.814590 31416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "57eb8abfbe5b4a91b08bca750b5c26f5"
format_stamp: "Formatted at 2026-08-09 09:26:46 on dist-test-slave-pgkr"
server_key: "e0edf9522a832552a787557535b9d5e5"
server_key_iv: "ab9d4e6d6c150572efc595a05608e098"
server_key_version: "encryptionkey@0"
I20260809 09:26:46.815179 31416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "57eb8abfbe5b4a91b08bca750b5c26f5"
format_stamp: "Formatted at 2026-08-09 09:26:46 on dist-test-slave-pgkr"
server_key: "e0edf9522a832552a787557535b9d5e5"
server_key_iv: "ab9d4e6d6c150572efc595a05608e098"
server_key_version: "encryptionkey@0"
I20260809 09:26:46.818534 31416 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 09:26:46.820777 31431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:46.821897 31416 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:26:46.822032 31416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "57eb8abfbe5b4a91b08bca750b5c26f5"
format_stamp: "Formatted at 2026-08-09 09:26:46 on dist-test-slave-pgkr"
server_key: "e0edf9522a832552a787557535b9d5e5"
server_key_iv: "ab9d4e6d6c150572efc595a05608e098"
server_key_version: "encryptionkey@0"
I20260809 09:26:46.822135 31416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:46.843037 31416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:46.845552 31416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:46.845752 31416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:46.852371 31416 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:45721
I20260809 09:26:46.852396 31485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:45721 every 8 connection(s)
I20260809 09:26:46.853291 31416 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:26:46.855696 31486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:46.860782 31486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57eb8abfbe5b4a91b08bca750b5c26f5: Bootstrap starting.
I20260809 09:26:46.861047 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 31416
I20260809 09:26:46.861195 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:26:46.861471 11663 external_mini_cluster.cc:1428] Setting key cac7d37800a90f788dad7f5f1f93ffcf
I20260809 09:26:46.863271 31486 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57eb8abfbe5b4a91b08bca750b5c26f5: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:46.863996 31486 log.cc:824] T 00000000000000000000000000000000 P 57eb8abfbe5b4a91b08bca750b5c26f5: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:46.865710 31486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57eb8abfbe5b4a91b08bca750b5c26f5: No bootstrap required, opened a new log
I20260809 09:26:46.868821 31486 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57eb8abfbe5b4a91b08bca750b5c26f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57eb8abfbe5b4a91b08bca750b5c26f5" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 45721 } }
I20260809 09:26:46.869035 31486 raft_consensus.cc:374] T 00000000000000000000000000000000 P 57eb8abfbe5b4a91b08bca750b5c26f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:46.869117 31486 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57eb8abfbe5b4a91b08bca750b5c26f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57eb8abfbe5b4a91b08bca750b5c26f5, State: Initialized, Role: FOLLOWER
I20260809 09:26:46.869522 31486 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57eb8abfbe5b4a91b08bca750b5c26f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57eb8abfbe5b4a91b08bca750b5c26f5" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 45721 } }
I20260809 09:26:46.869665 31486 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57eb8abfbe5b4a91b08bca750b5c26f5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:26:46.869757 31486 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57eb8abfbe5b4a91b08bca750b5c26f5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:26:46.869872 31486 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57eb8abfbe5b4a91b08bca750b5c26f5 [term 0 FOLLOWER]: Advancing to term 1
Aug 09 09:26:46 dist-test-slave-pgkr krb5kdc[31402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:26:46.870791 31486 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57eb8abfbe5b4a91b08bca750b5c26f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57eb8abfbe5b4a91b08bca750b5c26f5" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 45721 } }
I20260809 09:26:46.871111 31486 leader_election.cc:302] T 00000000000000000000000000000000 P 57eb8abfbe5b4a91b08bca750b5c26f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57eb8abfbe5b4a91b08bca750b5c26f5; no voters:
I20260809 09:26:46.871433 31486 leader_election.cc:288] T 00000000000000000000000000000000 P 57eb8abfbe5b4a91b08bca750b5c26f5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:26:46.871542 31492 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57eb8abfbe5b4a91b08bca750b5c26f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:26:46.871716 31492 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57eb8abfbe5b4a91b08bca750b5c26f5 [term 1 LEADER]: Becoming Leader. State: Replica: 57eb8abfbe5b4a91b08bca750b5c26f5, State: Running, Role: LEADER
I20260809 09:26:46.871985 31492 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57eb8abfbe5b4a91b08bca750b5c26f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57eb8abfbe5b4a91b08bca750b5c26f5" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 45721 } }
I20260809 09:26:46.872605 31486 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57eb8abfbe5b4a91b08bca750b5c26f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:26:46.873306 31494 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57eb8abfbe5b4a91b08bca750b5c26f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57eb8abfbe5b4a91b08bca750b5c26f5. Latest consensus state: current_term: 1 leader_uuid: "57eb8abfbe5b4a91b08bca750b5c26f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57eb8abfbe5b4a91b08bca750b5c26f5" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 45721 } } }
I20260809 09:26:46.873471 31494 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57eb8abfbe5b4a91b08bca750b5c26f5 [sys.catalog]: This master's current role is: LEADER
I20260809 09:26:46.873805 31493 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57eb8abfbe5b4a91b08bca750b5c26f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57eb8abfbe5b4a91b08bca750b5c26f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57eb8abfbe5b4a91b08bca750b5c26f5" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 45721 } } }
I20260809 09:26:46.873951 31493 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57eb8abfbe5b4a91b08bca750b5c26f5 [sys.catalog]: This master's current role is: LEADER
I20260809 09:26:46.874256 31501 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:26:46.876332 31489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:46.862777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60492 (local address 127.11.99.254:45721)
0809 09:26:46.863163 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:46.863178 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:46.863210 (+ 32us) server_negotiation.cc:407] Connection header received
0809 09:26:46.864082 (+ 872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:46.864098 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:46.864442 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:46.864772 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:46.865578 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:46.866474 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:46.867353 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:46.867806 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:46.867976 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:46.870595 (+ 2619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:46.870601 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:46.870645 (+ 44us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:46.870678 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:46.872626 (+ 1948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:46.873185 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:46.873191 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:46.873197 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:46.873339 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:46.873740 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:46.873745 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:46.873747 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:46.874270 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:46.874479 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:46.875113 (+ 634us) server_negotiation.cc:299] Negotiation successful
0809 09:26:46.875415 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":128,"threads_started":1}
I20260809 09:26:46.877791 31501 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:26:46.883488 31501 catalog_manager.cc:1347] Generated new cluster ID: 76b0f16061f5473f99dea5b6c0c855ee
I20260809 09:26:46.883575 31501 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:26:46.891659 31501 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:26:46.892491 31501 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:26:46.898398 31501 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 57eb8abfbe5b4a91b08bca750b5c26f5: Generated new TSK 0
I20260809 09:26:46.898973 31501 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.99.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
I20260809 09:26:46.930292 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:0
--local_ip_for_outbound_sockets=127.11.99.193
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:45721
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:32935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:26:47.050289 31513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:47.050508 31513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:47.050547 31513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:47.054380 31513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:47.054427 31513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:47.054476 31513 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:26:47.059386 31513 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:32935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:45721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31513
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:47.060218 31513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:47.061076 31513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:47.070037 31519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:47.070070 31513 server_base.cc:1034] running on GCE node
W20260809 09:26:47.070025 31521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:47.070022 31518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:47.070576 31513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:47.071269 31513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:47.072446 31513 hybrid_clock.cc:648] HybridClock initialized: now 1786267607072434 us; error 23 us; skew 500 ppm
Aug 09 09:26:47 dist-test-slave-pgkr krb5kdc[31402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267607, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:26:47.075218 31513 init.cc:377] Logged in from keytab as kudu/127.11.99.193@KRBTEST.COM (short username kudu)
I20260809 09:26:47.075971 31513 webserver.cc:460] Webserver started at http://127.11.99.193:35249/ using document root <none> and password file <none>
I20260809 09:26:47.076459 31513 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:47.076543 31513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:47.076763 31513 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:47.078504 31513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-0/data/instance:
uuid: "87b9251784264551997ddc5e6655d6bd"
format_stamp: "Formatted at 2026-08-09 09:26:47 on dist-test-slave-pgkr"
server_key: "2496dac99b506faee893759555da6fb4"
server_key_iv: "194d2d24e0056fad57a8000fc82be4ee"
server_key_version: "encryptionkey@0"
I20260809 09:26:47.079077 31513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance:
uuid: "87b9251784264551997ddc5e6655d6bd"
format_stamp: "Formatted at 2026-08-09 09:26:47 on dist-test-slave-pgkr"
server_key: "2496dac99b506faee893759555da6fb4"
server_key_iv: "194d2d24e0056fad57a8000fc82be4ee"
server_key_version: "encryptionkey@0"
I20260809 09:26:47.082324 31513 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 09:26:47.084481 31528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:47.085495 31513 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:26:47.085618 31513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "87b9251784264551997ddc5e6655d6bd"
format_stamp: "Formatted at 2026-08-09 09:26:47 on dist-test-slave-pgkr"
server_key: "2496dac99b506faee893759555da6fb4"
server_key_iv: "194d2d24e0056fad57a8000fc82be4ee"
server_key_version: "encryptionkey@0"
I20260809 09:26:47.085714 31513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:47.105536 31513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:47.108212 31513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:47.108385 31513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:47.108876 31513 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:26:47.109624 31513 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:26:47.109669 31513 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:47.109732 31513 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:26:47.109762 31513 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:47.117827 31513 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:45333
I20260809 09:26:47.117851 31649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:45333 every 8 connection(s)
I20260809 09:26:47.118577 31513 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:26:47.126539 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 31513
I20260809 09:26:47.126703 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance
I20260809 09:26:47.127071 11663 external_mini_cluster.cc:1428] Setting key 0ebcf0e3b17a4584c2b95fbf7ff0459e
Aug 09 09:26:47 dist-test-slave-pgkr krb5kdc[31402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267607, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:26:47.131697 31489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:47.120116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:33103 (local address 127.11.99.254:45721)
0809 09:26:47.120254 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:47.120257 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:47.120966 (+ 709us) server_negotiation.cc:407] Connection header received
0809 09:26:47.122194 (+ 1228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:47.122197 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:47.122255 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:47.122357 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:47.123421 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.123941 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.125068 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.125331 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.125455 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:47.128037 (+ 2582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:47.128040 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:47.128042 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:47.128065 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:47.129513 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:47.130080 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:47.130082 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:47.130083 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:47.130153 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:47.130531 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:47.130534 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:47.130537 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:47.130852 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:47.130958 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:47.131366 (+ 408us) server_negotiation.cc:299] Negotiation successful
0809 09:26:47.131510 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 09:26:47.132227 31652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:47.120413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:45721 (local address 127.11.99.193:33103)
0809 09:26:47.120824 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:47.120863 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:47.121987 (+ 1124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:47.122508 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:47.122515 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:47.122867 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:26:47.123278 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:47.123291 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.124069 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.124073 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:47.124924 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:47.124935 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.125489 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.125493 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:47.125649 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:47.126155 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:26:47.126170 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:26:47.127874 (+ 1704us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:26:47.129625 (+ 1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:47.129632 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:47.129647 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:47.129981 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:47.130233 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:47.130238 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:47.130243 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:47.130416 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:47.130952 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:26:47.130957 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:26:47.131152 (+ 195us) client_negotiation.cc:769] Sending connection context
0809 09:26:47.131288 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 09:26:47.131496 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":122,"threads_started":1}
I20260809 09:26:47.133421 31650 heartbeater.cc:347] Connected to a master server at 127.11.99.254:45721
I20260809 09:26:47.133668 31650 heartbeater.cc:464] Registering TS with master...
I20260809 09:26:47.134212 31650 heartbeater.cc:511] Master 127.11.99.254:45721 requested a full tablet report, sending...
I20260809 09:26:47.135964 31448 ts_manager.cc:194] Registered new tserver with Master: 87b9251784264551997ddc5e6655d6bd (127.11.99.193:45333)
I20260809 09:26:47.137526 31448 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.193@KRBTEST.COM'} at 127.11.99.193:33103
WARNING: no policy specified for kudu/127.11.99.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
I20260809 09:26:47.153509 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:0
--local_ip_for_outbound_sockets=127.11.99.194
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:45721
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:32935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:26:47.258474 31655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:47.258736 31655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:47.258797 31655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:47.262588 31655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:47.262679 31655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:47.262753 31655 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:26:47.267867 31655 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:32935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:45721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31655
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:47.268755 31655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:47.269632 31655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:47.278900 31664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:47.278901 31662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:47.278918 31661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:47.279170 31655 server_base.cc:1034] running on GCE node
I20260809 09:26:47.279589 31655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:47.280119 31655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:47.281288 31655 hybrid_clock.cc:648] HybridClock initialized: now 1786267607281258 us; error 43 us; skew 500 ppm
Aug 09 09:26:47 dist-test-slave-pgkr krb5kdc[31402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267607, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:26:47.283995 31655 init.cc:377] Logged in from keytab as kudu/127.11.99.194@KRBTEST.COM (short username kudu)
I20260809 09:26:47.284713 31655 webserver.cc:460] Webserver started at http://127.11.99.194:45583/ using document root <none> and password file <none>
I20260809 09:26:47.285189 31655 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:47.285245 31655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:47.285393 31655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:47.287293 31655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-1/data/instance:
uuid: "77914c7778cb4245bafed833c3fcb7fa"
format_stamp: "Formatted at 2026-08-09 09:26:47 on dist-test-slave-pgkr"
server_key: "1aa7389ff609d9ced3c9bc235ef1e6d4"
server_key_iv: "098f356883f6b8cc2e2ca50e4edfba51"
server_key_version: "encryptionkey@0"
I20260809 09:26:47.287814 31655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance:
uuid: "77914c7778cb4245bafed833c3fcb7fa"
format_stamp: "Formatted at 2026-08-09 09:26:47 on dist-test-slave-pgkr"
server_key: "1aa7389ff609d9ced3c9bc235ef1e6d4"
server_key_iv: "098f356883f6b8cc2e2ca50e4edfba51"
server_key_version: "encryptionkey@0"
I20260809 09:26:47.291433 31655 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 09:26:47.293567 31671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:47.294739 31655 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 09:26:47.294827 31655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "77914c7778cb4245bafed833c3fcb7fa"
format_stamp: "Formatted at 2026-08-09 09:26:47 on dist-test-slave-pgkr"
server_key: "1aa7389ff609d9ced3c9bc235ef1e6d4"
server_key_iv: "098f356883f6b8cc2e2ca50e4edfba51"
server_key_version: "encryptionkey@0"
I20260809 09:26:47.294903 31655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:47.306851 31655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:47.309484 31655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:47.309608 31655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:47.310015 31655 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:26:47.310765 31655 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:26:47.310812 31655 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:47.310847 31655 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:26:47.310870 31655 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:47.318845 31655 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:42357
I20260809 09:26:47.318861 31788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:42357 every 8 connection(s)
I20260809 09:26:47.319589 31655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:26:47.329087 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 31655
I20260809 09:26:47.329207 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance
I20260809 09:26:47.329440 11663 external_mini_cluster.cc:1428] Setting key 308d12b5dc23f3e4f9e3960974dbccfe
Aug 09 09:26:47 dist-test-slave-pgkr krb5kdc[31402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267607, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:26:47.335955 31489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:47.321255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:36587 (local address 127.11.99.254:45721)
0809 09:26:47.321377 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:47.321382 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:47.322060 (+ 678us) server_negotiation.cc:407] Connection header received
0809 09:26:47.323230 (+ 1170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:47.323233 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:47.323281 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:47.323353 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:47.324348 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.324909 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.326052 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.326267 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.326361 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:47.332361 (+ 6000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:47.332366 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:47.332372 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:47.332403 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:47.333769 (+ 1366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:47.334290 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:47.334297 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:47.334302 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:47.334405 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:47.334798 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:47.334804 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:47.334809 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:47.335055 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:47.335162 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:47.335601 (+ 439us) server_negotiation.cc:299] Negotiation successful
0809 09:26:47.335745 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 09:26:47.336517 31791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:47.321519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:45721 (local address 127.11.99.194:36587)
0809 09:26:47.321910 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:47.321945 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:47.323024 (+ 1079us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:47.323489 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:47.323495 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:47.323807 (+ 312us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:26:47.324222 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:47.324235 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.325010 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.325013 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:47.325954 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:47.325963 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.326414 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.326417 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:47.326545 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:47.330816 (+ 4271us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:26:47.330831 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:26:47.332185 (+ 1354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:26:47.333890 (+ 1705us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:47.333894 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:47.333904 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:47.334176 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:47.334511 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:47.334514 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:47.334516 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:47.334701 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:47.335156 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:26:47.335160 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:26:47.335352 (+ 192us) client_negotiation.cc:769] Sending connection context
0809 09:26:47.335483 (+ 131us) client_negotiation.cc:240] Negotiation successful
0809 09:26:47.335762 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":99,"threads_started":1}
I20260809 09:26:47.337631 31789 heartbeater.cc:347] Connected to a master server at 127.11.99.254:45721
I20260809 09:26:47.337877 31789 heartbeater.cc:464] Registering TS with master...
I20260809 09:26:47.338397 31789 heartbeater.cc:511] Master 127.11.99.254:45721 requested a full tablet report, sending...
I20260809 09:26:47.339556 31448 ts_manager.cc:194] Registered new tserver with Master: 77914c7778cb4245bafed833c3fcb7fa (127.11.99.194:42357)
WARNING: no policy specified for kudu/127.11.99.195@KRBTEST.COM; defaulting to no policy
I20260809 09:26:47.340195 31448 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.194@KRBTEST.COM'} at 127.11.99.194:36587
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
I20260809 09:26:47.355675 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:0
--local_ip_for_outbound_sockets=127.11.99.195
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:45721
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:32935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:26:47.459102 31794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:47.459307 31794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:47.459342 31794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:47.462759 31794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:47.462800 31794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:47.462910 31794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:26:47.467582 31794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:32935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:45721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:47.468443 31794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:47.469310 31794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:47.478153 31799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:47.478145 31800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:47.478145 31802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:47.478211 31794 server_base.cc:1034] running on GCE node
I20260809 09:26:47.478866 31794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:47.479389 31794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:47.480557 31794 hybrid_clock.cc:648] HybridClock initialized: now 1786267607480540 us; error 30 us; skew 500 ppm
Aug 09 09:26:47 dist-test-slave-pgkr krb5kdc[31402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267607, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:26:47.483101 31794 init.cc:377] Logged in from keytab as kudu/127.11.99.195@KRBTEST.COM (short username kudu)
I20260809 09:26:47.483789 31794 webserver.cc:460] Webserver started at http://127.11.99.195:35425/ using document root <none> and password file <none>
I20260809 09:26:47.484258 31794 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:47.484311 31794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:47.484452 31794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:47.486122 31794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-2/data/instance:
uuid: "12f5bf47c0c643cea0ee4e64b21f7a5a"
format_stamp: "Formatted at 2026-08-09 09:26:47 on dist-test-slave-pgkr"
server_key: "88bee7be2d246e5a785147831970d8e0"
server_key_iv: "97e70feb04265cf01756554073b3a25b"
server_key_version: "encryptionkey@0"
I20260809 09:26:47.486572 31794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance:
uuid: "12f5bf47c0c643cea0ee4e64b21f7a5a"
format_stamp: "Formatted at 2026-08-09 09:26:47 on dist-test-slave-pgkr"
server_key: "88bee7be2d246e5a785147831970d8e0"
server_key_iv: "97e70feb04265cf01756554073b3a25b"
server_key_version: "encryptionkey@0"
I20260809 09:26:47.490017 31794 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s
I20260809 09:26:47.492202 31809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:47.493281 31794 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 09:26:47.493394 31794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "12f5bf47c0c643cea0ee4e64b21f7a5a"
format_stamp: "Formatted at 2026-08-09 09:26:47 on dist-test-slave-pgkr"
server_key: "88bee7be2d246e5a785147831970d8e0"
server_key_iv: "97e70feb04265cf01756554073b3a25b"
server_key_version: "encryptionkey@0"
I20260809 09:26:47.493487 31794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:47.520908 31794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:47.523911 31794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:47.524098 31794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:47.524658 31794 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:26:47.525494 31794 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:26:47.525547 31794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:47.525583 31794 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:26:47.525635 31794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:47.533993 31794 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:35405
I20260809 09:26:47.534014 31925 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:35405 every 8 connection(s)
I20260809 09:26:47.534862 31794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:26:47.541049 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 31794
I20260809 09:26:47.541178 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance
I20260809 09:26:47.541438 11663 external_mini_cluster.cc:1428] Setting key a294cd94070e4470527b6da9335af2ca
Aug 09 09:26:47 dist-test-slave-pgkr krb5kdc[31402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267607, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:26:47.547888 31489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:47.536532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:43713 (local address 127.11.99.254:45721)
0809 09:26:47.536667 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:47.536671 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:47.537364 (+ 693us) server_negotiation.cc:407] Connection header received
0809 09:26:47.538658 (+ 1294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:47.538662 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:47.538736 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:47.538841 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:47.539939 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.540432 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.541611 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.541939 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.542064 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:47.544652 (+ 2588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:47.544655 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:47.544657 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:47.544679 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:47.546201 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:47.546676 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:47.546678 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:47.546680 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:47.546755 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:47.547065 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:47.547067 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:47.547068 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:47.547226 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:47.547310 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:47.547699 (+ 389us) server_negotiation.cc:299] Negotiation successful
0809 09:26:47.547786 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 09:26:47.548552 31928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:47.536793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:45721 (local address 127.11.99.195:43713)
0809 09:26:47.537205 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:47.537252 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:47.538430 (+ 1178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:47.539003 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:47.539010 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:47.539327 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:26:47.539739 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:47.539750 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.540557 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.540562 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:47.541486 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:47.541495 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.542094 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.542098 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:47.542301 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:47.542985 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:26:47.543003 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:26:47.544507 (+ 1504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:26:47.546297 (+ 1790us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:47.546302 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:47.546311 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:47.546545 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:47.546853 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:47.546856 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:47.546857 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:47.546980 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:47.547336 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:26:47.547340 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:26:47.547526 (+ 186us) client_negotiation.cc:769] Sending connection context
0809 09:26:47.547655 (+ 129us) client_negotiation.cc:240] Negotiation successful
0809 09:26:47.547873 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":111,"threads_started":1}
I20260809 09:26:47.549554 31926 heartbeater.cc:347] Connected to a master server at 127.11.99.254:45721
I20260809 09:26:47.549762 31926 heartbeater.cc:464] Registering TS with master...
I20260809 09:26:47.550205 31926 heartbeater.cc:511] Master 127.11.99.254:45721 requested a full tablet report, sending...
I20260809 09:26:47.551177 31448 ts_manager.cc:194] Registered new tserver with Master: 12f5bf47c0c643cea0ee4e64b21f7a5a (127.11.99.195:35405)
I20260809 09:26:47.551751 31448 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.195@KRBTEST.COM'} at 127.11.99.195:43713
I20260809 09:26:47.555101 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 09:26:47.563570 31489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:47.556973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60502 (local address 127.11.99.254:45721)
0809 09:26:47.557075 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:47.557078 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:47.557262 (+ 184us) server_negotiation.cc:407] Connection header received
0809 09:26:47.557335 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:47.557337 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:47.557370 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:47.557425 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:47.557982 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.558424 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.559217 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.559414 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.559500 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:47.560927 (+ 1427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:47.560929 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:47.560931 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:47.560950 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:47.562078 (+ 1128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:47.562513 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:47.562515 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:47.562516 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:47.562582 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:47.562914 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:47.562916 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:47.562917 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:47.563085 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:47.563193 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:47.563402 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 09:26:47.563472 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 09:26:47.566210 31448 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60502:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 09:26:47.569134 31448 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:26:47.583325 31937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:47.577210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:35405 (local address 127.0.0.1:54262)
0809 09:26:47.577636 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:47.577650 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:47.577773 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:47.578995 (+ 1222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:47.578998 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:47.579016 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:47.579115 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:47.579122 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.580500 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.580503 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:47.581878 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:47.581887 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.582769 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.582772 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:47.582876 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:47.582909 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 09:26:47.583041 (+ 132us) client_negotiation.cc:240] Negotiation successful
0809 09:26:47.583154 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"mutex_wait_us":172,"spinlock_wait_cycles":28800,"thread_start_us":121,"threads_started":1}
I20260809 09:26:47.583519 31938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:47.577108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:45333 (local address 127.0.0.1:50416)
0809 09:26:47.577580 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:47.577629 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:47.577773 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:47.578598 (+ 825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:47.578604 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:47.578628 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:47.578842 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:47.578862 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.580500 (+ 1638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.580503 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:47.581918 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:47.581928 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.583057 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.583061 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:47.583153 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:47.583173 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 09:26:47.583257 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 09:26:47.583311 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"mutex_wait_us":107,"spinlock_wait_cycles":7040,"thread_start_us":78,"threads_started":1}
I20260809 09:26:47.583736 31940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:47.577839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:42357 (local address 127.0.0.1:57738)
0809 09:26:47.578554 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:47.578567 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:47.578716 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:47.579430 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:47.579433 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:47.579449 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:47.579530 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:47.579536 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.580477 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.580482 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:47.582082 (+ 1600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:47.582090 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.583320 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.583324 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:47.583419 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:47.583447 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 09:26:47.583532 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 09:26:47.583608 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":659,"mutex_wait_us":74,"spinlock_wait_cycles":4992,"thread_start_us":120,"threads_started":1}
I20260809 09:26:47.583958 31942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:47.578118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54262 (local address 127.11.99.195:35405)
0809 09:26:47.578502 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:47.578514 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:47.578534 (+ 20us) server_negotiation.cc:407] Connection header received
0809 09:26:47.578598 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:47.578603 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:47.578867 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:47.579007 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:47.579238 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.580345 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.582001 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.582578 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.582766 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:47.582910 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:47.583672 (+ 762us) server_negotiation.cc:299] Negotiation successful
0809 09:26:47.583813 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":106,"threads_started":1}
I20260809 09:26:47.584148 31941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:47.578046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57738 (local address 127.11.99.194:42357)
0809 09:26:47.579034 (+ 988us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:47.579045 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:47.579066 (+ 21us) server_negotiation.cc:407] Connection header received
0809 09:26:47.579135 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:47.579140 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:47.579308 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:47.579451 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:47.579646 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.580352 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.582222 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.583042 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.583146 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:47.583258 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:47.583900 (+ 642us) server_negotiation.cc:299] Negotiation successful
0809 09:26:47.584002 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":875,"thread_start_us":119,"threads_started":1}
I20260809 09:26:47.584252 31939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:47.577247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50416 (local address 127.11.99.193:45333)
0809 09:26:47.578095 (+ 848us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:47.578106 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:47.578128 (+ 22us) server_negotiation.cc:407] Connection header received
0809 09:26:47.578209 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:47.578217 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:47.578419 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:47.579010 (+ 591us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:47.579163 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.580342 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.582056 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.582930 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.583048 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:47.583197 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:47.583294 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 09:26:47.583389 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":726,"thread_start_us":130,"threads_started":1}
I20260809 09:26:47.586436 31857 tablet_service.cc:1467] Processing CreateTablet for tablet 29c030755c1a4002a552da78ebe8ca23 (DEFAULT_TABLE table=test-table [id=1fe945625f5e45c28fb6f16a47294309]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:26:47.586649 31581 tablet_service.cc:1467] Processing CreateTablet for tablet 29c030755c1a4002a552da78ebe8ca23 (DEFAULT_TABLE table=test-table [id=1fe945625f5e45c28fb6f16a47294309]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:26:47.586644 31720 tablet_service.cc:1467] Processing CreateTablet for tablet 29c030755c1a4002a552da78ebe8ca23 (DEFAULT_TABLE table=test-table [id=1fe945625f5e45c28fb6f16a47294309]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:26:47.587458 31857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29c030755c1a4002a552da78ebe8ca23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:47.587585 31720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29c030755c1a4002a552da78ebe8ca23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:47.587585 31581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29c030755c1a4002a552da78ebe8ca23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:47.594070 31943 tablet_bootstrap.cc:492] T 29c030755c1a4002a552da78ebe8ca23 P 12f5bf47c0c643cea0ee4e64b21f7a5a: Bootstrap starting.
I20260809 09:26:47.595144 31944 tablet_bootstrap.cc:492] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd: Bootstrap starting.
I20260809 09:26:47.596149 31943 tablet_bootstrap.cc:654] T 29c030755c1a4002a552da78ebe8ca23 P 12f5bf47c0c643cea0ee4e64b21f7a5a: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:47.596760 31944 tablet_bootstrap.cc:654] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:47.597399 31943 log.cc:824] T 29c030755c1a4002a552da78ebe8ca23 P 12f5bf47c0c643cea0ee4e64b21f7a5a: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:47.597898 31944 log.cc:824] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:47.598052 31945 tablet_bootstrap.cc:492] T 29c030755c1a4002a552da78ebe8ca23 P 77914c7778cb4245bafed833c3fcb7fa: Bootstrap starting.
I20260809 09:26:47.599583 31943 tablet_bootstrap.cc:492] T 29c030755c1a4002a552da78ebe8ca23 P 12f5bf47c0c643cea0ee4e64b21f7a5a: No bootstrap required, opened a new log
I20260809 09:26:47.599682 31944 tablet_bootstrap.cc:492] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd: No bootstrap required, opened a new log
I20260809 09:26:47.599819 31943 ts_tablet_manager.cc:1397] T 29c030755c1a4002a552da78ebe8ca23 P 12f5bf47c0c643cea0ee4e64b21f7a5a: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 09:26:47.599865 31944 ts_tablet_manager.cc:1397] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 09:26:47.599997 31945 tablet_bootstrap.cc:654] T 29c030755c1a4002a552da78ebe8ca23 P 77914c7778cb4245bafed833c3fcb7fa: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:47.601153 31945 log.cc:824] T 29c030755c1a4002a552da78ebe8ca23 P 77914c7778cb4245bafed833c3fcb7fa: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:47.603062 31945 tablet_bootstrap.cc:492] T 29c030755c1a4002a552da78ebe8ca23 P 77914c7778cb4245bafed833c3fcb7fa: No bootstrap required, opened a new log
I20260809 09:26:47.602983 31944 raft_consensus.cc:348] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b9251784264551997ddc5e6655d6bd" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45333 } } peers { permanent_uuid: "12f5bf47c0c643cea0ee4e64b21f7a5a" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35405 } } peers { permanent_uuid: "77914c7778cb4245bafed833c3fcb7fa" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 42357 } }
I20260809 09:26:47.603217 31944 raft_consensus.cc:374] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:47.603233 31945 ts_tablet_manager.cc:1397] T 29c030755c1a4002a552da78ebe8ca23 P 77914c7778cb4245bafed833c3fcb7fa: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 09:26:47.603271 31944 raft_consensus.cc:729] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b9251784264551997ddc5e6655d6bd, State: Initialized, Role: FOLLOWER
I20260809 09:26:47.603703 31944 consensus_queue.cc:260] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b9251784264551997ddc5e6655d6bd" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45333 } } peers { permanent_uuid: "12f5bf47c0c643cea0ee4e64b21f7a5a" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35405 } } peers { permanent_uuid: "77914c7778cb4245bafed833c3fcb7fa" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 42357 } }
I20260809 09:26:47.603617 31943 raft_consensus.cc:348] T 29c030755c1a4002a552da78ebe8ca23 P 12f5bf47c0c643cea0ee4e64b21f7a5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b9251784264551997ddc5e6655d6bd" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45333 } } peers { permanent_uuid: "12f5bf47c0c643cea0ee4e64b21f7a5a" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35405 } } peers { permanent_uuid: "77914c7778cb4245bafed833c3fcb7fa" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 42357 } }
I20260809 09:26:47.603835 31943 raft_consensus.cc:374] T 29c030755c1a4002a552da78ebe8ca23 P 12f5bf47c0c643cea0ee4e64b21f7a5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:47.603895 31943 raft_consensus.cc:729] T 29c030755c1a4002a552da78ebe8ca23 P 12f5bf47c0c643cea0ee4e64b21f7a5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12f5bf47c0c643cea0ee4e64b21f7a5a, State: Initialized, Role: FOLLOWER
I20260809 09:26:47.604290 31650 heartbeater.cc:503] Master 127.11.99.254:45721 was elected leader, sending a full tablet report...
I20260809 09:26:47.604321 31943 consensus_queue.cc:260] T 29c030755c1a4002a552da78ebe8ca23 P 12f5bf47c0c643cea0ee4e64b21f7a5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b9251784264551997ddc5e6655d6bd" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45333 } } peers { permanent_uuid: "12f5bf47c0c643cea0ee4e64b21f7a5a" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35405 } } peers { permanent_uuid: "77914c7778cb4245bafed833c3fcb7fa" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 42357 } }
I20260809 09:26:47.604614 31944 ts_tablet_manager.cc:1428] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 09:26:47.605161 31943 ts_tablet_manager.cc:1428] T 29c030755c1a4002a552da78ebe8ca23 P 12f5bf47c0c643cea0ee4e64b21f7a5a: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 09:26:47.605497 31926 heartbeater.cc:503] Master 127.11.99.254:45721 was elected leader, sending a full tablet report...
I20260809 09:26:47.606586 31945 raft_consensus.cc:348] T 29c030755c1a4002a552da78ebe8ca23 P 77914c7778cb4245bafed833c3fcb7fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b9251784264551997ddc5e6655d6bd" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45333 } } peers { permanent_uuid: "12f5bf47c0c643cea0ee4e64b21f7a5a" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35405 } } peers { permanent_uuid: "77914c7778cb4245bafed833c3fcb7fa" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 42357 } }
I20260809 09:26:47.606841 31945 raft_consensus.cc:374] T 29c030755c1a4002a552da78ebe8ca23 P 77914c7778cb4245bafed833c3fcb7fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:47.606904 31945 raft_consensus.cc:729] T 29c030755c1a4002a552da78ebe8ca23 P 77914c7778cb4245bafed833c3fcb7fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77914c7778cb4245bafed833c3fcb7fa, State: Initialized, Role: FOLLOWER
I20260809 09:26:47.607285 31945 consensus_queue.cc:260] T 29c030755c1a4002a552da78ebe8ca23 P 77914c7778cb4245bafed833c3fcb7fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b9251784264551997ddc5e6655d6bd" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45333 } } peers { permanent_uuid: "12f5bf47c0c643cea0ee4e64b21f7a5a" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35405 } } peers { permanent_uuid: "77914c7778cb4245bafed833c3fcb7fa" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 42357 } }
I20260809 09:26:47.607993 31789 heartbeater.cc:503] Master 127.11.99.254:45721 was elected leader, sending a full tablet report...
I20260809 09:26:47.608170 31945 ts_tablet_manager.cc:1428] T 29c030755c1a4002a552da78ebe8ca23 P 77914c7778cb4245bafed833c3fcb7fa: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260809 09:26:47.619555 31651 tablet.cc:2369] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:26:47.661980 31950 raft_consensus.cc:482] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:26:47.662226 31950 raft_consensus.cc:504] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b9251784264551997ddc5e6655d6bd" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45333 } } peers { permanent_uuid: "12f5bf47c0c643cea0ee4e64b21f7a5a" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35405 } } peers { permanent_uuid: "77914c7778cb4245bafed833c3fcb7fa" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 42357 } }
I20260809 09:26:47.663432 31950 leader_election.cc:288] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 12f5bf47c0c643cea0ee4e64b21f7a5a (127.11.99.195:35405), 77914c7778cb4245bafed833c3fcb7fa (127.11.99.194:42357)
I20260809 09:26:47.668136 31942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:47.663783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:45745 (local address 127.11.99.195:35405)
0809 09:26:47.663926 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:47.663930 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:47.663945 (+ 15us) server_negotiation.cc:407] Connection header received
0809 09:26:47.664176 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:47.664180 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:47.664240 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:47.664330 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:47.664679 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.665430 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.667114 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.667497 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.667636 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:47.667687 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:47.667928 (+ 241us) server_negotiation.cc:299] Negotiation successful
0809 09:26:47.668009 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 09:26:47.668143 31941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:47.664147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:35745 (local address 127.11.99.194:42357)
0809 09:26:47.664278 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:47.664284 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:47.664429 (+ 145us) server_negotiation.cc:407] Connection header received
0809 09:26:47.664530 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:47.664532 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:47.664572 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:47.664674 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:47.664901 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.665575 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.667064 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.667504 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.667647 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:47.667698 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:47.667960 (+ 262us) server_negotiation.cc:299] Negotiation successful
0809 09:26:47.668027 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 09:26:47.668164 31953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:47.663636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:35405 (local address 127.11.99.193:45745)
0809 09:26:47.663886 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:47.663905 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:47.663998 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:47.664360 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:47.664366 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:47.664389 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:47.664556 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:47.664562 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.665541 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.665543 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:47.666932 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:47.666945 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.667625 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.667628 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:47.667743 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:47.667822 (+ 79us) client_negotiation.cc:769] Sending connection context
0809 09:26:47.667884 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 09:26:47.667990 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":100,"spinlock_wait_cycles":17024,"thread_start_us":83,"threads_started":1}
I20260809 09:26:47.668188 31954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:47.664004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:42357 (local address 127.11.99.193:35745)
0809 09:26:47.664333 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:47.664346 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:47.664448 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:47.664698 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:47.664704 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:47.664720 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:47.664801 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:47.664805 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.665680 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.665682 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:47.666932 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:47.666960 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.667671 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.667674 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:47.667796 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:47.667834 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 09:26:47.667926 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 09:26:47.668030 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"mutex_wait_us":91,"spinlock_wait_cycles":384,"thread_start_us":112,"threads_started":1}
I20260809 09:26:47.668887 31741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29c030755c1a4002a552da78ebe8ca23" candidate_uuid: "87b9251784264551997ddc5e6655d6bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77914c7778cb4245bafed833c3fcb7fa" is_pre_election: true
I20260809 09:26:47.668886 31878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29c030755c1a4002a552da78ebe8ca23" candidate_uuid: "87b9251784264551997ddc5e6655d6bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f5bf47c0c643cea0ee4e64b21f7a5a" is_pre_election: true
I20260809 09:26:47.669173 31741 raft_consensus.cc:2454] T 29c030755c1a4002a552da78ebe8ca23 P 77914c7778cb4245bafed833c3fcb7fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b9251784264551997ddc5e6655d6bd in term 0.
I20260809 09:26:47.669173 31878 raft_consensus.cc:2454] T 29c030755c1a4002a552da78ebe8ca23 P 12f5bf47c0c643cea0ee4e64b21f7a5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b9251784264551997ddc5e6655d6bd in term 0.
I20260809 09:26:47.669629 31529 leader_election.cc:302] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77914c7778cb4245bafed833c3fcb7fa, 87b9251784264551997ddc5e6655d6bd; no voters:
I20260809 09:26:47.669857 31950 raft_consensus.cc:2781] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:26:47.669937 31950 raft_consensus.cc:482] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:26:47.669967 31950 raft_consensus.cc:3037] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:47.671072 31950 raft_consensus.cc:504] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b9251784264551997ddc5e6655d6bd" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45333 } } peers { permanent_uuid: "12f5bf47c0c643cea0ee4e64b21f7a5a" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35405 } } peers { permanent_uuid: "77914c7778cb4245bafed833c3fcb7fa" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 42357 } }
I20260809 09:26:47.671406 31950 leader_election.cc:288] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd [CANDIDATE]: Term 1 election: Requested vote from peers 12f5bf47c0c643cea0ee4e64b21f7a5a (127.11.99.195:35405), 77914c7778cb4245bafed833c3fcb7fa (127.11.99.194:42357)
I20260809 09:26:47.671854 31741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29c030755c1a4002a552da78ebe8ca23" candidate_uuid: "87b9251784264551997ddc5e6655d6bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77914c7778cb4245bafed833c3fcb7fa"
I20260809 09:26:47.671888 31878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29c030755c1a4002a552da78ebe8ca23" candidate_uuid: "87b9251784264551997ddc5e6655d6bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f5bf47c0c643cea0ee4e64b21f7a5a"
I20260809 09:26:47.671998 31741 raft_consensus.cc:3037] T 29c030755c1a4002a552da78ebe8ca23 P 77914c7778cb4245bafed833c3fcb7fa [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:47.672022 31878 raft_consensus.cc:3037] T 29c030755c1a4002a552da78ebe8ca23 P 12f5bf47c0c643cea0ee4e64b21f7a5a [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:47.673377 31741 raft_consensus.cc:2454] T 29c030755c1a4002a552da78ebe8ca23 P 77914c7778cb4245bafed833c3fcb7fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b9251784264551997ddc5e6655d6bd in term 1.
I20260809 09:26:47.673424 31878 raft_consensus.cc:2454] T 29c030755c1a4002a552da78ebe8ca23 P 12f5bf47c0c643cea0ee4e64b21f7a5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b9251784264551997ddc5e6655d6bd in term 1.
I20260809 09:26:47.673754 31529 leader_election.cc:302] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77914c7778cb4245bafed833c3fcb7fa, 87b9251784264551997ddc5e6655d6bd; no voters:
I20260809 09:26:47.673956 31950 raft_consensus.cc:2781] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:26:47.674217 31950 raft_consensus.cc:686] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd [term 1 LEADER]: Becoming Leader. State: Replica: 87b9251784264551997ddc5e6655d6bd, State: Running, Role: LEADER
I20260809 09:26:47.674562 31950 consensus_queue.cc:237] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b9251784264551997ddc5e6655d6bd" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45333 } } peers { permanent_uuid: "12f5bf47c0c643cea0ee4e64b21f7a5a" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35405 } } peers { permanent_uuid: "77914c7778cb4245bafed833c3fcb7fa" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 42357 } }
I20260809 09:26:47.677500 31447 catalog_manager.cc:5495] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 87b9251784264551997ddc5e6655d6bd (127.11.99.193). New cstate: current_term: 1 leader_uuid: "87b9251784264551997ddc5e6655d6bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b9251784264551997ddc5e6655d6bd" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 45333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12f5bf47c0c643cea0ee4e64b21f7a5a" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77914c7778cb4245bafed833c3fcb7fa" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 42357 } health_report { overall_health: UNKNOWN } } }
I20260809 09:26:47.704627 31939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:47.701345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50432 (local address 127.11.99.193:45333)
0809 09:26:47.701473 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:47.701476 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:47.701489 (+ 13us) server_negotiation.cc:407] Connection header received
0809 09:26:47.701652 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:47.701654 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:47.701705 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:47.701806 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:26:47.702044 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.702509 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.703289 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.703495 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.703569 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:47.703872 (+ 303us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:26:47.704227 (+ 355us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:26:47.704333 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:47.704428 (+ 95us) server_negotiation.cc:299] Negotiation successful
0809 09:26:47.704460 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 09:26:47.709944 31741 raft_consensus.cc:1261] T 29c030755c1a4002a552da78ebe8ca23 P 77914c7778cb4245bafed833c3fcb7fa [term 1 FOLLOWER]: Refusing update from remote peer 87b9251784264551997ddc5e6655d6bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:26:47.709944 31878 raft_consensus.cc:1261] T 29c030755c1a4002a552da78ebe8ca23 P 12f5bf47c0c643cea0ee4e64b21f7a5a [term 1 FOLLOWER]: Refusing update from remote peer 87b9251784264551997ddc5e6655d6bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:26:47.710659 31950 consensus_queue.cc:1035] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "77914c7778cb4245bafed833c3fcb7fa" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:26:47.710843 31955 consensus_queue.cc:1035] T 29c030755c1a4002a552da78ebe8ca23 P 87b9251784264551997ddc5e6655d6bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f5bf47c0c643cea0ee4e64b21f7a5a" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:26:47.719017 31959 mvcc.cc:205] Tried to move back new op lower bound from 7316552121173270528 to 7316552121037725696. Current Snapshot: MvccSnapshot[applied={T|T < 7316552121173270528}]
I20260809 09:26:47.726473 31448 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60502:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:26:47.726636 31448 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60502:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:26:47.728850 31448 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 57eb8abfbe5b4a91b08bca750b5c26f5: Sending DeleteTablet for 3 replicas of tablet 29c030755c1a4002a552da78ebe8ca23
I20260809 09:26:47.729660 31857 tablet_service.cc:1514] Processing DeleteTablet for tablet 29c030755c1a4002a552da78ebe8ca23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:26:47 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:54262
I20260809 09:26:47.729825 31720 tablet_service.cc:1514] Processing DeleteTablet for tablet 29c030755c1a4002a552da78ebe8ca23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:26:47 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:57738
I20260809 09:26:47.730127 31581 tablet_service.cc:1514] Processing DeleteTablet for tablet 29c030755c1a4002a552da78ebe8ca23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:26:47 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:50416
I20260809 09:26:47.730340 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 31513
I20260809 09:26:47.730453 31969 tablet_replica.cc:330] T 29c030755c1a4002a552da78ebe8ca23 P 77914c7778cb4245bafed833c3fcb7fa: stopping tablet replica
I20260809 09:26:47.730911 31969 raft_consensus.cc:2229] T 29c030755c1a4002a552da78ebe8ca23 P 77914c7778cb4245bafed833c3fcb7fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:26:47.731262 31969 raft_consensus.cc:2258] T 29c030755c1a4002a552da78ebe8ca23 P 77914c7778cb4245bafed833c3fcb7fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:26:47.733103 31969 ts_tablet_manager.cc:1905] T 29c030755c1a4002a552da78ebe8ca23 P 77914c7778cb4245bafed833c3fcb7fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:26:47.733744 31968 tablet_replica.cc:330] T 29c030755c1a4002a552da78ebe8ca23 P 12f5bf47c0c643cea0ee4e64b21f7a5a: stopping tablet replica
I20260809 09:26:47.734010 31968 raft_consensus.cc:2229] T 29c030755c1a4002a552da78ebe8ca23 P 12f5bf47c0c643cea0ee4e64b21f7a5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:26:47.734274 31968 raft_consensus.cc:2258] T 29c030755c1a4002a552da78ebe8ca23 P 12f5bf47c0c643cea0ee4e64b21f7a5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:26:47.736519 31969 ts_tablet_manager.cc:1918] T 29c030755c1a4002a552da78ebe8ca23 P 77914c7778cb4245bafed833c3fcb7fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:26:47.736646 31969 log.cc:1196] T 29c030755c1a4002a552da78ebe8ca23 P 77914c7778cb4245bafed833c3fcb7fa: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/29c030755c1a4002a552da78ebe8ca23
I20260809 09:26:47.737095 31969 ts_tablet_manager.cc:1939] T 29c030755c1a4002a552da78ebe8ca23 P 77914c7778cb4245bafed833c3fcb7fa: Deleting consensus metadata
I20260809 09:26:47.737696 31968 ts_tablet_manager.cc:1905] T 29c030755c1a4002a552da78ebe8ca23 P 12f5bf47c0c643cea0ee4e64b21f7a5a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:26:47.738335 31432 catalog_manager.cc:4841] TS 77914c7778cb4245bafed833c3fcb7fa (127.11.99.194:42357): tablet 29c030755c1a4002a552da78ebe8ca23 (table test-table [id=1fe945625f5e45c28fb6f16a47294309]) successfully deleted
I20260809 09:26:47.739961 31968 ts_tablet_manager.cc:1918] T 29c030755c1a4002a552da78ebe8ca23 P 12f5bf47c0c643cea0ee4e64b21f7a5a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:26:47.740103 31968 log.cc:1196] T 29c030755c1a4002a552da78ebe8ca23 P 12f5bf47c0c643cea0ee4e64b21f7a5a: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/29c030755c1a4002a552da78ebe8ca23
I20260809 09:26:47.740492 31968 ts_tablet_manager.cc:1939] T 29c030755c1a4002a552da78ebe8ca23 P 12f5bf47c0c643cea0ee4e64b21f7a5a: Deleting consensus metadata
W20260809 09:26:47.740718 31435 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.99.193:45333 (error 108)
I20260809 09:26:47.741499 31432 catalog_manager.cc:4841] TS 12f5bf47c0c643cea0ee4e64b21f7a5a (127.11.99.195:35405): tablet 29c030755c1a4002a552da78ebe8ca23 (table test-table [id=1fe945625f5e45c28fb6f16a47294309]) successfully deleted
I20260809 09:26:47.741539 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 31655
I20260809 09:26:47.741755 31940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:47.741438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:45333 (local address 127.0.0.1:50438)
0809 09:26:47.741589 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:47.741667 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.193:45333: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260809 09:26:47.743203 31435 catalog_manager.cc:4584] TS 87b9251784264551997ddc5e6655d6bd (127.11.99.193:45333): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 29c030755c1a4002a552da78ebe8ca23: Network error: Client connection negotiation failed: client connection to 127.11.99.193:45333: connect: Connection refused (error 111)
I20260809 09:26:47.747946 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 31794
I20260809 09:26:47.754750 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 31416
2026-08-09T09:26:47Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2224 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-09T09:26:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:26:47Z Disabled control of system clock
I20260809 09:26:47.785601 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:32949
--webserver_interface=127.11.99.254
--webserver_port=0
--builtin_ntp_servers=127.11.99.212:42631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:32949
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 09:26:47.889394 31975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:47.889663 31975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:47.889731 31975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:47.893584 31975 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:26:47.893635 31975 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:47.893651 31975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:47.893667 31975 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:26:47.893682 31975 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:26:47.897693 31975 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:42631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:32949
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:32949
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31975
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:47.898442 31975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:47.899564 31975 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:47.907012 31981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:47.907043 31984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:47.907044 31980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:47.907390 31975 server_base.cc:1034] running on GCE node
I20260809 09:26:47.907878 31975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:47.908829 31975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:47.910003 31975 hybrid_clock.cc:648] HybridClock initialized: now 1786267607909987 us; error 28 us; skew 500 ppm
I20260809 09:26:47.911731 31975 webserver.cc:460] Webserver started at http://127.11.99.254:33035/ using document root <none> and password file <none>
I20260809 09:26:47.912246 31975 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:47.912355 31975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:47.912587 31975 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:47.914427 31975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "80d1da57134e476d8af761a22c27e718"
format_stamp: "Formatted at 2026-08-09 09:26:47 on dist-test-slave-pgkr"
server_key: "c84e45d8bfea7db9fe4906627ab0e1c3"
server_key_iv: "31f82cadf133298ed644861a4f03746f"
server_key_version: "encryptionkey@0"
I20260809 09:26:47.915011 31975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "80d1da57134e476d8af761a22c27e718"
format_stamp: "Formatted at 2026-08-09 09:26:47 on dist-test-slave-pgkr"
server_key: "c84e45d8bfea7db9fe4906627ab0e1c3"
server_key_iv: "31f82cadf133298ed644861a4f03746f"
server_key_version: "encryptionkey@0"
I20260809 09:26:47.918239 31975 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 09:26:47.920324 31990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:47.921391 31975 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:26:47.921542 31975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "80d1da57134e476d8af761a22c27e718"
format_stamp: "Formatted at 2026-08-09 09:26:47 on dist-test-slave-pgkr"
server_key: "c84e45d8bfea7db9fe4906627ab0e1c3"
server_key_iv: "31f82cadf133298ed644861a4f03746f"
server_key_version: "encryptionkey@0"
I20260809 09:26:47.921638 31975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:47.942376 31975 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:47.942936 31975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:47.943104 31975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:47.948868 31975 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:32949
I20260809 09:26:47.948873 32044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:32949 every 8 connection(s)
I20260809 09:26:47.949632 31975 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:26:47.950832 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 31975
I20260809 09:26:47.950958 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:26:47.951262 11663 external_mini_cluster.cc:1428] Setting key e2646ff295c05793d4632c48509acbe9
I20260809 09:26:47.952989 32045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:47.958570 32045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80d1da57134e476d8af761a22c27e718: Bootstrap starting.
I20260809 09:26:47.959338 32048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:47.952478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54912 (local address 127.11.99.254:32949)
0809 09:26:47.953015 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:47.953048 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:47.953089 (+ 41us) server_negotiation.cc:407] Connection header received
0809 09:26:47.953648 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:47.953661 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:47.953959 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:47.954189 (+ 230us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:47.954522 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.955376 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.956466 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:47.956867 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:47.956980 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:47.957801 (+ 821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:47.957806 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:47.957815 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:26:47.958156 (+ 341us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:47.958209 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:26:47.958228 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:47.958308 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:47.958464 (+ 156us) server_negotiation.cc:299] Negotiation successful
0809 09:26:47.958753 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":128,"threads_started":1}
I20260809 09:26:47.960572 32045 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80d1da57134e476d8af761a22c27e718: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:47.961244 32045 log.cc:824] T 00000000000000000000000000000000 P 80d1da57134e476d8af761a22c27e718: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:47.962951 32045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80d1da57134e476d8af761a22c27e718: No bootstrap required, opened a new log
I20260809 09:26:47.965866 32045 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80d1da57134e476d8af761a22c27e718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80d1da57134e476d8af761a22c27e718" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 32949 } }
I20260809 09:26:47.966099 32045 raft_consensus.cc:374] T 00000000000000000000000000000000 P 80d1da57134e476d8af761a22c27e718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:47.966188 32045 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80d1da57134e476d8af761a22c27e718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d1da57134e476d8af761a22c27e718, State: Initialized, Role: FOLLOWER
I20260809 09:26:47.966575 32045 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80d1da57134e476d8af761a22c27e718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80d1da57134e476d8af761a22c27e718" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 32949 } }
I20260809 09:26:47.966774 32045 raft_consensus.cc:388] T 00000000000000000000000000000000 P 80d1da57134e476d8af761a22c27e718 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:26:47.966857 32045 raft_consensus.cc:482] T 00000000000000000000000000000000 P 80d1da57134e476d8af761a22c27e718 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:26:47.966944 32045 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80d1da57134e476d8af761a22c27e718 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:47.967749 32045 raft_consensus.cc:504] T 00000000000000000000000000000000 P 80d1da57134e476d8af761a22c27e718 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80d1da57134e476d8af761a22c27e718" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 32949 } }
I20260809 09:26:47.968062 32045 leader_election.cc:302] T 00000000000000000000000000000000 P 80d1da57134e476d8af761a22c27e718 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80d1da57134e476d8af761a22c27e718; no voters:
I20260809 09:26:47.968354 32045 leader_election.cc:288] T 00000000000000000000000000000000 P 80d1da57134e476d8af761a22c27e718 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:26:47.968411 32050 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 80d1da57134e476d8af761a22c27e718 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:26:47.968667 32050 raft_consensus.cc:686] T 00000000000000000000000000000000 P 80d1da57134e476d8af761a22c27e718 [term 1 LEADER]: Becoming Leader. State: Replica: 80d1da57134e476d8af761a22c27e718, State: Running, Role: LEADER
I20260809 09:26:47.968916 32050 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80d1da57134e476d8af761a22c27e718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80d1da57134e476d8af761a22c27e718" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 32949 } }
I20260809 09:26:47.969456 32045 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80d1da57134e476d8af761a22c27e718 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:26:47.970463 32051 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80d1da57134e476d8af761a22c27e718 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "80d1da57134e476d8af761a22c27e718" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80d1da57134e476d8af761a22c27e718" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 32949 } } }
I20260809 09:26:47.970587 32051 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80d1da57134e476d8af761a22c27e718 [sys.catalog]: This master's current role is: LEADER
I20260809 09:26:47.970955 32052 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80d1da57134e476d8af761a22c27e718 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80d1da57134e476d8af761a22c27e718. Latest consensus state: current_term: 1 leader_uuid: "80d1da57134e476d8af761a22c27e718" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80d1da57134e476d8af761a22c27e718" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 32949 } } }
I20260809 09:26:47.971046 32052 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80d1da57134e476d8af761a22c27e718 [sys.catalog]: This master's current role is: LEADER
W20260809 09:26:47.973677 32065 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 80d1da57134e476d8af761a22c27e718: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 09:26:47.973747 32065 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 09:26:47.973817 32059 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:26:47.974561 32059 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:26:47.979252 32059 catalog_manager.cc:1347] Generated new cluster ID: 0927289b89934bfb9ca28022bf18cd1a
I20260809 09:26:47.979321 32059 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:26:47.986892 32059 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:26:47.987622 32059 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:26:47.991410 32059 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 80d1da57134e476d8af761a22c27e718: Generated new TSK 0
I20260809 09:26:47.991927 32059 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:26:47.995355 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:0
--local_ip_for_outbound_sockets=127.11.99.193
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:32949
--builtin_ntp_servers=127.11.99.212:42631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 09:26:48.107010 32069 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:48.107349 32069 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:48.107416 32069 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:48.111299 32069 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:48.111366 32069 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:48.111462 32069 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:26:48.116024 32069 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:42631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:32949
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32069
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:48.116926 32069 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:48.118170 32069 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:48.127254 32074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:48.127336 32077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:48.127344 32075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:48.127426 32069 server_base.cc:1034] running on GCE node
I20260809 09:26:48.127810 32069 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:48.128350 32069 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:48.129493 32069 hybrid_clock.cc:648] HybridClock initialized: now 1786267608129469 us; error 38 us; skew 500 ppm
I20260809 09:26:48.131124 32069 webserver.cc:460] Webserver started at http://127.11.99.193:44119/ using document root <none> and password file <none>
I20260809 09:26:48.131597 32069 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:48.131666 32069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:48.131827 32069 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:48.133565 32069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-0/data/instance:
uuid: "9ce24ed4e9ad4470bfc14cffb835ffc8"
format_stamp: "Formatted at 2026-08-09 09:26:48 on dist-test-slave-pgkr"
server_key: "ceb6286ad217fc30165802d5c96885ce"
server_key_iv: "00589109a355a987e86308c85d1a1e5c"
server_key_version: "encryptionkey@0"
I20260809 09:26:48.134025 32069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance:
uuid: "9ce24ed4e9ad4470bfc14cffb835ffc8"
format_stamp: "Formatted at 2026-08-09 09:26:48 on dist-test-slave-pgkr"
server_key: "ceb6286ad217fc30165802d5c96885ce"
server_key_iv: "00589109a355a987e86308c85d1a1e5c"
server_key_version: "encryptionkey@0"
I20260809 09:26:48.137434 32069 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 09:26:48.139740 32083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:48.140817 32069 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 09:26:48.140949 32069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "9ce24ed4e9ad4470bfc14cffb835ffc8"
format_stamp: "Formatted at 2026-08-09 09:26:48 on dist-test-slave-pgkr"
server_key: "ceb6286ad217fc30165802d5c96885ce"
server_key_iv: "00589109a355a987e86308c85d1a1e5c"
server_key_version: "encryptionkey@0"
I20260809 09:26:48.141053 32069 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:48.166138 32069 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:48.166786 32069 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:48.166960 32069 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:48.167459 32069 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:26:48.168283 32069 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:26:48.168351 32069 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:48.168411 32069 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:26:48.168453 32069 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:48.176684 32069 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:37945
I20260809 09:26:48.176743 32201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:37945 every 8 connection(s)
I20260809 09:26:48.177556 32069 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:26:48.182540 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 32069
I20260809 09:26:48.182677 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance
I20260809 09:26:48.182977 11663 external_mini_cluster.cc:1428] Setting key e49c0240f83dd61a3c7228ffe342afe4
I20260809 09:26:48.184881 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:0
--local_ip_for_outbound_sockets=127.11.99.194
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:32949
--builtin_ntp_servers=127.11.99.212:42631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 09:26:48.186082 32048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:48.179164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:43647 (local address 127.11.99.254:32949)
0809 09:26:48.179284 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:48.179288 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:48.180152 (+ 864us) server_negotiation.cc:407] Connection header received
0809 09:26:48.181479 (+ 1327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:48.181482 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:48.181549 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:48.181646 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:48.182458 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.183161 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.184264 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.184480 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.184583 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:48.185609 (+ 1026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:48.185612 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:48.185614 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:26:48.185627 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:48.185652 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:26:48.185659 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:48.185727 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:48.185861 (+ 134us) server_negotiation.cc:299] Negotiation successful
0809 09:26:48.185946 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 09:26:48.186887 32204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:48.179453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:32949 (local address 127.11.99.193:43647)
0809 09:26:48.180021 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:48.180055 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:48.181281 (+ 1226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:48.181793 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:48.181799 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:48.181878 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:26:48.182301 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:48.182320 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.183302 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.183305 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:48.184110 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:48.184118 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.184618 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.184621 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:48.184768 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:48.185334 (+ 566us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 09:26:48.185336 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:26:48.185374 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 09:26:48.185426 (+ 52us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:26:48.185728 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:26:48.185738 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:26:48.185744 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 09:26:48.185858 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 09:26:48.186070 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":115,"threads_started":1}
I20260809 09:26:48.188040 32202 heartbeater.cc:347] Connected to a master server at 127.11.99.254:32949
I20260809 09:26:48.188253 32202 heartbeater.cc:464] Registering TS with master...
I20260809 09:26:48.188782 32202 heartbeater.cc:511] Master 127.11.99.254:32949 requested a full tablet report, sending...
I20260809 09:26:48.190219 32005 ts_manager.cc:194] Registered new tserver with Master: 9ce24ed4e9ad4470bfc14cffb835ffc8 (127.11.99.193:37945)
I20260809 09:26:48.191362 32005 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.99.193:43647
W20260809 09:26:48.293277 32205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:48.293530 32205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:48.293584 32205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:48.297549 32205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:48.297598 32205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:48.297679 32205 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:26:48.302381 32205 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:42631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:32949
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32205
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:48.303378 32205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:48.304699 32205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:48.313803 32211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:48.313898 32205 server_base.cc:1034] running on GCE node
W20260809 09:26:48.313864 32210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:48.313802 32213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:48.314378 32205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:48.315040 32205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:48.316226 32205 hybrid_clock.cc:648] HybridClock initialized: now 1786267608316203 us; error 41 us; skew 500 ppm
I20260809 09:26:48.317932 32205 webserver.cc:460] Webserver started at http://127.11.99.194:42679/ using document root <none> and password file <none>
I20260809 09:26:48.318471 32205 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:48.318567 32205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:48.318806 32205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:48.320691 32205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-1/data/instance:
uuid: "4b8dd8381e964dbf8323351515bdf1b7"
format_stamp: "Formatted at 2026-08-09 09:26:48 on dist-test-slave-pgkr"
server_key: "21fb38cf21c43f0e12a8cd97ceb4acfc"
server_key_iv: "f0601bbe0cb4dc890b6b9669629d9ca4"
server_key_version: "encryptionkey@0"
I20260809 09:26:48.321219 32205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance:
uuid: "4b8dd8381e964dbf8323351515bdf1b7"
format_stamp: "Formatted at 2026-08-09 09:26:48 on dist-test-slave-pgkr"
server_key: "21fb38cf21c43f0e12a8cd97ceb4acfc"
server_key_iv: "f0601bbe0cb4dc890b6b9669629d9ca4"
server_key_version: "encryptionkey@0"
I20260809 09:26:48.324774 32205 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:26:48.326987 32219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:48.328069 32205 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:26:48.328199 32205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "4b8dd8381e964dbf8323351515bdf1b7"
format_stamp: "Formatted at 2026-08-09 09:26:48 on dist-test-slave-pgkr"
server_key: "21fb38cf21c43f0e12a8cd97ceb4acfc"
server_key_iv: "f0601bbe0cb4dc890b6b9669629d9ca4"
server_key_version: "encryptionkey@0"
I20260809 09:26:48.328303 32205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:48.352633 32205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:48.353202 32205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:48.353376 32205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:48.353885 32205 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:26:48.354761 32205 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:26:48.354822 32205 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:48.354885 32205 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:26:48.354928 32205 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:48.362854 32205 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:40179
I20260809 09:26:48.362928 32338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:40179 every 8 connection(s)
I20260809 09:26:48.363701 32205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:26:48.371878 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 32205
I20260809 09:26:48.372015 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance
I20260809 09:26:48.372316 11663 external_mini_cluster.cc:1428] Setting key 0bd112e50bee15243882e7bde49e86d6
I20260809 09:26:48.372330 32048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:48.365381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:46111 (local address 127.11.99.254:32949)
0809 09:26:48.365524 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:48.365530 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:48.366505 (+ 975us) server_negotiation.cc:407] Connection header received
0809 09:26:48.367835 (+ 1330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:48.367838 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:48.367884 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:48.367958 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:48.368737 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.369235 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.370367 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.370567 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.370749 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:48.371804 (+ 1055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:48.371808 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:48.371810 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:26:48.371823 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:48.371849 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:26:48.371857 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:48.371932 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:48.372121 (+ 189us) server_negotiation.cc:299] Negotiation successful
0809 09:26:48.372181 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 09:26:48.373116 32341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:48.365759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:32949 (local address 127.11.99.194:46111)
0809 09:26:48.366363 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:48.366398 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:48.367659 (+ 1261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:48.368106 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:48.368112 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:48.368183 (+ 71us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:26:48.368616 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:48.368627 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.369337 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.369340 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:48.370243 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:48.370257 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.370788 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.370791 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:48.370926 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:48.371550 (+ 624us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 09:26:48.371552 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:26:48.371587 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 09:26:48.371639 (+ 52us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:26:48.371934 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:26:48.371945 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:26:48.371952 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 09:26:48.372107 (+ 155us) client_negotiation.cc:240] Negotiation successful
0809 09:26:48.372352 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":114,"threads_started":1}
I20260809 09:26:48.374126 32339 heartbeater.cc:347] Connected to a master server at 127.11.99.254:32949
I20260809 09:26:48.374151 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:0
--local_ip_for_outbound_sockets=127.11.99.195
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:32949
--builtin_ntp_servers=127.11.99.212:42631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 09:26:48.374349 32339 heartbeater.cc:464] Registering TS with master...
I20260809 09:26:48.374838 32339 heartbeater.cc:511] Master 127.11.99.254:32949 requested a full tablet report, sending...
I20260809 09:26:48.375727 32005 ts_manager.cc:194] Registered new tserver with Master: 4b8dd8381e964dbf8323351515bdf1b7 (127.11.99.194:40179)
I20260809 09:26:48.376259 32005 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.99.194:46111
W20260809 09:26:48.479640 32342 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:48.479885 32342 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:48.479954 32342 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:48.483680 32342 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:48.483753 32342 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:48.483839 32342 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:26:48.488170 32342 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:42631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:32949
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32342
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:48.489063 32342 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:48.490320 32342 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 09:26:48.499004 32342 server_base.cc:1034] running on GCE node
W20260809 09:26:48.498942 32350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:48.498971 32347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:48.498958 32348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:48.499532 32342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:48.500144 32342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:48.501291 32342 hybrid_clock.cc:648] HybridClock initialized: now 1786267608501257 us; error 47 us; skew 500 ppm
I20260809 09:26:48.502978 32342 webserver.cc:460] Webserver started at http://127.11.99.195:40955/ using document root <none> and password file <none>
I20260809 09:26:48.503525 32342 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:48.503584 32342 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:48.503829 32342 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:48.505686 32342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-2/data/instance:
uuid: "08969e46fd544fa5bfc52dc7f424aeff"
format_stamp: "Formatted at 2026-08-09 09:26:48 on dist-test-slave-pgkr"
server_key: "ea2e4e6229a55bb9e5e3a83385bbac0c"
server_key_iv: "ff0456f370667618c32d6e6ef1bcbdd3"
server_key_version: "encryptionkey@0"
I20260809 09:26:48.506201 32342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance:
uuid: "08969e46fd544fa5bfc52dc7f424aeff"
format_stamp: "Formatted at 2026-08-09 09:26:48 on dist-test-slave-pgkr"
server_key: "ea2e4e6229a55bb9e5e3a83385bbac0c"
server_key_iv: "ff0456f370667618c32d6e6ef1bcbdd3"
server_key_version: "encryptionkey@0"
I20260809 09:26:48.509460 32342 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 09:26:48.511835 32357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:48.513007 32342 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 09:26:48.513135 32342 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "08969e46fd544fa5bfc52dc7f424aeff"
format_stamp: "Formatted at 2026-08-09 09:26:48 on dist-test-slave-pgkr"
server_key: "ea2e4e6229a55bb9e5e3a83385bbac0c"
server_key_iv: "ff0456f370667618c32d6e6ef1bcbdd3"
server_key_version: "encryptionkey@0"
I20260809 09:26:48.513248 32342 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:48.529713 32342 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:48.530319 32342 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:48.530495 32342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:48.531075 32342 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:26:48.532011 32342 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:26:48.532075 32342 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:48.532135 32342 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:26:48.532176 32342 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:48.540653 32342 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:43113
I20260809 09:26:48.540685 32474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:43113 every 8 connection(s)
I20260809 09:26:48.541505 32342 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:26:48.550035 32048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:48.543270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:33339 (local address 127.11.99.254:32949)
0809 09:26:48.543435 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:48.543440 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:48.544494 (+ 1054us) server_negotiation.cc:407] Connection header received
0809 09:26:48.545885 (+ 1391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:48.545888 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:48.545931 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:48.546001 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:48.546813 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.547310 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.548329 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.548522 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.548594 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:48.549580 (+ 986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:48.549582 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:48.549584 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:26:48.549595 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:48.549609 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:26:48.549615 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:48.549687 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:48.549875 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 09:26:48.549924 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 09:26:48.550552 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 32342
I20260809 09:26:48.550733 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance
I20260809 09:26:48.551019 11663 external_mini_cluster.cc:1428] Setting key c0046448038f7193cfc98219af918626
I20260809 09:26:48.551028 32477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:48.543653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:32949 (local address 127.11.99.195:33339)
0809 09:26:48.544359 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:48.544397 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:48.545706 (+ 1309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:48.546139 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:48.546144 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:48.546213 (+ 69us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:26:48.546699 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:48.546713 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.547417 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.547419 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:48.548231 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:48.548239 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.548638 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.548640 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:48.548763 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:48.549368 (+ 605us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 09:26:48.549370 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:26:48.549409 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 09:26:48.549463 (+ 54us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:26:48.549740 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:26:48.549748 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:26:48.549753 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 09:26:48.549864 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 09:26:48.550058 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":110,"threads_started":1}
I20260809 09:26:48.552258 32475 heartbeater.cc:347] Connected to a master server at 127.11.99.254:32949
I20260809 09:26:48.552470 32475 heartbeater.cc:464] Registering TS with master...
I20260809 09:26:48.552932 32475 heartbeater.cc:511] Master 127.11.99.254:32949 requested a full tablet report, sending...
I20260809 09:26:48.553889 32005 ts_manager.cc:194] Registered new tserver with Master: 08969e46fd544fa5bfc52dc7f424aeff (127.11.99.195:43113)
I20260809 09:26:48.554528 32005 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.99.195:33339
I20260809 09:26:48.565753 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 09:26:48.571411 32048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:48.567792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54922 (local address 127.11.99.254:32949)
0809 09:26:48.567920 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:48.567923 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:48.568097 (+ 174us) server_negotiation.cc:407] Connection header received
0809 09:26:48.568185 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:48.568187 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:48.568219 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:48.568277 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:48.568469 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.568893 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.569701 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.569938 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.570012 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:48.571037 (+ 1025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:48.571040 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:48.571042 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:26:48.571053 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:48.571070 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:26:48.571078 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:48.571176 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:48.571295 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 09:26:48.571321 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 09:26:48.573972 32005 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54922:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 09:26:48.576954 32005 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:26:48.589990 32488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:48.584670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38478 (local address 127.11.99.195:43113)
0809 09:26:48.585361 (+ 691us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:48.585373 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:48.585395 (+ 22us) server_negotiation.cc:407] Connection header received
0809 09:26:48.585457 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:48.585462 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:48.585661 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:48.586108 (+ 447us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:48.586235 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.587376 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.588712 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.589370 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.589501 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:48.589673 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:48.589770 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 09:26:48.589855 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":590,"thread_start_us":142,"threads_started":1}
I20260809 09:26:48.589973 32487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:48.584545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:43113 (local address 127.0.0.1:38478)
0809 09:26:48.584911 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:48.584957 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:48.585077 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:48.585821 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:48.585827 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:48.585850 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:48.585969 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:48.585975 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.587496 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.587499 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:48.588580 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:48.588593 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.589501 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.589505 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:48.589603 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:48.589635 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 09:26:48.589727 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 09:26:48.589838 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":90,"threads_started":1}
I20260809 09:26:48.590394 32489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:48.584818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:37945 (local address 127.0.0.1:42980)
0809 09:26:48.585227 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:48.585241 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:48.585326 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:48.586189 (+ 863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:48.586191 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:48.586207 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:48.586289 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:48.586295 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.587713 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.587718 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:48.588958 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:48.588969 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.589969 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.589973 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:48.590072 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:48.590102 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 09:26:48.590157 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 09:26:48.590234 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"mutex_wait_us":28,"thread_start_us":111,"threads_started":1}
I20260809 09:26:48.591115 32490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:48.585231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:40179 (local address 127.0.0.1:49180)
0809 09:26:48.585605 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:48.585617 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:48.585700 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:48.586656 (+ 956us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:48.586659 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:48.586677 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:48.586787 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:48.586796 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.587847 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.587850 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:48.588973 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:48.588980 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.589969 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.589973 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:48.590770 (+ 797us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:48.590800 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 09:26:48.590902 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 09:26:48.590972 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"mutex_wait_us":723,"thread_start_us":99,"threads_started":1}
I20260809 09:26:48.591172 32492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:48.585621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49180 (local address 127.11.99.194:40179)
0809 09:26:48.586252 (+ 631us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:48.586264 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:48.586286 (+ 22us) server_negotiation.cc:407] Connection header received
0809 09:26:48.586381 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:48.586385 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:48.586505 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:48.586678 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:48.586901 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.587735 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.589104 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.589835 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.590013 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:48.590358 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:48.590933 (+ 575us) server_negotiation.cc:299] Negotiation successful
0809 09:26:48.591020 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":132,"threads_started":1}
I20260809 09:26:48.591948 32491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:48.585198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42980 (local address 127.11.99.193:37945)
0809 09:26:48.585776 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:48.585789 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:48.585808 (+ 19us) server_negotiation.cc:407] Connection header received
0809 09:26:48.585870 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:48.585875 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:48.586051 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:48.586437 (+ 386us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:48.586569 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.587610 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.589103 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.589835 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.591301 (+ 1466us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:48.591592 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:48.591652 (+ 60us) server_negotiation.cc:299] Negotiation successful
0809 09:26:48.591758 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":136,"threads_started":1}
I20260809 09:26:48.592940 32406 tablet_service.cc:1467] Processing CreateTablet for tablet c13bb58145fd472dadc37846d2d8037d (DEFAULT_TABLE table=test-table [id=ddfe742462a5481bbb39f6abbca73eac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:26:48.594070 32406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c13bb58145fd472dadc37846d2d8037d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:48.593818 32269 tablet_service.cc:1467] Processing CreateTablet for tablet c13bb58145fd472dadc37846d2d8037d (DEFAULT_TABLE table=test-table [id=ddfe742462a5481bbb39f6abbca73eac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:26:48.594812 32269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c13bb58145fd472dadc37846d2d8037d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:48.594476 32134 tablet_service.cc:1467] Processing CreateTablet for tablet c13bb58145fd472dadc37846d2d8037d (DEFAULT_TABLE table=test-table [id=ddfe742462a5481bbb39f6abbca73eac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:26:48.595448 32134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c13bb58145fd472dadc37846d2d8037d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:48.600930 32493 tablet_bootstrap.cc:492] T c13bb58145fd472dadc37846d2d8037d P 4b8dd8381e964dbf8323351515bdf1b7: Bootstrap starting.
I20260809 09:26:48.602460 32495 tablet_bootstrap.cc:492] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8: Bootstrap starting.
I20260809 09:26:48.602996 32494 tablet_bootstrap.cc:492] T c13bb58145fd472dadc37846d2d8037d P 08969e46fd544fa5bfc52dc7f424aeff: Bootstrap starting.
I20260809 09:26:48.603209 32493 tablet_bootstrap.cc:654] T c13bb58145fd472dadc37846d2d8037d P 4b8dd8381e964dbf8323351515bdf1b7: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:48.604125 32493 log.cc:824] T c13bb58145fd472dadc37846d2d8037d P 4b8dd8381e964dbf8323351515bdf1b7: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:48.604436 32495 tablet_bootstrap.cc:654] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:48.604969 32494 tablet_bootstrap.cc:654] T c13bb58145fd472dadc37846d2d8037d P 08969e46fd544fa5bfc52dc7f424aeff: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:48.605201 32495 log.cc:824] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:48.605731 32494 log.cc:824] T c13bb58145fd472dadc37846d2d8037d P 08969e46fd544fa5bfc52dc7f424aeff: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:48.606249 32493 tablet_bootstrap.cc:492] T c13bb58145fd472dadc37846d2d8037d P 4b8dd8381e964dbf8323351515bdf1b7: No bootstrap required, opened a new log
I20260809 09:26:48.606453 32493 ts_tablet_manager.cc:1397] T c13bb58145fd472dadc37846d2d8037d P 4b8dd8381e964dbf8323351515bdf1b7: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 09:26:48.607138 32495 tablet_bootstrap.cc:492] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8: No bootstrap required, opened a new log
I20260809 09:26:48.607322 32495 ts_tablet_manager.cc:1397] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 09:26:48.607635 32494 tablet_bootstrap.cc:492] T c13bb58145fd472dadc37846d2d8037d P 08969e46fd544fa5bfc52dc7f424aeff: No bootstrap required, opened a new log
I20260809 09:26:48.607825 32494 ts_tablet_manager.cc:1397] T c13bb58145fd472dadc37846d2d8037d P 08969e46fd544fa5bfc52dc7f424aeff: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 09:26:48.609957 32493 raft_consensus.cc:348] T c13bb58145fd472dadc37846d2d8037d P 4b8dd8381e964dbf8323351515bdf1b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08969e46fd544fa5bfc52dc7f424aeff" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 43113 } } peers { permanent_uuid: "4b8dd8381e964dbf8323351515bdf1b7" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 40179 } } peers { permanent_uuid: "9ce24ed4e9ad4470bfc14cffb835ffc8" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 37945 } }
I20260809 09:26:48.610232 32493 raft_consensus.cc:374] T c13bb58145fd472dadc37846d2d8037d P 4b8dd8381e964dbf8323351515bdf1b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:48.610327 32493 raft_consensus.cc:729] T c13bb58145fd472dadc37846d2d8037d P 4b8dd8381e964dbf8323351515bdf1b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b8dd8381e964dbf8323351515bdf1b7, State: Initialized, Role: FOLLOWER
I20260809 09:26:48.610837 32493 consensus_queue.cc:260] T c13bb58145fd472dadc37846d2d8037d P 4b8dd8381e964dbf8323351515bdf1b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08969e46fd544fa5bfc52dc7f424aeff" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 43113 } } peers { permanent_uuid: "4b8dd8381e964dbf8323351515bdf1b7" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 40179 } } peers { permanent_uuid: "9ce24ed4e9ad4470bfc14cffb835ffc8" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 37945 } }
I20260809 09:26:48.611531 32339 heartbeater.cc:503] Master 127.11.99.254:32949 was elected leader, sending a full tablet report...
I20260809 09:26:48.611454 32495 raft_consensus.cc:348] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08969e46fd544fa5bfc52dc7f424aeff" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 43113 } } peers { permanent_uuid: "4b8dd8381e964dbf8323351515bdf1b7" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 40179 } } peers { permanent_uuid: "9ce24ed4e9ad4470bfc14cffb835ffc8" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 37945 } }
I20260809 09:26:48.611716 32495 raft_consensus.cc:374] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:48.611778 32495 raft_consensus.cc:729] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ce24ed4e9ad4470bfc14cffb835ffc8, State: Initialized, Role: FOLLOWER
I20260809 09:26:48.611886 32494 raft_consensus.cc:348] T c13bb58145fd472dadc37846d2d8037d P 08969e46fd544fa5bfc52dc7f424aeff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08969e46fd544fa5bfc52dc7f424aeff" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 43113 } } peers { permanent_uuid: "4b8dd8381e964dbf8323351515bdf1b7" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 40179 } } peers { permanent_uuid: "9ce24ed4e9ad4470bfc14cffb835ffc8" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 37945 } }
I20260809 09:26:48.612099 32494 raft_consensus.cc:374] T c13bb58145fd472dadc37846d2d8037d P 08969e46fd544fa5bfc52dc7f424aeff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:48.612152 32494 raft_consensus.cc:729] T c13bb58145fd472dadc37846d2d8037d P 08969e46fd544fa5bfc52dc7f424aeff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08969e46fd544fa5bfc52dc7f424aeff, State: Initialized, Role: FOLLOWER
I20260809 09:26:48.612183 32495 consensus_queue.cc:260] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08969e46fd544fa5bfc52dc7f424aeff" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 43113 } } peers { permanent_uuid: "4b8dd8381e964dbf8323351515bdf1b7" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 40179 } } peers { permanent_uuid: "9ce24ed4e9ad4470bfc14cffb835ffc8" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 37945 } }
I20260809 09:26:48.612614 32494 consensus_queue.cc:260] T c13bb58145fd472dadc37846d2d8037d P 08969e46fd544fa5bfc52dc7f424aeff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08969e46fd544fa5bfc52dc7f424aeff" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 43113 } } peers { permanent_uuid: "4b8dd8381e964dbf8323351515bdf1b7" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 40179 } } peers { permanent_uuid: "9ce24ed4e9ad4470bfc14cffb835ffc8" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 37945 } }
I20260809 09:26:48.612856 32202 heartbeater.cc:503] Master 127.11.99.254:32949 was elected leader, sending a full tablet report...
I20260809 09:26:48.613334 32493 ts_tablet_manager.cc:1428] T c13bb58145fd472dadc37846d2d8037d P 4b8dd8381e964dbf8323351515bdf1b7: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260809 09:26:48.613528 32494 ts_tablet_manager.cc:1428] T c13bb58145fd472dadc37846d2d8037d P 08969e46fd544fa5bfc52dc7f424aeff: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 09:26:48.613899 32475 heartbeater.cc:503] Master 127.11.99.254:32949 was elected leader, sending a full tablet report...
I20260809 09:26:48.614002 32495 ts_tablet_manager.cc:1428] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
W20260809 09:26:48.614681 32340 tablet.cc:2369] T c13bb58145fd472dadc37846d2d8037d P 4b8dd8381e964dbf8323351515bdf1b7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 09:26:48.678741 32203 tablet.cc:2369] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:26:48.749923 32500 raft_consensus.cc:482] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:26:48.750167 32500 raft_consensus.cc:504] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08969e46fd544fa5bfc52dc7f424aeff" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 43113 } } peers { permanent_uuid: "4b8dd8381e964dbf8323351515bdf1b7" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 40179 } } peers { permanent_uuid: "9ce24ed4e9ad4470bfc14cffb835ffc8" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 37945 } }
I20260809 09:26:48.751359 32500 leader_election.cc:288] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08969e46fd544fa5bfc52dc7f424aeff (127.11.99.195:43113), 4b8dd8381e964dbf8323351515bdf1b7 (127.11.99.194:40179)
I20260809 09:26:48.755292 32488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:48.751694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:38843 (local address 127.11.99.195:43113)
0809 09:26:48.751850 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:48.751855 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:48.752002 (+ 147us) server_negotiation.cc:407] Connection header received
0809 09:26:48.752365 (+ 363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:48.752368 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:48.752409 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:48.752502 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:48.752787 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.753264 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.754320 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.754767 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.754892 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:48.754943 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:48.755109 (+ 166us) server_negotiation.cc:299] Negotiation successful
0809 09:26:48.755176 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 09:26:48.755318 32502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:48.751603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:43113 (local address 127.11.99.193:38843)
0809 09:26:48.751893 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:48.751918 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:48.752041 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:48.752517 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:48.752520 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:48.752539 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:48.752663 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:48.752668 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.753385 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.753390 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:48.754184 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:48.754192 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.754884 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.754887 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:48.754971 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:48.754994 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 09:26:48.755094 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 09:26:48.755164 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"mutex_wait_us":1,"thread_start_us":140,"threads_started":1}
I20260809 09:26:48.755461 32492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:48.752228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:59607 (local address 127.11.99.194:40179)
0809 09:26:48.752387 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:48.752392 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:48.752445 (+ 53us) server_negotiation.cc:407] Connection header received
0809 09:26:48.752596 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:48.752601 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:48.752646 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:48.752721 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:48.752989 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.753459 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.754476 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.754902 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.755031 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:48.755078 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:48.755250 (+ 172us) server_negotiation.cc:299] Negotiation successful
0809 09:26:48.755313 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 09:26:48.755621 32503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:48.752075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:40179 (local address 127.11.99.193:59607)
0809 09:26:48.752378 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:48.752392 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:48.752483 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:48.752740 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:48.752742 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:48.752758 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:48.752880 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:48.752885 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.753580 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.753586 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:48.754358 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:48.754367 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.755016 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.755020 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:48.755118 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:48.755140 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 09:26:48.755225 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 09:26:48.755292 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":22,"thread_start_us":77,"threads_started":1}
I20260809 09:26:48.755901 32427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c13bb58145fd472dadc37846d2d8037d" candidate_uuid: "9ce24ed4e9ad4470bfc14cffb835ffc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08969e46fd544fa5bfc52dc7f424aeff" is_pre_election: true
I20260809 09:26:48.756263 32427 raft_consensus.cc:2454] T c13bb58145fd472dadc37846d2d8037d P 08969e46fd544fa5bfc52dc7f424aeff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce24ed4e9ad4470bfc14cffb835ffc8 in term 0.
I20260809 09:26:48.756263 32289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c13bb58145fd472dadc37846d2d8037d" candidate_uuid: "9ce24ed4e9ad4470bfc14cffb835ffc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b8dd8381e964dbf8323351515bdf1b7" is_pre_election: true
I20260809 09:26:48.756493 32289 raft_consensus.cc:2454] T c13bb58145fd472dadc37846d2d8037d P 4b8dd8381e964dbf8323351515bdf1b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ce24ed4e9ad4470bfc14cffb835ffc8 in term 0.
I20260809 09:26:48.756717 32085 leader_election.cc:302] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08969e46fd544fa5bfc52dc7f424aeff, 9ce24ed4e9ad4470bfc14cffb835ffc8; no voters:
I20260809 09:26:48.756989 32500 raft_consensus.cc:2781] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:26:48.757062 32500 raft_consensus.cc:482] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:26:48.757091 32500 raft_consensus.cc:3037] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:48.758131 32500 raft_consensus.cc:504] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08969e46fd544fa5bfc52dc7f424aeff" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 43113 } } peers { permanent_uuid: "4b8dd8381e964dbf8323351515bdf1b7" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 40179 } } peers { permanent_uuid: "9ce24ed4e9ad4470bfc14cffb835ffc8" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 37945 } }
I20260809 09:26:48.758469 32500 leader_election.cc:288] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8 [CANDIDATE]: Term 1 election: Requested vote from peers 08969e46fd544fa5bfc52dc7f424aeff (127.11.99.195:43113), 4b8dd8381e964dbf8323351515bdf1b7 (127.11.99.194:40179)
I20260809 09:26:48.758900 32427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c13bb58145fd472dadc37846d2d8037d" candidate_uuid: "9ce24ed4e9ad4470bfc14cffb835ffc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08969e46fd544fa5bfc52dc7f424aeff"
I20260809 09:26:48.758924 32289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c13bb58145fd472dadc37846d2d8037d" candidate_uuid: "9ce24ed4e9ad4470bfc14cffb835ffc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b8dd8381e964dbf8323351515bdf1b7"
I20260809 09:26:48.759027 32289 raft_consensus.cc:3037] T c13bb58145fd472dadc37846d2d8037d P 4b8dd8381e964dbf8323351515bdf1b7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:48.759042 32427 raft_consensus.cc:3037] T c13bb58145fd472dadc37846d2d8037d P 08969e46fd544fa5bfc52dc7f424aeff [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:48.760267 32289 raft_consensus.cc:2454] T c13bb58145fd472dadc37846d2d8037d P 4b8dd8381e964dbf8323351515bdf1b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce24ed4e9ad4470bfc14cffb835ffc8 in term 1.
I20260809 09:26:48.760267 32427 raft_consensus.cc:2454] T c13bb58145fd472dadc37846d2d8037d P 08969e46fd544fa5bfc52dc7f424aeff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ce24ed4e9ad4470bfc14cffb835ffc8 in term 1.
I20260809 09:26:48.760571 32085 leader_election.cc:302] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08969e46fd544fa5bfc52dc7f424aeff, 9ce24ed4e9ad4470bfc14cffb835ffc8; no voters:
I20260809 09:26:48.760721 32500 raft_consensus.cc:2781] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:26:48.760911 32500 raft_consensus.cc:686] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8 [term 1 LEADER]: Becoming Leader. State: Replica: 9ce24ed4e9ad4470bfc14cffb835ffc8, State: Running, Role: LEADER
I20260809 09:26:48.761262 32500 consensus_queue.cc:237] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08969e46fd544fa5bfc52dc7f424aeff" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 43113 } } peers { permanent_uuid: "4b8dd8381e964dbf8323351515bdf1b7" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 40179 } } peers { permanent_uuid: "9ce24ed4e9ad4470bfc14cffb835ffc8" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 37945 } }
I20260809 09:26:48.764403 32006 catalog_manager.cc:5495] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ce24ed4e9ad4470bfc14cffb835ffc8 (127.11.99.193). New cstate: current_term: 1 leader_uuid: "9ce24ed4e9ad4470bfc14cffb835ffc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08969e46fd544fa5bfc52dc7f424aeff" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 43113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b8dd8381e964dbf8323351515bdf1b7" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ce24ed4e9ad4470bfc14cffb835ffc8" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 37945 } health_report { overall_health: HEALTHY } } }
I20260809 09:26:48.780603 32491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:48.777031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42992 (local address 127.11.99.193:37945)
0809 09:26:48.777168 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:48.777171 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:48.777186 (+ 15us) server_negotiation.cc:407] Connection header received
0809 09:26:48.777382 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:48.777385 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:48.777442 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:48.777548 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:26:48.777757 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.778253 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.779150 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:48.779357 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:48.779444 (+ 87us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:48.779733 (+ 289us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:26:48.780144 (+ 411us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:26:48.780265 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:48.780378 (+ 113us) server_negotiation.cc:299] Negotiation successful
0809 09:26:48.780444 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 09:26:48.786363 32289 raft_consensus.cc:1261] T c13bb58145fd472dadc37846d2d8037d P 4b8dd8381e964dbf8323351515bdf1b7 [term 1 FOLLOWER]: Refusing update from remote peer 9ce24ed4e9ad4470bfc14cffb835ffc8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:26:48.786363 32427 raft_consensus.cc:1261] T c13bb58145fd472dadc37846d2d8037d P 08969e46fd544fa5bfc52dc7f424aeff [term 1 FOLLOWER]: Refusing update from remote peer 9ce24ed4e9ad4470bfc14cffb835ffc8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:26:48.787086 32504 consensus_queue.cc:1035] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08969e46fd544fa5bfc52dc7f424aeff" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 43113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:26:48.787264 32500 consensus_queue.cc:1035] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b8dd8381e964dbf8323351515bdf1b7" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 09:26:48.792387 32476 tablet.cc:2369] T c13bb58145fd472dadc37846d2d8037d P 08969e46fd544fa5bfc52dc7f424aeff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:26:48.796277 32508 mvcc.cc:205] Tried to move back new op lower bound from 7316552125581844480 to 7316552125488922624. Current Snapshot: MvccSnapshot[applied={T|T < 7316552125581844480}]
I20260809 09:26:48.802507 32006 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54922:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:26:48.802711 32006 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54922:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:26:48.805016 32006 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 80d1da57134e476d8af761a22c27e718: Sending DeleteTablet for 3 replicas of tablet c13bb58145fd472dadc37846d2d8037d
I20260809 09:26:48.805773 32134 tablet_service.cc:1514] Processing DeleteTablet for tablet c13bb58145fd472dadc37846d2d8037d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:26:48 UTC) from {username='slave'} at 127.0.0.1:42980
I20260809 09:26:48.805784 32269 tablet_service.cc:1514] Processing DeleteTablet for tablet c13bb58145fd472dadc37846d2d8037d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:26:48 UTC) from {username='slave'} at 127.0.0.1:49180
I20260809 09:26:48.806295 32518 tablet_replica.cc:330] T c13bb58145fd472dadc37846d2d8037d P 4b8dd8381e964dbf8323351515bdf1b7: stopping tablet replica
I20260809 09:26:48.806293 32406 tablet_service.cc:1514] Processing DeleteTablet for tablet c13bb58145fd472dadc37846d2d8037d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:26:48 UTC) from {username='slave'} at 127.0.0.1:38478
I20260809 09:26:48.806607 32518 raft_consensus.cc:2229] T c13bb58145fd472dadc37846d2d8037d P 4b8dd8381e964dbf8323351515bdf1b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:26:48.806802 32519 tablet_replica.cc:330] T c13bb58145fd472dadc37846d2d8037d P 08969e46fd544fa5bfc52dc7f424aeff: stopping tablet replica
I20260809 09:26:48.806917 32518 raft_consensus.cc:2258] T c13bb58145fd472dadc37846d2d8037d P 4b8dd8381e964dbf8323351515bdf1b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:26:48.807156 32519 raft_consensus.cc:2229] T c13bb58145fd472dadc37846d2d8037d P 08969e46fd544fa5bfc52dc7f424aeff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:26:48.807386 32517 tablet_replica.cc:330] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8: stopping tablet replica
I20260809 09:26:48.807422 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 32069
I20260809 09:26:48.807715 32517 raft_consensus.cc:2229] T c13bb58145fd472dadc37846d2d8037d P 9ce24ed4e9ad4470bfc14cffb835ffc8 [term 1 LEADER]: Raft consensus shutting down.
I20260809 09:26:48.808840 32519 raft_consensus.cc:2258] T c13bb58145fd472dadc37846d2d8037d P 08969e46fd544fa5bfc52dc7f424aeff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:26:48.809536 32518 ts_tablet_manager.cc:1905] T c13bb58145fd472dadc37846d2d8037d P 4b8dd8381e964dbf8323351515bdf1b7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:26:48.810602 32519 ts_tablet_manager.cc:1905] T c13bb58145fd472dadc37846d2d8037d P 08969e46fd544fa5bfc52dc7f424aeff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:26:48.812793 32518 ts_tablet_manager.cc:1918] T c13bb58145fd472dadc37846d2d8037d P 4b8dd8381e964dbf8323351515bdf1b7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:26:48.812912 32518 log.cc:1196] T c13bb58145fd472dadc37846d2d8037d P 4b8dd8381e964dbf8323351515bdf1b7: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/c13bb58145fd472dadc37846d2d8037d
I20260809 09:26:48.813215 32518 ts_tablet_manager.cc:1939] T c13bb58145fd472dadc37846d2d8037d P 4b8dd8381e964dbf8323351515bdf1b7: Deleting consensus metadata
I20260809 09:26:48.813907 32519 ts_tablet_manager.cc:1918] T c13bb58145fd472dadc37846d2d8037d P 08969e46fd544fa5bfc52dc7f424aeff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:26:48.814005 32519 log.cc:1196] T c13bb58145fd472dadc37846d2d8037d P 08969e46fd544fa5bfc52dc7f424aeff: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/c13bb58145fd472dadc37846d2d8037d
I20260809 09:26:48.814347 32519 ts_tablet_manager.cc:1939] T c13bb58145fd472dadc37846d2d8037d P 08969e46fd544fa5bfc52dc7f424aeff: Deleting consensus metadata
I20260809 09:26:48.814325 31992 catalog_manager.cc:4841] TS 4b8dd8381e964dbf8323351515bdf1b7 (127.11.99.194:40179): tablet c13bb58145fd472dadc37846d2d8037d (table test-table [id=ddfe742462a5481bbb39f6abbca73eac]) successfully deleted
I20260809 09:26:48.815476 31992 catalog_manager.cc:4841] TS 08969e46fd544fa5bfc52dc7f424aeff (127.11.99.195:43113): tablet c13bb58145fd472dadc37846d2d8037d (table test-table [id=ddfe742462a5481bbb39f6abbca73eac]) successfully deleted
W20260809 09:26:48.818409 31991 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.99.193:37945 (error 108)
I20260809 09:26:48.818713 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 32205
I20260809 09:26:48.820803 32490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:48.820446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:37945 (local address 127.0.0.1:42996)
0809 09:26:48.820623 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:48.820708 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.193:37945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260809 09:26:48.821058 31991 catalog_manager.cc:4584] TS 9ce24ed4e9ad4470bfc14cffb835ffc8 (127.11.99.193:37945): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c13bb58145fd472dadc37846d2d8037d: Network error: Client connection negotiation failed: client connection to 127.11.99.193:37945: connect: Connection refused (error 111)
I20260809 09:26:48.825680 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 32342
I20260809 09:26:48.832257 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 31975
2026-08-09T09:26:48Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1077 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:26:48 dist-test-slave-pgkr krb5kdc[32523](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:26:48 dist-test-slave-pgkr krb5kdc[32523](info): set up 2 sockets
Aug 09 09:26:48 dist-test-slave-pgkr krb5kdc[32523](info): commencing operation
krb5kdc: starting...
W20260809 09:26:49.868683 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.014s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:26:49 dist-test-slave-pgkr krb5kdc[32523](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267609, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:26:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:26:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:26:49.985143 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:40487
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:41137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:40487
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:26:50.088315 32536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:50.088541 32536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:50.088610 32536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:50.092383 32536 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:26:50.092430 32536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:50.092449 32536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:50.092464 32536 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:26:50.092520 32536 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:26:50.097148 32536 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:41137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:40487
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:40487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32536
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:50.098035 32536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:50.099000 32536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:50.106897 32544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:50.106913 32541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:50.106962 32536 server_base.cc:1034] running on GCE node
W20260809 09:26:50.106913 32542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:50.107673 32536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:50.108603 32536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:50.109754 32536 hybrid_clock.cc:648] HybridClock initialized: now 1786267610109737 us; error 27 us; skew 500 ppm
Aug 09 09:26:50 dist-test-slave-pgkr krb5kdc[32523](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267610, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:26:50.112926 32536 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:26:50.114063 32536 webserver.cc:460] Webserver started at http://127.11.99.254:39399/ using document root <none> and password file <none>
I20260809 09:26:50.114805 32536 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:50.114907 32536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:50.115144 32536 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:50.116907 32536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "9950a6ac18be4f6a9067d79e4fe70f0c"
format_stamp: "Formatted at 2026-08-09 09:26:50 on dist-test-slave-pgkr"
server_key: "ee7f7ea259e71427cbfc8a61aafe2f4a"
server_key_iv: "2d180327ab339d4860aefda1d707c81e"
server_key_version: "encryptionkey@0"
I20260809 09:26:50.117389 32536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "9950a6ac18be4f6a9067d79e4fe70f0c"
format_stamp: "Formatted at 2026-08-09 09:26:50 on dist-test-slave-pgkr"
server_key: "ee7f7ea259e71427cbfc8a61aafe2f4a"
server_key_iv: "2d180327ab339d4860aefda1d707c81e"
server_key_version: "encryptionkey@0"
I20260809 09:26:50.120976 32536 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:26:50.123106 32551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:50.124195 32536 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:26:50.124344 32536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "9950a6ac18be4f6a9067d79e4fe70f0c"
format_stamp: "Formatted at 2026-08-09 09:26:50 on dist-test-slave-pgkr"
server_key: "ee7f7ea259e71427cbfc8a61aafe2f4a"
server_key_iv: "2d180327ab339d4860aefda1d707c81e"
server_key_version: "encryptionkey@0"
I20260809 09:26:50.124439 32536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:50.143379 32536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:50.146317 32536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:50.146463 32536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:50.153261 32536 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:40487
I20260809 09:26:50.153337 32605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:40487 every 8 connection(s)
I20260809 09:26:50.154218 32536 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:26:50.156862 32606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:50.160241 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 32536
I20260809 09:26:50.160382 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:26:50.160657 11663 external_mini_cluster.cc:1428] Setting key c455548873cd3e0de1d6a04b80d40560
I20260809 09:26:50.162317 32606 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9950a6ac18be4f6a9067d79e4fe70f0c: Bootstrap starting.
I20260809 09:26:50.164553 32606 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9950a6ac18be4f6a9067d79e4fe70f0c: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:50.165206 32606 log.cc:824] T 00000000000000000000000000000000 P 9950a6ac18be4f6a9067d79e4fe70f0c: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:50.166900 32606 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9950a6ac18be4f6a9067d79e4fe70f0c: No bootstrap required, opened a new log
Aug 09 09:26:50 dist-test-slave-pgkr krb5kdc[32523](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267609, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:26:50.170384 32606 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9950a6ac18be4f6a9067d79e4fe70f0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9950a6ac18be4f6a9067d79e4fe70f0c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 40487 } }
I20260809 09:26:50.170619 32606 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9950a6ac18be4f6a9067d79e4fe70f0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:50.170714 32606 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9950a6ac18be4f6a9067d79e4fe70f0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9950a6ac18be4f6a9067d79e4fe70f0c, State: Initialized, Role: FOLLOWER
I20260809 09:26:50.171144 32606 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9950a6ac18be4f6a9067d79e4fe70f0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9950a6ac18be4f6a9067d79e4fe70f0c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 40487 } }
I20260809 09:26:50.171295 32606 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9950a6ac18be4f6a9067d79e4fe70f0c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:26:50.171367 32606 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9950a6ac18be4f6a9067d79e4fe70f0c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:26:50.171479 32606 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9950a6ac18be4f6a9067d79e4fe70f0c [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:50.172286 32606 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9950a6ac18be4f6a9067d79e4fe70f0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9950a6ac18be4f6a9067d79e4fe70f0c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 40487 } }
I20260809 09:26:50.172626 32606 leader_election.cc:302] T 00000000000000000000000000000000 P 9950a6ac18be4f6a9067d79e4fe70f0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9950a6ac18be4f6a9067d79e4fe70f0c; no voters:
I20260809 09:26:50.172930 32606 leader_election.cc:288] T 00000000000000000000000000000000 P 9950a6ac18be4f6a9067d79e4fe70f0c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:26:50.173033 32611 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9950a6ac18be4f6a9067d79e4fe70f0c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:26:50.173269 32611 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9950a6ac18be4f6a9067d79e4fe70f0c [term 1 LEADER]: Becoming Leader. State: Replica: 9950a6ac18be4f6a9067d79e4fe70f0c, State: Running, Role: LEADER
I20260809 09:26:50.173583 32611 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9950a6ac18be4f6a9067d79e4fe70f0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9950a6ac18be4f6a9067d79e4fe70f0c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 40487 } }
I20260809 09:26:50.173866 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:50.161880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35112 (local address 127.11.99.254:40487)
0809 09:26:50.162249 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:50.162264 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:50.162295 (+ 31us) server_negotiation.cc:407] Connection header received
0809 09:26:50.162934 (+ 639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:50.162950 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:50.163225 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:50.163460 (+ 235us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:50.164305 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.165241 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.166026 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.166446 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.166651 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:50.169095 (+ 2444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:50.169099 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:50.169109 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:50.169133 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:50.170869 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:50.171297 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:50.171303 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:50.171308 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:50.171463 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:50.171746 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:50.171750 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:50.171752 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:50.172116 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:50.172338 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:50.172583 (+ 245us) server_negotiation.cc:299] Negotiation successful
0809 09:26:50.172921 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":127,"threads_started":1}
I20260809 09:26:50.174093 32606 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9950a6ac18be4f6a9067d79e4fe70f0c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:26:50.175312 32612 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9950a6ac18be4f6a9067d79e4fe70f0c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9950a6ac18be4f6a9067d79e4fe70f0c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9950a6ac18be4f6a9067d79e4fe70f0c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 40487 } } }
I20260809 09:26:50.175450 32612 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9950a6ac18be4f6a9067d79e4fe70f0c [sys.catalog]: This master's current role is: LEADER
I20260809 09:26:50.175312 32613 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9950a6ac18be4f6a9067d79e4fe70f0c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9950a6ac18be4f6a9067d79e4fe70f0c. Latest consensus state: current_term: 1 leader_uuid: "9950a6ac18be4f6a9067d79e4fe70f0c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9950a6ac18be4f6a9067d79e4fe70f0c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 40487 } } }
I20260809 09:26:50.175544 32613 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9950a6ac18be4f6a9067d79e4fe70f0c [sys.catalog]: This master's current role is: LEADER
I20260809 09:26:50.175957 32620 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:26:50.178448 32620 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:26:50.183065 32620 catalog_manager.cc:1347] Generated new cluster ID: 8df6277da2524ab2b583c81f75d8bc0d
I20260809 09:26:50.183123 32620 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:26:50.190289 32620 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:26:50.191396 32620 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:26:50.200430 32620 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9950a6ac18be4f6a9067d79e4fe70f0c: Generated new TSK 0
I20260809 09:26:50.201079 32620 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.99.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
Entry for principal kudu/127.11.99.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab.
I20260809 09:26:50.227737 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:0
--local_ip_for_outbound_sockets=127.11.99.193
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:40487
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:41137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:26:50.335397 32632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:50.335628 32632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:50.335671 32632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:50.339246 32632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:50.339295 32632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:50.339354 32632 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:26:50.344192 32632 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:41137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.193.keytab
--principal=kudu/127.11.99.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:40487
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32632
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:50.345005 32632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:50.345875 32632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:50.354717 32638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:50.354723 32640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:50.354735 32637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:50.355058 32632 server_base.cc:1034] running on GCE node
I20260809 09:26:50.355499 32632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:50.356029 32632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:50.357187 32632 hybrid_clock.cc:648] HybridClock initialized: now 1786267610357160 us; error 38 us; skew 500 ppm
Aug 09 09:26:50 dist-test-slave-pgkr krb5kdc[32523](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267610, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:26:50.359829 32632 init.cc:377] Logged in from keytab as kudu/127.11.99.193@KRBTEST.COM (short username kudu)
I20260809 09:26:50.360654 32632 webserver.cc:460] Webserver started at http://127.11.99.193:41485/ using document root <none> and password file <none>
I20260809 09:26:50.361125 32632 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:50.361179 32632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:50.361331 32632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:50.363287 32632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-0/data/instance:
uuid: "d5ba0081f6994642942b20c710ade3c7"
format_stamp: "Formatted at 2026-08-09 09:26:50 on dist-test-slave-pgkr"
server_key: "19512ee329af099f1c06a452c57016bc"
server_key_iv: "2a7cf24fd9b83cbfa6f1c4b3f94c544a"
server_key_version: "encryptionkey@0"
I20260809 09:26:50.363757 32632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance:
uuid: "d5ba0081f6994642942b20c710ade3c7"
format_stamp: "Formatted at 2026-08-09 09:26:50 on dist-test-slave-pgkr"
server_key: "19512ee329af099f1c06a452c57016bc"
server_key_iv: "2a7cf24fd9b83cbfa6f1c4b3f94c544a"
server_key_version: "encryptionkey@0"
I20260809 09:26:50.367089 32632 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 09:26:50.369247 32647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:50.370347 32632 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:26:50.370504 32632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "d5ba0081f6994642942b20c710ade3c7"
format_stamp: "Formatted at 2026-08-09 09:26:50 on dist-test-slave-pgkr"
server_key: "19512ee329af099f1c06a452c57016bc"
server_key_iv: "2a7cf24fd9b83cbfa6f1c4b3f94c544a"
server_key_version: "encryptionkey@0"
I20260809 09:26:50.370613 32632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:50.382787 32632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:50.385906 32632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:50.386122 32632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:50.386752 32632 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:26:50.387566 32632 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:26:50.387638 32632 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:50.387703 32632 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:26:50.387759 32632 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:50.396759 32632 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:36873
I20260809 09:26:50.396790 32766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:36873 every 8 connection(s)
I20260809 09:26:50.397603 32632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:26:50.403311 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 32632
I20260809 09:26:50.403441 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance
I20260809 09:26:50.403738 11663 external_mini_cluster.cc:1428] Setting key 337b04c9038523b5362c8e78ef5a3c96
Aug 09 09:26:50 dist-test-slave-pgkr krb5kdc[32523](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267610, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.193@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:26:50.412117 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:50.399305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:34189 (local address 127.11.99.254:40487)
0809 09:26:50.399438 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:50.399441 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:50.400237 (+ 796us) server_negotiation.cc:407] Connection header received
0809 09:26:50.401626 (+ 1389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:50.401630 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:50.401691 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:50.401788 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:50.402984 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.403785 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.405091 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.405400 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.405483 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:50.408229 (+ 2746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:50.408235 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:50.408239 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:50.408270 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:50.409854 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:50.410477 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:50.410480 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:50.410481 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:50.410560 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:50.410983 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:50.410985 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:50.410987 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:50.411158 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:50.411245 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:50.411884 (+ 639us) server_negotiation.cc:299] Negotiation successful
0809 09:26:50.411999 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 09:26:50.413265 301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:50.399583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:40487 (local address 127.11.99.193:34189)
0809 09:26:50.400081 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:50.400124 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:50.401400 (+ 1276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:50.401950 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:50.401956 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:50.402274 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:26:50.402835 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:50.402850 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.403910 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.403912 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:50.404966 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:50.404978 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.405558 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.405564 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:50.405781 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:50.406366 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:26:50.406389 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:26:50.408069 (+ 1680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:26:50.409966 (+ 1897us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:50.409974 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:50.409989 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:50.410376 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:50.410688 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:50.410694 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:50.410698 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:50.410887 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:50.411265 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:26:50.411274 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:26:50.411600 (+ 326us) client_negotiation.cc:769] Sending connection context
0809 09:26:50.411812 (+ 212us) client_negotiation.cc:240] Negotiation successful
0809 09:26:50.412173 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":111,"threads_started":1}
I20260809 09:26:50.414556 32767 heartbeater.cc:347] Connected to a master server at 127.11.99.254:40487
I20260809 09:26:50.414844 32767 heartbeater.cc:464] Registering TS with master...
I20260809 09:26:50.415405 32767 heartbeater.cc:511] Master 127.11.99.254:40487 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.99.194@KRBTEST.COM; defaulting to no policy
I20260809 09:26:50.417052 32570 ts_manager.cc:194] Registered new tserver with Master: d5ba0081f6994642942b20c710ade3c7 (127.11.99.193:36873)
I20260809 09:26:50.418241 32570 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.193@KRBTEST.COM'} at 127.11.99.193:34189
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
Entry for principal kudu/127.11.99.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab.
I20260809 09:26:50.431761 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:0
--local_ip_for_outbound_sockets=127.11.99.194
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:40487
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:41137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:26:50.535238 304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:50.535496 304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:50.535570 304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:50.539455 304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:50.539522 304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:50.539602 304 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:26:50.544526 304 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:41137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.194.keytab
--principal=kudu/127.11.99.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:40487
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.304
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:50.545452 304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:50.546367 304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:50.554998 310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:50.555043 309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:50.554998 312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:50.555151 304 server_base.cc:1034] running on GCE node
I20260809 09:26:50.555611 304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:50.556125 304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:50.557296 304 hybrid_clock.cc:648] HybridClock initialized: now 1786267610557283 us; error 28 us; skew 500 ppm
Aug 09 09:26:50 dist-test-slave-pgkr krb5kdc[32523](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267610, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:26:50.559944 304 init.cc:377] Logged in from keytab as kudu/127.11.99.194@KRBTEST.COM (short username kudu)
I20260809 09:26:50.560782 304 webserver.cc:460] Webserver started at http://127.11.99.194:38903/ using document root <none> and password file <none>
I20260809 09:26:50.561318 304 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:50.561383 304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:50.561589 304 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:50.563588 304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-1/data/instance:
uuid: "cb640f695f914f4a80067ee59ccaaa7e"
format_stamp: "Formatted at 2026-08-09 09:26:50 on dist-test-slave-pgkr"
server_key: "b55a264c208400574fa2de74abf4d98b"
server_key_iv: "285802d7011fee7645e1fe203d9a9a18"
server_key_version: "encryptionkey@0"
I20260809 09:26:50.564148 304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance:
uuid: "cb640f695f914f4a80067ee59ccaaa7e"
format_stamp: "Formatted at 2026-08-09 09:26:50 on dist-test-slave-pgkr"
server_key: "b55a264c208400574fa2de74abf4d98b"
server_key_iv: "285802d7011fee7645e1fe203d9a9a18"
server_key_version: "encryptionkey@0"
I20260809 09:26:50.567551 304 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 09:26:50.569756 319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:50.571030 304 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:26:50.571152 304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "cb640f695f914f4a80067ee59ccaaa7e"
format_stamp: "Formatted at 2026-08-09 09:26:50 on dist-test-slave-pgkr"
server_key: "b55a264c208400574fa2de74abf4d98b"
server_key_iv: "285802d7011fee7645e1fe203d9a9a18"
server_key_version: "encryptionkey@0"
I20260809 09:26:50.571247 304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:50.599677 304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:50.602542 304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:50.602806 304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:50.603387 304 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:26:50.604202 304 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:26:50.604251 304 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:50.604323 304 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:26:50.604368 304 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:50.613910 304 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:37151
I20260809 09:26:50.613963 437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:37151 every 8 connection(s)
I20260809 09:26:50.614826 304 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:26:50.617436 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 304
I20260809 09:26:50.617585 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance
I20260809 09:26:50.618059 11663 external_mini_cluster.cc:1428] Setting key 9f700c660aae2a7d6588f45e81def3a1
Aug 09 09:26:50 dist-test-slave-pgkr krb5kdc[32523](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267610, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.194@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.99.195@KRBTEST.COM; defaulting to no policy
I20260809 09:26:50.628850 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:50.616519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:39105 (local address 127.11.99.254:40487)
0809 09:26:50.616661 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:50.616665 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:50.617485 (+ 820us) server_negotiation.cc:407] Connection header received
0809 09:26:50.619260 (+ 1775us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:50.619263 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:50.619315 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:50.619392 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:50.620672 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.621197 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.622293 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.622521 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.622666 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:50.625253 (+ 2587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:50.625256 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:50.625258 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:50.625281 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:50.626681 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:50.627162 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:50.627167 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:50.627169 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:50.627249 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:50.627679 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:50.627684 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:50.627686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:50.627869 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:50.627981 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:50.628556 (+ 575us) server_negotiation.cc:299] Negotiation successful
0809 09:26:50.628686 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 09:26:50.629671 440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:50.616868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:40487 (local address 127.11.99.194:39105)
0809 09:26:50.617325 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:50.617368 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:50.619039 (+ 1671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:50.619570 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:50.619577 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:50.620042 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:26:50.620511 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:50.620523 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.621324 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.621327 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:50.622163 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:50.622172 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.622706 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.622711 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:50.622872 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:50.623443 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:26:50.623458 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:26:50.625080 (+ 1622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:26:50.626788 (+ 1708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:50.626794 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:50.626806 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:50.627052 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:50.627348 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:50.627353 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:50.627355 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:50.627580 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:50.627978 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:26:50.627985 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:26:50.628276 (+ 291us) client_negotiation.cc:769] Sending connection context
0809 09:26:50.628473 (+ 197us) client_negotiation.cc:240] Negotiation successful
0809 09:26:50.628790 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":112,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.195@KRBTEST.COM" created.
I20260809 09:26:50.631006 438 heartbeater.cc:347] Connected to a master server at 127.11.99.254:40487
I20260809 09:26:50.631255 438 heartbeater.cc:464] Registering TS with master...
I20260809 09:26:50.631887 438 heartbeater.cc:511] Master 127.11.99.254:40487 requested a full tablet report, sending...
I20260809 09:26:50.633080 32570 ts_manager.cc:194] Registered new tserver with Master: cb640f695f914f4a80067ee59ccaaa7e (127.11.99.194:37151)
I20260809 09:26:50.633668 32570 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.194@KRBTEST.COM'} at 127.11.99.194:39105
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
Entry for principal kudu/127.11.99.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab.
I20260809 09:26:50.645502 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:0
--local_ip_for_outbound_sockets=127.11.99.195
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:40487
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:41137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:26:50.750089 444 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:50.750298 444 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:50.750336 444 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:50.754347 444 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:50.754396 444 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:50.754448 444 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:26:50.759333 444 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:41137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.195.keytab
--principal=kudu/127.11.99.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:40487
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.444
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:50.760104 444 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:50.760896 444 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:50.769729 450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:50.769780 449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:50.769945 444 server_base.cc:1034] running on GCE node
W20260809 09:26:50.769784 452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:50.770506 444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:50.771097 444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:50.772297 444 hybrid_clock.cc:648] HybridClock initialized: now 1786267610772287 us; error 28 us; skew 500 ppm
Aug 09 09:26:50 dist-test-slave-pgkr krb5kdc[32523](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267610, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:26:50.775230 444 init.cc:377] Logged in from keytab as kudu/127.11.99.195@KRBTEST.COM (short username kudu)
I20260809 09:26:50.776136 444 webserver.cc:460] Webserver started at http://127.11.99.195:42839/ using document root <none> and password file <none>
I20260809 09:26:50.776647 444 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:50.776706 444 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:50.776937 444 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:50.778776 444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-2/data/instance:
uuid: "bfa2b416007a4bdcb64679f144c0933b"
format_stamp: "Formatted at 2026-08-09 09:26:50 on dist-test-slave-pgkr"
server_key: "0a76c45fa56869ed2436e677eafa6c63"
server_key_iv: "00c46d2317b2df45458fb1fe9cb7e74f"
server_key_version: "encryptionkey@0"
I20260809 09:26:50.779287 444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance:
uuid: "bfa2b416007a4bdcb64679f144c0933b"
format_stamp: "Formatted at 2026-08-09 09:26:50 on dist-test-slave-pgkr"
server_key: "0a76c45fa56869ed2436e677eafa6c63"
server_key_iv: "00c46d2317b2df45458fb1fe9cb7e74f"
server_key_version: "encryptionkey@0"
I20260809 09:26:50.782783 444 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 09:26:50.784902 460 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:50.785969 444 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:26:50.786108 444 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "bfa2b416007a4bdcb64679f144c0933b"
format_stamp: "Formatted at 2026-08-09 09:26:50 on dist-test-slave-pgkr"
server_key: "0a76c45fa56869ed2436e677eafa6c63"
server_key_iv: "00c46d2317b2df45458fb1fe9cb7e74f"
server_key_version: "encryptionkey@0"
I20260809 09:26:50.786224 444 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:50.804877 444 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:50.807595 444 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:50.807770 444 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:50.808276 444 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:26:50.809036 444 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:26:50.809114 444 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:50.809181 444 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:26:50.809223 444 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:50.817703 444 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:40693
I20260809 09:26:50.817739 577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:40693 every 8 connection(s)
I20260809 09:26:50.818528 444 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:26:50.821296 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 444
I20260809 09:26:50.821424 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance
I20260809 09:26:50.821787 11663 external_mini_cluster.cc:1428] Setting key 205cee758f4243c70e1ccc5dc0d04649
Aug 09 09:26:50 dist-test-slave-pgkr krb5kdc[32523](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267610, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.195@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:26:50.831326 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:50.820272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:54163 (local address 127.11.99.254:40487)
0809 09:26:50.820423 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:50.820427 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:50.821275 (+ 848us) server_negotiation.cc:407] Connection header received
0809 09:26:50.822890 (+ 1615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:50.822892 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:50.822937 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:50.823022 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:50.824302 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.824831 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.825865 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.826073 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.826143 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:50.828240 (+ 2097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:50.828243 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:50.828245 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:50.828265 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:50.829693 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:50.830084 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:50.830086 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:50.830087 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:50.830154 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:50.830434 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:50.830436 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:50.830437 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:50.830655 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:50.830738 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:50.831124 (+ 386us) server_negotiation.cc:299] Negotiation successful
0809 09:26:50.831214 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 09:26:50.832026 580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:50.820605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:40487 (local address 127.11.99.195:54163)
0809 09:26:50.821054 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:50.821126 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:50.822689 (+ 1563us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:50.823153 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:50.823159 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:50.823591 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:26:50.824178 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:50.824192 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.824931 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.824933 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:50.825758 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:50.825767 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.826188 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.826190 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:50.826312 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:50.826777 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:26:50.826790 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:26:50.828110 (+ 1320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:26:50.829781 (+ 1671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:50.829785 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:50.829794 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:50.830006 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:50.830225 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:26:50.830227 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:26:50.830228 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:26:50.830360 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:26:50.830735 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:26:50.830740 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:26:50.830936 (+ 196us) client_negotiation.cc:769] Sending connection context
0809 09:26:50.831078 (+ 142us) client_negotiation.cc:240] Negotiation successful
0809 09:26:50.831302 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":106,"threads_started":1}
I20260809 09:26:50.833088 578 heartbeater.cc:347] Connected to a master server at 127.11.99.254:40487
I20260809 09:26:50.833300 578 heartbeater.cc:464] Registering TS with master...
I20260809 09:26:50.833725 578 heartbeater.cc:511] Master 127.11.99.254:40487 requested a full tablet report, sending...
I20260809 09:26:50.834815 32570 ts_manager.cc:194] Registered new tserver with Master: bfa2b416007a4bdcb64679f144c0933b (127.11.99.195:40693)
I20260809 09:26:50.835436 32570 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.99.195@KRBTEST.COM'} at 127.11.99.195:54163
I20260809 09:26:50.835681 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 09:26:50.843750 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:50.837576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35118 (local address 127.11.99.254:40487)
0809 09:26:50.837727 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:50.837733 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:50.837877 (+ 144us) server_negotiation.cc:407] Connection header received
0809 09:26:50.837964 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:50.837965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:50.837998 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:50.838054 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:50.838652 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.839132 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.839856 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.840042 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.840117 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:50.841254 (+ 1137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:50.841256 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:50.841258 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:50.841278 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:50.842416 (+ 1138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:50.842831 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:50.842833 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:50.842834 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:50.842914 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:50.843100 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:50.843101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:50.843102 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:50.843258 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:50.843342 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:50.843487 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 09:26:50.843578 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 09:26:50.846194 32570 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35118:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 09:26:50.849015 32570 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:26:50.862339 592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:50.856986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:40693 (local address 127.0.0.1:60298)
0809 09:26:50.857545 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:50.857559 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:50.857636 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:50.858266 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:50.858271 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:50.858286 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:50.858352 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:50.858359 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.859832 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.859834 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:50.860940 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:50.860949 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.861749 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.861752 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:50.861875 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:50.861919 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 09:26:50.862059 (+ 140us) client_negotiation.cc:240] Negotiation successful
0809 09:26:50.862174 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"mutex_wait_us":43,"thread_start_us":82,"threads_started":1}
I20260809 09:26:50.862526 593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:50.857176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58970 (local address 127.11.99.194:37151)
0809 09:26:50.857493 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:50.857519 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:50.857543 (+ 24us) server_negotiation.cc:407] Connection header received
0809 09:26:50.857621 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:50.857626 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:50.857843 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:50.858327 (+ 484us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:50.858474 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.859623 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.861119 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.861913 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.862015 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:50.862171 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:50.862286 (+ 115us) server_negotiation.cc:299] Negotiation successful
0809 09:26:50.862397 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":100,"threads_started":1}
I20260809 09:26:50.862820 590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:50.856473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43786 (local address 127.11.99.193:36873)
0809 09:26:50.857706 (+ 1233us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:50.857716 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:50.857737 (+ 21us) server_negotiation.cc:407] Connection header received
0809 09:26:50.857813 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:50.857818 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:50.857982 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:50.858438 (+ 456us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:50.858578 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.859307 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.860955 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.861793 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.862383 (+ 590us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:50.862512 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:50.862564 (+ 52us) server_negotiation.cc:299] Negotiation successful
0809 09:26:50.862703 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1133,"thread_start_us":122,"threads_started":1}
I20260809 09:26:50.863111 594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:50.857200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60298 (local address 127.11.99.195:40693)
0809 09:26:50.857512 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:50.857779 (+ 267us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:50.857798 (+ 19us) server_negotiation.cc:407] Connection header received
0809 09:26:50.857853 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:50.857857 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:50.857981 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:50.858124 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:50.858475 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.859633 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.861065 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.861623 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.861747 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:50.861889 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:50.862852 (+ 963us) server_negotiation.cc:299] Negotiation successful
0809 09:26:50.862979 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":128,"threads_started":1}
I20260809 09:26:50.862463 589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:50.856355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:36873 (local address 127.0.0.1:43786)
0809 09:26:50.856648 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:50.856691 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:50.856801 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:50.858175 (+ 1374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:50.858178 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:50.858195 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:50.858296 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:50.858303 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.859450 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.859454 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:50.860813 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:50.860824 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.861943 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.861950 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:50.862089 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:50.862111 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 09:26:50.862174 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 09:26:50.862258 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"mutex_wait_us":56,"thread_start_us":73,"threads_started":1}
I20260809 09:26:50.862564 591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:50.856777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:37151 (local address 127.0.0.1:58970)
0809 09:26:50.857046 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:50.857058 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:50.857136 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:50.858010 (+ 874us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:50.858015 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:50.858036 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:50.858177 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:50.858186 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.859782 (+ 1596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.859786 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:50.860977 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:50.860985 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.862030 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.862036 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:50.862148 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:50.862168 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 09:26:50.862241 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 09:26:50.862299 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":47,"thread_start_us":111,"threads_started":1}
I20260809 09:26:50.865890 369 tablet_service.cc:1467] Processing CreateTablet for tablet cf892d2f895844f980529f3f05ced5b5 (DEFAULT_TABLE table=test-table [id=416d031e9da54526bcadd60e9acf8381]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:26:50.865867 509 tablet_service.cc:1467] Processing CreateTablet for tablet cf892d2f895844f980529f3f05ced5b5 (DEFAULT_TABLE table=test-table [id=416d031e9da54526bcadd60e9acf8381]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:26:50.866799 369 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf892d2f895844f980529f3f05ced5b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:50.866812 509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf892d2f895844f980529f3f05ced5b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:50.868194 32699 tablet_service.cc:1467] Processing CreateTablet for tablet cf892d2f895844f980529f3f05ced5b5 (DEFAULT_TABLE table=test-table [id=416d031e9da54526bcadd60e9acf8381]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:26:50.869138 32699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf892d2f895844f980529f3f05ced5b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:50.873454 596 tablet_bootstrap.cc:492] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e: Bootstrap starting.
I20260809 09:26:50.874050 597 tablet_bootstrap.cc:492] T cf892d2f895844f980529f3f05ced5b5 P bfa2b416007a4bdcb64679f144c0933b: Bootstrap starting.
I20260809 09:26:50.875803 598 tablet_bootstrap.cc:492] T cf892d2f895844f980529f3f05ced5b5 P d5ba0081f6994642942b20c710ade3c7: Bootstrap starting.
I20260809 09:26:50.876179 596 tablet_bootstrap.cc:654] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:50.876509 597 tablet_bootstrap.cc:654] T cf892d2f895844f980529f3f05ced5b5 P bfa2b416007a4bdcb64679f144c0933b: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:50.877472 598 tablet_bootstrap.cc:654] T cf892d2f895844f980529f3f05ced5b5 P d5ba0081f6994642942b20c710ade3c7: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:50.877583 596 log.cc:824] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:50.877719 597 log.cc:824] T cf892d2f895844f980529f3f05ced5b5 P bfa2b416007a4bdcb64679f144c0933b: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:50.878856 598 log.cc:824] T cf892d2f895844f980529f3f05ced5b5 P d5ba0081f6994642942b20c710ade3c7: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:50.879735 596 tablet_bootstrap.cc:492] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e: No bootstrap required, opened a new log
I20260809 09:26:50.879735 597 tablet_bootstrap.cc:492] T cf892d2f895844f980529f3f05ced5b5 P bfa2b416007a4bdcb64679f144c0933b: No bootstrap required, opened a new log
I20260809 09:26:50.879920 596 ts_tablet_manager.cc:1397] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260809 09:26:50.879921 597 ts_tablet_manager.cc:1397] T cf892d2f895844f980529f3f05ced5b5 P bfa2b416007a4bdcb64679f144c0933b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 09:26:50.880558 598 tablet_bootstrap.cc:492] T cf892d2f895844f980529f3f05ced5b5 P d5ba0081f6994642942b20c710ade3c7: No bootstrap required, opened a new log
I20260809 09:26:50.880772 598 ts_tablet_manager.cc:1397] T cf892d2f895844f980529f3f05ced5b5 P d5ba0081f6994642942b20c710ade3c7: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260809 09:26:50.883416 598 raft_consensus.cc:348] T cf892d2f895844f980529f3f05ced5b5 P d5ba0081f6994642942b20c710ade3c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ba0081f6994642942b20c710ade3c7" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 36873 } } peers { permanent_uuid: "bfa2b416007a4bdcb64679f144c0933b" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 40693 } } peers { permanent_uuid: "cb640f695f914f4a80067ee59ccaaa7e" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37151 } }
I20260809 09:26:50.883671 598 raft_consensus.cc:374] T cf892d2f895844f980529f3f05ced5b5 P d5ba0081f6994642942b20c710ade3c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:50.883728 598 raft_consensus.cc:729] T cf892d2f895844f980529f3f05ced5b5 P d5ba0081f6994642942b20c710ade3c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ba0081f6994642942b20c710ade3c7, State: Initialized, Role: FOLLOWER
I20260809 09:26:50.883667 597 raft_consensus.cc:348] T cf892d2f895844f980529f3f05ced5b5 P bfa2b416007a4bdcb64679f144c0933b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ba0081f6994642942b20c710ade3c7" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 36873 } } peers { permanent_uuid: "bfa2b416007a4bdcb64679f144c0933b" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 40693 } } peers { permanent_uuid: "cb640f695f914f4a80067ee59ccaaa7e" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37151 } }
I20260809 09:26:50.883667 596 raft_consensus.cc:348] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ba0081f6994642942b20c710ade3c7" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 36873 } } peers { permanent_uuid: "bfa2b416007a4bdcb64679f144c0933b" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 40693 } } peers { permanent_uuid: "cb640f695f914f4a80067ee59ccaaa7e" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37151 } }
I20260809 09:26:50.883905 596 raft_consensus.cc:374] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:50.883905 597 raft_consensus.cc:374] T cf892d2f895844f980529f3f05ced5b5 P bfa2b416007a4bdcb64679f144c0933b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:50.883970 596 raft_consensus.cc:729] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb640f695f914f4a80067ee59ccaaa7e, State: Initialized, Role: FOLLOWER
I20260809 09:26:50.883978 597 raft_consensus.cc:729] T cf892d2f895844f980529f3f05ced5b5 P bfa2b416007a4bdcb64679f144c0933b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfa2b416007a4bdcb64679f144c0933b, State: Initialized, Role: FOLLOWER
I20260809 09:26:50.884235 598 consensus_queue.cc:260] T cf892d2f895844f980529f3f05ced5b5 P d5ba0081f6994642942b20c710ade3c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ba0081f6994642942b20c710ade3c7" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 36873 } } peers { permanent_uuid: "bfa2b416007a4bdcb64679f144c0933b" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 40693 } } peers { permanent_uuid: "cb640f695f914f4a80067ee59ccaaa7e" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37151 } }
I20260809 09:26:50.884379 597 consensus_queue.cc:260] T cf892d2f895844f980529f3f05ced5b5 P bfa2b416007a4bdcb64679f144c0933b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ba0081f6994642942b20c710ade3c7" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 36873 } } peers { permanent_uuid: "bfa2b416007a4bdcb64679f144c0933b" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 40693 } } peers { permanent_uuid: "cb640f695f914f4a80067ee59ccaaa7e" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37151 } }
I20260809 09:26:50.884379 596 consensus_queue.cc:260] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ba0081f6994642942b20c710ade3c7" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 36873 } } peers { permanent_uuid: "bfa2b416007a4bdcb64679f144c0933b" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 40693 } } peers { permanent_uuid: "cb640f695f914f4a80067ee59ccaaa7e" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37151 } }
I20260809 09:26:50.885251 598 ts_tablet_manager.cc:1428] T cf892d2f895844f980529f3f05ced5b5 P d5ba0081f6994642942b20c710ade3c7: Time spent starting tablet: real 0.004s user 0.004s sys 0.001s
I20260809 09:26:50.885255 597 ts_tablet_manager.cc:1428] T cf892d2f895844f980529f3f05ced5b5 P bfa2b416007a4bdcb64679f144c0933b: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 09:26:50.885617 32767 heartbeater.cc:503] Master 127.11.99.254:40487 was elected leader, sending a full tablet report...
I20260809 09:26:50.885654 438 heartbeater.cc:503] Master 127.11.99.254:40487 was elected leader, sending a full tablet report...
I20260809 09:26:50.886600 578 heartbeater.cc:503] Master 127.11.99.254:40487 was elected leader, sending a full tablet report...
I20260809 09:26:50.887661 596 ts_tablet_manager.cc:1428] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
W20260809 09:26:50.898792 300 tablet.cc:2369] T cf892d2f895844f980529f3f05ced5b5 P d5ba0081f6994642942b20c710ade3c7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:26:50.913636 604 raft_consensus.cc:482] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:26:50.913813 604 raft_consensus.cc:504] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ba0081f6994642942b20c710ade3c7" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 36873 } } peers { permanent_uuid: "bfa2b416007a4bdcb64679f144c0933b" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 40693 } } peers { permanent_uuid: "cb640f695f914f4a80067ee59ccaaa7e" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37151 } }
I20260809 09:26:50.914939 604 leader_election.cc:288] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ba0081f6994642942b20c710ade3c7 (127.11.99.193:36873), bfa2b416007a4bdcb64679f144c0933b (127.11.99.195:40693)
I20260809 09:26:50.918764 440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:50.915199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:36873 (local address 127.11.99.194:33003)
0809 09:26:50.915347 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:50.915365 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:50.915472 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:50.915766 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:50.915769 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:50.915787 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:50.915924 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:50.915933 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.916692 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.916698 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:50.917451 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:50.917459 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.918256 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.918262 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:50.918408 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:50.918440 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 09:26:50.918528 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 09:26:50.918605 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58,"mutex_wait_us":1}
I20260809 09:26:50.918853 590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:50.915288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:33003 (local address 127.11.99.193:36873)
0809 09:26:50.915435 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:50.915440 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:50.915456 (+ 16us) server_negotiation.cc:407] Connection header received
0809 09:26:50.915583 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:50.915587 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:50.915643 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:50.915735 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:50.916030 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.916580 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.917575 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.918136 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.918251 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:50.918301 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:50.918627 (+ 326us) server_negotiation.cc:299] Negotiation successful
0809 09:26:50.918708 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 09:26:50.919014 594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:50.915653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:44539 (local address 127.11.99.195:40693)
0809 09:26:50.915814 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:50.915820 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:50.915852 (+ 32us) server_negotiation.cc:407] Connection header received
0809 09:26:50.915984 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:50.915988 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:50.916055 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:50.916127 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:50.916407 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.916878 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.917880 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.918468 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.918628 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:50.918676 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:50.918818 (+ 142us) server_negotiation.cc:299] Negotiation successful
0809 09:26:50.918895 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 09:26:50.919123 605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:50.915480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:40693 (local address 127.11.99.194:44539)
0809 09:26:50.915786 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:50.915799 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:50.915880 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:50.916139 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:50.916142 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:50.916161 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:50.916294 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:50.916300 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.916985 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.916989 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:50.917744 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:50.917753 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.918588 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.918591 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:50.918699 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:50.918720 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 09:26:50.918793 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 09:26:50.918988 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":110,"threads_started":1}
I20260809 09:26:50.919358 32721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf892d2f895844f980529f3f05ced5b5" candidate_uuid: "cb640f695f914f4a80067ee59ccaaa7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ba0081f6994642942b20c710ade3c7" is_pre_election: true
I20260809 09:26:50.919632 32721 raft_consensus.cc:2454] T cf892d2f895844f980529f3f05ced5b5 P d5ba0081f6994642942b20c710ade3c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb640f695f914f4a80067ee59ccaaa7e in term 0.
I20260809 09:26:50.919693 530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf892d2f895844f980529f3f05ced5b5" candidate_uuid: "cb640f695f914f4a80067ee59ccaaa7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfa2b416007a4bdcb64679f144c0933b" is_pre_election: true
I20260809 09:26:50.919962 530 raft_consensus.cc:2454] T cf892d2f895844f980529f3f05ced5b5 P bfa2b416007a4bdcb64679f144c0933b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb640f695f914f4a80067ee59ccaaa7e in term 0.
I20260809 09:26:50.920121 324 leader_election.cc:302] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb640f695f914f4a80067ee59ccaaa7e, d5ba0081f6994642942b20c710ade3c7; no voters:
I20260809 09:26:50.920399 604 raft_consensus.cc:2781] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:26:50.920496 604 raft_consensus.cc:482] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:26:50.920553 604 raft_consensus.cc:3037] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:50.921603 604 raft_consensus.cc:504] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ba0081f6994642942b20c710ade3c7" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 36873 } } peers { permanent_uuid: "bfa2b416007a4bdcb64679f144c0933b" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 40693 } } peers { permanent_uuid: "cb640f695f914f4a80067ee59ccaaa7e" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37151 } }
I20260809 09:26:50.921922 604 leader_election.cc:288] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e [CANDIDATE]: Term 1 election: Requested vote from peers d5ba0081f6994642942b20c710ade3c7 (127.11.99.193:36873), bfa2b416007a4bdcb64679f144c0933b (127.11.99.195:40693)
I20260809 09:26:50.922276 32721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf892d2f895844f980529f3f05ced5b5" candidate_uuid: "cb640f695f914f4a80067ee59ccaaa7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ba0081f6994642942b20c710ade3c7"
I20260809 09:26:50.922307 530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf892d2f895844f980529f3f05ced5b5" candidate_uuid: "cb640f695f914f4a80067ee59ccaaa7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfa2b416007a4bdcb64679f144c0933b"
I20260809 09:26:50.922392 32721 raft_consensus.cc:3037] T cf892d2f895844f980529f3f05ced5b5 P d5ba0081f6994642942b20c710ade3c7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:50.922426 530 raft_consensus.cc:3037] T cf892d2f895844f980529f3f05ced5b5 P bfa2b416007a4bdcb64679f144c0933b [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:50.923395 32721 raft_consensus.cc:2454] T cf892d2f895844f980529f3f05ced5b5 P d5ba0081f6994642942b20c710ade3c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb640f695f914f4a80067ee59ccaaa7e in term 1.
I20260809 09:26:50.923525 530 raft_consensus.cc:2454] T cf892d2f895844f980529f3f05ced5b5 P bfa2b416007a4bdcb64679f144c0933b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb640f695f914f4a80067ee59ccaaa7e in term 1.
I20260809 09:26:50.923682 324 leader_election.cc:302] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb640f695f914f4a80067ee59ccaaa7e, d5ba0081f6994642942b20c710ade3c7; no voters:
I20260809 09:26:50.923837 604 raft_consensus.cc:2781] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:26:50.924050 604 raft_consensus.cc:686] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e [term 1 LEADER]: Becoming Leader. State: Replica: cb640f695f914f4a80067ee59ccaaa7e, State: Running, Role: LEADER
I20260809 09:26:50.924401 604 consensus_queue.cc:237] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ba0081f6994642942b20c710ade3c7" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 36873 } } peers { permanent_uuid: "bfa2b416007a4bdcb64679f144c0933b" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 40693 } } peers { permanent_uuid: "cb640f695f914f4a80067ee59ccaaa7e" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37151 } }
I20260809 09:26:50.927277 32568 catalog_manager.cc:5495] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e reported cstate change: term changed from 0 to 1, leader changed from <none> to cb640f695f914f4a80067ee59ccaaa7e (127.11.99.194). New cstate: current_term: 1 leader_uuid: "cb640f695f914f4a80067ee59ccaaa7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ba0081f6994642942b20c710ade3c7" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 36873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfa2b416007a4bdcb64679f144c0933b" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 40693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb640f695f914f4a80067ee59ccaaa7e" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 37151 } health_report { overall_health: HEALTHY } } }
I20260809 09:26:50.941516 593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:50.937971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58976 (local address 127.11.99.194:37151)
0809 09:26:50.938087 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:50.938094 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:50.938129 (+ 35us) server_negotiation.cc:407] Connection header received
0809 09:26:50.938344 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:50.938347 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:50.938396 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:50.938501 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:26:50.938789 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.939262 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.940087 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:50.940299 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:50.940405 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:50.940697 (+ 292us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:26:50.941084 (+ 387us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:26:50.941208 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:50.941287 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 09:26:50.941340 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 09:26:50.947270 32721 raft_consensus.cc:1261] T cf892d2f895844f980529f3f05ced5b5 P d5ba0081f6994642942b20c710ade3c7 [term 1 FOLLOWER]: Refusing update from remote peer cb640f695f914f4a80067ee59ccaaa7e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:26:50.947270 530 raft_consensus.cc:1261] T cf892d2f895844f980529f3f05ced5b5 P bfa2b416007a4bdcb64679f144c0933b [term 1 FOLLOWER]: Refusing update from remote peer cb640f695f914f4a80067ee59ccaaa7e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:26:50.947927 604 consensus_queue.cc:1035] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfa2b416007a4bdcb64679f144c0933b" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 40693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:26:50.948155 606 consensus_queue.cc:1035] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ba0081f6994642942b20c710ade3c7" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 36873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:26:50.954348 609 mvcc.cc:205] Tried to move back new op lower bound from 7316552134432010240 to 7316552134348894208. Current Snapshot: MvccSnapshot[applied={T|T < 7316552134432010240}]
I20260809 09:26:50.955063 610 mvcc.cc:205] Tried to move back new op lower bound from 7316552134432010240 to 7316552134348894208. Current Snapshot: MvccSnapshot[applied={T|T < 7316552134432010240}]
I20260809 09:26:50.962744 32568 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35118:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:26:50.962872 32568 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35118:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:26:50.965006 32568 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9950a6ac18be4f6a9067d79e4fe70f0c: Sending DeleteTablet for 3 replicas of tablet cf892d2f895844f980529f3f05ced5b5
I20260809 09:26:50.965898 369 tablet_service.cc:1514] Processing DeleteTablet for tablet cf892d2f895844f980529f3f05ced5b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:26:50 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:58970
I20260809 09:26:50.965925 32699 tablet_service.cc:1514] Processing DeleteTablet for tablet cf892d2f895844f980529f3f05ced5b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:26:50 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:43786
I20260809 09:26:50.966393 619 tablet_replica.cc:330] T cf892d2f895844f980529f3f05ced5b5 P d5ba0081f6994642942b20c710ade3c7: stopping tablet replica
I20260809 09:26:50.966375 509 tablet_service.cc:1514] Processing DeleteTablet for tablet cf892d2f895844f980529f3f05ced5b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:26:50 UTC) from {username='kudu', principal='kudu/127.11.99.254@KRBTEST.COM'} at 127.0.0.1:60298
I20260809 09:26:50.966711 619 raft_consensus.cc:2229] T cf892d2f895844f980529f3f05ced5b5 P d5ba0081f6994642942b20c710ade3c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:26:50.966856 620 tablet_replica.cc:330] T cf892d2f895844f980529f3f05ced5b5 P bfa2b416007a4bdcb64679f144c0933b: stopping tablet replica
I20260809 09:26:50.966995 619 raft_consensus.cc:2258] T cf892d2f895844f980529f3f05ced5b5 P d5ba0081f6994642942b20c710ade3c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:26:50.967199 620 raft_consensus.cc:2229] T cf892d2f895844f980529f3f05ced5b5 P bfa2b416007a4bdcb64679f144c0933b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:26:50.967417 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 32632
I20260809 09:26:50.967545 620 raft_consensus.cc:2258] T cf892d2f895844f980529f3f05ced5b5 P bfa2b416007a4bdcb64679f144c0933b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:26:50.970700 620 ts_tablet_manager.cc:1905] T cf892d2f895844f980529f3f05ced5b5 P bfa2b416007a4bdcb64679f144c0933b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:26:50.971335 618 tablet_replica.cc:330] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e: stopping tablet replica
I20260809 09:26:50.971591 618 raft_consensus.cc:2229] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e [term 1 LEADER]: Raft consensus shutting down.
I20260809 09:26:50.971882 618 raft_consensus.cc:2258] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:26:50.973243 618 ts_tablet_manager.cc:1905] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:26:50.974161 620 ts_tablet_manager.cc:1918] T cf892d2f895844f980529f3f05ced5b5 P bfa2b416007a4bdcb64679f144c0933b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:26:50.974329 620 log.cc:1196] T cf892d2f895844f980529f3f05ced5b5 P bfa2b416007a4bdcb64679f144c0933b: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/cf892d2f895844f980529f3f05ced5b5
I20260809 09:26:50.974869 620 ts_tablet_manager.cc:1939] T cf892d2f895844f980529f3f05ced5b5 P bfa2b416007a4bdcb64679f144c0933b: Deleting consensus metadata
I20260809 09:26:50.976127 618 ts_tablet_manager.cc:1918] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:26:50.976257 618 log.cc:1196] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/cf892d2f895844f980529f3f05ced5b5
I20260809 09:26:50.976248 32556 catalog_manager.cc:4841] TS bfa2b416007a4bdcb64679f144c0933b (127.11.99.195:40693): tablet cf892d2f895844f980529f3f05ced5b5 (table test-table [id=416d031e9da54526bcadd60e9acf8381]) successfully deleted
I20260809 09:26:50.976627 618 ts_tablet_manager.cc:1939] T cf892d2f895844f980529f3f05ced5b5 P cb640f695f914f4a80067ee59ccaaa7e: Deleting consensus metadata
W20260809 09:26:50.976977 32556 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.99.193:36873 (error 108)
I20260809 09:26:50.977172 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 304
I20260809 09:26:50.978145 592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:50.977829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:36873 (local address 127.0.0.1:43792)
0809 09:26:50.977993 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:50.978054 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.193:36873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260809 09:26:50.978384 32556 catalog_manager.cc:4584] TS d5ba0081f6994642942b20c710ade3c7 (127.11.99.193:36873): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cf892d2f895844f980529f3f05ced5b5: Network error: Client connection negotiation failed: client connection to 127.11.99.193:36873: connect: Connection refused (error 111)
I20260809 09:26:50.983601 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 444
I20260809 09:26:50.984979 592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:50.983722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:37151 (local address 127.0.0.1:58990)
0809 09:26:50.984865 (+ 1143us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:50.984920 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.194:37151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1058}
I20260809 09:26:50.990095 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 32536
2026-08-09T09:26:50Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2159 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-09T09:26:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:26:51Z Disabled control of system clock
I20260809 09:26:51.022521 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:41415
--webserver_interface=127.11.99.254
--webserver_port=0
--builtin_ntp_servers=127.11.99.212:38785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:41415
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 09:26:51.126962 625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:51.127243 625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:51.127278 625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:51.131059 625 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:26:51.131105 625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:51.131120 625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:51.131175 625 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:26:51.131189 625 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:26:51.135591 625 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:38785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:41415
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:41415
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.625
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:51.136444 625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:51.137692 625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:51.145462 633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:51.145493 630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:51.145529 631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:51.145673 625 server_base.cc:1034] running on GCE node
I20260809 09:26:51.146275 625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:51.147348 625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:51.148538 625 hybrid_clock.cc:648] HybridClock initialized: now 1786267611148510 us; error 39 us; skew 500 ppm
I20260809 09:26:51.150166 625 webserver.cc:460] Webserver started at http://127.11.99.254:44219/ using document root <none> and password file <none>
I20260809 09:26:51.150739 625 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:51.150802 625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:51.151031 625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:51.152886 625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "f91ec2313d964f18b04fc6a149e54b50"
format_stamp: "Formatted at 2026-08-09 09:26:51 on dist-test-slave-pgkr"
server_key: "e07815a1ab74a8794b04133a18b70f8d"
server_key_iv: "b8eaedcbdcd802d8c61d7454db14e7d4"
server_key_version: "encryptionkey@0"
I20260809 09:26:51.153388 625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "f91ec2313d964f18b04fc6a149e54b50"
format_stamp: "Formatted at 2026-08-09 09:26:51 on dist-test-slave-pgkr"
server_key: "e07815a1ab74a8794b04133a18b70f8d"
server_key_iv: "b8eaedcbdcd802d8c61d7454db14e7d4"
server_key_version: "encryptionkey@0"
I20260809 09:26:51.156924 625 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260809 09:26:51.159123 640 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:51.160219 625 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:26:51.160365 625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "f91ec2313d964f18b04fc6a149e54b50"
format_stamp: "Formatted at 2026-08-09 09:26:51 on dist-test-slave-pgkr"
server_key: "e07815a1ab74a8794b04133a18b70f8d"
server_key_iv: "b8eaedcbdcd802d8c61d7454db14e7d4"
server_key_version: "encryptionkey@0"
I20260809 09:26:51.160477 625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:51.168784 625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:51.169299 625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:51.169471 625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:51.175809 625 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:41415
I20260809 09:26:51.175819 694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:41415 every 8 connection(s)
I20260809 09:26:51.176594 625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:26:51.177908 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 625
I20260809 09:26:51.178046 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:26:51.178315 11663 external_mini_cluster.cc:1428] Setting key ca523f8b815e8253612e3910329d25a7
I20260809 09:26:51.179662 695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:51.184715 695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f91ec2313d964f18b04fc6a149e54b50: Bootstrap starting.
I20260809 09:26:51.186470 698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:51.179515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39240 (local address 127.11.99.254:41415)
0809 09:26:51.180120 (+ 605us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:51.180134 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:51.180164 (+ 30us) server_negotiation.cc:407] Connection header received
0809 09:26:51.180750 (+ 586us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:51.180764 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:51.181104 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:51.181397 (+ 293us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:51.181784 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.182754 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.183590 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.184051 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.184220 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:51.185087 (+ 867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:51.185091 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:51.185101 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:26:51.185417 (+ 316us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:51.185464 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:26:51.185480 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:51.185588 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:51.185688 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 09:26:51.185903 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":142,"threads_started":1}
I20260809 09:26:51.186762 695 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f91ec2313d964f18b04fc6a149e54b50: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:51.187570 695 log.cc:824] T 00000000000000000000000000000000 P f91ec2313d964f18b04fc6a149e54b50: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:51.189268 695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f91ec2313d964f18b04fc6a149e54b50: No bootstrap required, opened a new log
I20260809 09:26:51.192576 695 raft_consensus.cc:348] T 00000000000000000000000000000000 P f91ec2313d964f18b04fc6a149e54b50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f91ec2313d964f18b04fc6a149e54b50" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 41415 } }
I20260809 09:26:51.192768 695 raft_consensus.cc:374] T 00000000000000000000000000000000 P f91ec2313d964f18b04fc6a149e54b50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:51.192835 695 raft_consensus.cc:729] T 00000000000000000000000000000000 P f91ec2313d964f18b04fc6a149e54b50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91ec2313d964f18b04fc6a149e54b50, State: Initialized, Role: FOLLOWER
I20260809 09:26:51.193245 695 consensus_queue.cc:260] T 00000000000000000000000000000000 P f91ec2313d964f18b04fc6a149e54b50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f91ec2313d964f18b04fc6a149e54b50" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 41415 } }
I20260809 09:26:51.193363 695 raft_consensus.cc:388] T 00000000000000000000000000000000 P f91ec2313d964f18b04fc6a149e54b50 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:26:51.193470 695 raft_consensus.cc:482] T 00000000000000000000000000000000 P f91ec2313d964f18b04fc6a149e54b50 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:26:51.193593 695 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f91ec2313d964f18b04fc6a149e54b50 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:51.194409 695 raft_consensus.cc:504] T 00000000000000000000000000000000 P f91ec2313d964f18b04fc6a149e54b50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f91ec2313d964f18b04fc6a149e54b50" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 41415 } }
I20260809 09:26:51.194766 695 leader_election.cc:302] T 00000000000000000000000000000000 P f91ec2313d964f18b04fc6a149e54b50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f91ec2313d964f18b04fc6a149e54b50; no voters:
I20260809 09:26:51.195067 695 leader_election.cc:288] T 00000000000000000000000000000000 P f91ec2313d964f18b04fc6a149e54b50 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:26:51.195179 700 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f91ec2313d964f18b04fc6a149e54b50 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:26:51.195442 700 raft_consensus.cc:686] T 00000000000000000000000000000000 P f91ec2313d964f18b04fc6a149e54b50 [term 1 LEADER]: Becoming Leader. State: Replica: f91ec2313d964f18b04fc6a149e54b50, State: Running, Role: LEADER
I20260809 09:26:51.195744 700 consensus_queue.cc:237] T 00000000000000000000000000000000 P f91ec2313d964f18b04fc6a149e54b50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f91ec2313d964f18b04fc6a149e54b50" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 41415 } }
I20260809 09:26:51.196241 695 sys_catalog.cc:564] T 00000000000000000000000000000000 P f91ec2313d964f18b04fc6a149e54b50 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:26:51.197505 702 sys_catalog.cc:455] T 00000000000000000000000000000000 P f91ec2313d964f18b04fc6a149e54b50 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f91ec2313d964f18b04fc6a149e54b50. Latest consensus state: current_term: 1 leader_uuid: "f91ec2313d964f18b04fc6a149e54b50" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f91ec2313d964f18b04fc6a149e54b50" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 41415 } } }
I20260809 09:26:51.197639 702 sys_catalog.cc:458] T 00000000000000000000000000000000 P f91ec2313d964f18b04fc6a149e54b50 [sys.catalog]: This master's current role is: LEADER
I20260809 09:26:51.197855 701 sys_catalog.cc:455] T 00000000000000000000000000000000 P f91ec2313d964f18b04fc6a149e54b50 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f91ec2313d964f18b04fc6a149e54b50" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f91ec2313d964f18b04fc6a149e54b50" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 41415 } } }
I20260809 09:26:51.197944 701 sys_catalog.cc:458] T 00000000000000000000000000000000 P f91ec2313d964f18b04fc6a149e54b50 [sys.catalog]: This master's current role is: LEADER
W20260809 09:26:51.200608 717 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f91ec2313d964f18b04fc6a149e54b50: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 09:26:51.200714 717 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 09:26:51.200809 709 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:26:51.201539 709 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:26:51.206411 709 catalog_manager.cc:1347] Generated new cluster ID: b460f324155b4bd3b323f5af5d74a28e
I20260809 09:26:51.206475 709 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:26:51.215268 709 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:26:51.216056 709 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:26:51.226795 709 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f91ec2313d964f18b04fc6a149e54b50: Generated new TSK 0
I20260809 09:26:51.227346 709 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:26:51.236651 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.193:0
--local_ip_for_outbound_sockets=127.11.99.193
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:41415
--builtin_ntp_servers=127.11.99.212:38785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 09:26:51.385982 720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:51.386267 720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:51.386335 720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:51.391527 720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:51.391582 720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:51.391635 720 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.193
I20260809 09:26:51.396035 720 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:38785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.99.193
--webserver_port=0
--tserver_master_addrs=127.11.99.254:41415
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.720
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.193
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:51.396999 720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:51.398239 720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:51.406776 728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:51.406795 726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:51.406795 725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:51.407159 720 server_base.cc:1034] running on GCE node
I20260809 09:26:51.407488 720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:51.408077 720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:51.409258 720 hybrid_clock.cc:648] HybridClock initialized: now 1786267611409246 us; error 24 us; skew 500 ppm
I20260809 09:26:51.410959 720 webserver.cc:460] Webserver started at http://127.11.99.193:38771/ using document root <none> and password file <none>
I20260809 09:26:51.411475 720 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:51.411567 720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:51.411784 720 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:51.413635 720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-0/data/instance:
uuid: "97f04e85370f4cab9ff4f4029edde281"
format_stamp: "Formatted at 2026-08-09 09:26:51 on dist-test-slave-pgkr"
server_key: "8097e376344114d26018df72c4a3e450"
server_key_iv: "e567cd6d60d6ada22408d5b10beeddfd"
server_key_version: "encryptionkey@0"
I20260809 09:26:51.414160 720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance:
uuid: "97f04e85370f4cab9ff4f4029edde281"
format_stamp: "Formatted at 2026-08-09 09:26:51 on dist-test-slave-pgkr"
server_key: "8097e376344114d26018df72c4a3e450"
server_key_iv: "e567cd6d60d6ada22408d5b10beeddfd"
server_key_version: "encryptionkey@0"
I20260809 09:26:51.417503 720 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 09:26:51.419620 734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:51.420698 720 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 09:26:51.420843 720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-0/wal
uuid: "97f04e85370f4cab9ff4f4029edde281"
format_stamp: "Formatted at 2026-08-09 09:26:51 on dist-test-slave-pgkr"
server_key: "8097e376344114d26018df72c4a3e450"
server_key_iv: "e567cd6d60d6ada22408d5b10beeddfd"
server_key_version: "encryptionkey@0"
I20260809 09:26:51.420953 720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:51.443166 720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:51.443737 720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:51.443917 720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:51.444425 720 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:26:51.445258 720 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:26:51.445327 720 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:51.445395 720 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:26:51.445446 720 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:51.453778 720 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.193:38911
I20260809 09:26:51.453822 852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.193:38911 every 8 connection(s)
I20260809 09:26:51.454661 720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-0/data/info.pb
I20260809 09:26:51.462750 698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:51.456255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.193:56743 (local address 127.11.99.254:41415)
0809 09:26:51.456424 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:51.456429 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:51.457357 (+ 928us) server_negotiation.cc:407] Connection header received
0809 09:26:51.458645 (+ 1288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:51.458650 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:51.458728 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:51.458804 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:51.459584 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.460077 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.461082 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.461291 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.461363 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:51.462333 (+ 970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:51.462336 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:51.462337 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:26:51.462346 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:51.462359 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:26:51.462366 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:51.462415 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:51.462555 (+ 140us) server_negotiation.cc:299] Negotiation successful
0809 09:26:51.462597 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 09:26:51.463544 855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:51.456627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:41415 (local address 127.11.99.193:56743)
0809 09:26:51.457221 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:51.457266 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:51.458450 (+ 1184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:51.458952 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:51.458957 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:51.459030 (+ 73us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:26:51.459468 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:51.459479 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.460178 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.460180 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:51.460985 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:51.460994 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.461410 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.461412 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:51.461538 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:51.462118 (+ 580us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 09:26:51.462119 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:26:51.462154 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 09:26:51.462209 (+ 55us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:26:51.462444 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:26:51.462451 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:26:51.462454 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 09:26:51.462535 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 09:26:51.462733 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":104,"threads_started":1}
I20260809 09:26:51.464612 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 720
I20260809 09:26:51.464737 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-0/wal/instance
I20260809 09:26:51.464819 853 heartbeater.cc:347] Connected to a master server at 127.11.99.254:41415
I20260809 09:26:51.465049 853 heartbeater.cc:464] Registering TS with master...
I20260809 09:26:51.465063 11663 external_mini_cluster.cc:1428] Setting key aabdc95c1e6b3ef84a32f558ee89ce7a
I20260809 09:26:51.465580 853 heartbeater.cc:511] Master 127.11.99.254:41415 requested a full tablet report, sending...
I20260809 09:26:51.466912 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.194:0
--local_ip_for_outbound_sockets=127.11.99.194
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:41415
--builtin_ntp_servers=127.11.99.212:38785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 09:26:51.466966 657 ts_manager.cc:194] Registered new tserver with Master: 97f04e85370f4cab9ff4f4029edde281 (127.11.99.193:38911)
I20260809 09:26:51.467993 657 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.99.193:56743
W20260809 09:26:51.571046 856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:51.571280 856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:51.571316 856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:51.575258 856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:51.575306 856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:51.575357 856 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.194
I20260809 09:26:51.579759 856 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:38785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.99.194
--webserver_port=0
--tserver_master_addrs=127.11.99.254:41415
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.856
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.194
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:51.580639 856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:51.581878 856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:51.591060 862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:51.591133 856 server_base.cc:1034] running on GCE node
W20260809 09:26:51.591253 861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:51.591112 864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:51.591641 856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:51.592221 856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:51.593420 856 hybrid_clock.cc:648] HybridClock initialized: now 1786267611593412 us; error 63 us; skew 500 ppm
I20260809 09:26:51.595193 856 webserver.cc:460] Webserver started at http://127.11.99.194:39205/ using document root <none> and password file <none>
I20260809 09:26:51.595726 856 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:51.595813 856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:51.596071 856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:51.598146 856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-1/data/instance:
uuid: "95ebc70a3b39456780a01fbd7478b473"
format_stamp: "Formatted at 2026-08-09 09:26:51 on dist-test-slave-pgkr"
server_key: "43eed31a5b0597184fae29b62b9c73fd"
server_key_iv: "a2a6e7b185f9680e0c7f25c5050b7699"
server_key_version: "encryptionkey@0"
I20260809 09:26:51.598742 856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance:
uuid: "95ebc70a3b39456780a01fbd7478b473"
format_stamp: "Formatted at 2026-08-09 09:26:51 on dist-test-slave-pgkr"
server_key: "43eed31a5b0597184fae29b62b9c73fd"
server_key_iv: "a2a6e7b185f9680e0c7f25c5050b7699"
server_key_version: "encryptionkey@0"
I20260809 09:26:51.602303 856 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 09:26:51.604704 871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:51.605811 856 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:26:51.605940 856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-1/wal
uuid: "95ebc70a3b39456780a01fbd7478b473"
format_stamp: "Formatted at 2026-08-09 09:26:51 on dist-test-slave-pgkr"
server_key: "43eed31a5b0597184fae29b62b9c73fd"
server_key_iv: "a2a6e7b185f9680e0c7f25c5050b7699"
server_key_version: "encryptionkey@0"
I20260809 09:26:51.606051 856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:51.615196 856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:51.615718 856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:51.615888 856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:51.616366 856 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:26:51.617151 856 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:26:51.617226 856 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:51.617290 856 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:26:51.617326 856 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:51.626041 856 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.194:39691
I20260809 09:26:51.626071 993 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.194:39691 every 8 connection(s)
I20260809 09:26:51.626853 856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-1/data/info.pb
I20260809 09:26:51.633237 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 856
I20260809 09:26:51.633363 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-1/wal/instance
I20260809 09:26:51.633711 11663 external_mini_cluster.cc:1428] Setting key 69c4f930712fbd326584039c01b659d7
I20260809 09:26:51.635814 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.99.195:0
--local_ip_for_outbound_sockets=127.11.99.195
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:41415
--builtin_ntp_servers=127.11.99.212:38785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 09:26:51.635844 698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:51.628470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:59975 (local address 127.11.99.254:41415)
0809 09:26:51.628619 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:51.628623 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:51.629536 (+ 913us) server_negotiation.cc:407] Connection header received
0809 09:26:51.630854 (+ 1318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:51.630857 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:51.630912 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:51.630998 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:51.631862 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.632412 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.633799 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.634025 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.634158 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:51.635403 (+ 1245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:51.635405 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:51.635407 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:26:51.635419 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:51.635437 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:26:51.635444 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:51.635505 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:51.635683 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 09:26:51.635742 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 09:26:51.636850 996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:51.628820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:41415 (local address 127.11.99.194:59975)
0809 09:26:51.629391 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:51.629426 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:51.630666 (+ 1240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:51.631202 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:51.631207 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:51.631281 (+ 74us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:26:51.631729 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:51.631740 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.632534 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.632541 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:51.633652 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:51.633663 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.634185 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.634188 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:51.634374 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:51.635117 (+ 743us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 09:26:51.635118 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:26:51.635177 (+ 59us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 09:26:51.635248 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:26:51.635531 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:26:51.635540 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:26:51.635545 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 09:26:51.635676 (+ 131us) client_negotiation.cc:240] Negotiation successful
0809 09:26:51.635938 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":107,"threads_started":1}
I20260809 09:26:51.637914 994 heartbeater.cc:347] Connected to a master server at 127.11.99.254:41415
I20260809 09:26:51.638141 994 heartbeater.cc:464] Registering TS with master...
I20260809 09:26:51.638597 994 heartbeater.cc:511] Master 127.11.99.254:41415 requested a full tablet report, sending...
I20260809 09:26:51.639602 657 ts_manager.cc:194] Registered new tserver with Master: 95ebc70a3b39456780a01fbd7478b473 (127.11.99.194:39691)
I20260809 09:26:51.640446 657 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.99.194:59975
W20260809 09:26:51.745949 997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:51.746315 997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:51.746384 997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:51.750195 997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:51.750264 997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:51.750317 997 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.99.195
I20260809 09:26:51.755095 997 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:38785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.99.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.99.195
--webserver_port=0
--tserver_master_addrs=127.11.99.254:41415
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.99.195
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:51.755895 997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:51.757047 997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:51.766145 1006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:51.766144 1004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:51.766355 997 server_base.cc:1034] running on GCE node
W20260809 09:26:51.766464 1002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:51.766835 997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:51.767385 997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:51.768571 997 hybrid_clock.cc:648] HybridClock initialized: now 1786267611768555 us; error 29 us; skew 500 ppm
I20260809 09:26:51.770254 997 webserver.cc:460] Webserver started at http://127.11.99.195:35363/ using document root <none> and password file <none>
I20260809 09:26:51.770831 997 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:51.770917 997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:51.771155 997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:51.773077 997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-2/data/instance:
uuid: "b5d1401337814672a1404489e0f39330"
format_stamp: "Formatted at 2026-08-09 09:26:51 on dist-test-slave-pgkr"
server_key: "5a978cf45831bc0be563350323392963"
server_key_iv: "34b7fd439af0ec0016324dfbb4107e6c"
server_key_version: "encryptionkey@0"
I20260809 09:26:51.773628 997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance:
uuid: "b5d1401337814672a1404489e0f39330"
format_stamp: "Formatted at 2026-08-09 09:26:51 on dist-test-slave-pgkr"
server_key: "5a978cf45831bc0be563350323392963"
server_key_iv: "34b7fd439af0ec0016324dfbb4107e6c"
server_key_version: "encryptionkey@0"
I20260809 09:26:51.776896 997 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:26:51.779116 1013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:51.780112 997 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:26:51.780246 997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-2/wal
uuid: "b5d1401337814672a1404489e0f39330"
format_stamp: "Formatted at 2026-08-09 09:26:51 on dist-test-slave-pgkr"
server_key: "5a978cf45831bc0be563350323392963"
server_key_iv: "34b7fd439af0ec0016324dfbb4107e6c"
server_key_version: "encryptionkey@0"
I20260809 09:26:51.780349 997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:51.798834 997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:51.799396 997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:51.799574 997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:51.800074 997 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 09:26:51.800911 997 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 09:26:51.800982 997 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:51.801048 997 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 09:26:51.801098 997 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:51.809906 997 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.195:35297
I20260809 09:26:51.809984 1133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.195:35297 every 8 connection(s)
I20260809 09:26:51.810813 997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-2/data/info.pb
I20260809 09:26:51.813402 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 997
I20260809 09:26:51.813541 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-2/wal/instance
I20260809 09:26:51.813813 11663 external_mini_cluster.cc:1428] Setting key 70bda6de721b9621cf491f2909130349
I20260809 09:26:51.819917 698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:51.812469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.195:35801 (local address 127.11.99.254:41415)
0809 09:26:51.812628 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:51.812633 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:51.813576 (+ 943us) server_negotiation.cc:407] Connection header received
0809 09:26:51.815373 (+ 1797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:51.815376 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:51.815418 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:51.815485 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:51.816410 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.816928 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.818120 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.818347 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.818429 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:51.819521 (+ 1092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:51.819524 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:51.819526 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:26:51.819537 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:51.819556 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:26:51.819563 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:51.819622 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:51.819759 (+ 137us) server_negotiation.cc:299] Negotiation successful
0809 09:26:51.819810 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 09:26:51.820688 1136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:51.812827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:41415 (local address 127.11.99.195:35801)
0809 09:26:51.813419 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:51.813455 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:51.815141 (+ 1686us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:51.815664 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:51.815671 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:51.815768 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:26:51.816284 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:51.816296 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.817052 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.817055 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:51.818004 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:51.818014 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.818497 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.818500 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:51.818759 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:51.819281 (+ 522us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 09:26:51.819283 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:26:51.819318 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 09:26:51.819375 (+ 57us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:26:51.819635 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:26:51.819642 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:26:51.819646 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 09:26:51.819733 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 09:26:51.819929 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":102,"threads_started":1}
I20260809 09:26:51.821707 1134 heartbeater.cc:347] Connected to a master server at 127.11.99.254:41415
I20260809 09:26:51.821940 1134 heartbeater.cc:464] Registering TS with master...
I20260809 09:26:51.822399 1134 heartbeater.cc:511] Master 127.11.99.254:41415 requested a full tablet report, sending...
I20260809 09:26:51.823348 657 ts_manager.cc:194] Registered new tserver with Master: b5d1401337814672a1404489e0f39330 (127.11.99.195:35297)
I20260809 09:26:51.824008 657 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.99.195:35801
I20260809 09:26:51.827426 11663 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 09:26:51.833181 698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:51.829373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39246 (local address 127.11.99.254:41415)
0809 09:26:51.829519 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:51.829524 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:51.829669 (+ 145us) server_negotiation.cc:407] Connection header received
0809 09:26:51.829818 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:51.829821 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:51.829859 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:51.829946 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:51.830212 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.830788 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.831643 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.831880 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.832000 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:51.832800 (+ 800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:51.832804 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:51.832806 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:26:51.832818 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:51.832841 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:26:51.832849 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:51.832921 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:51.833013 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 09:26:51.833060 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 09:26:51.835922 657 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39246:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 09:26:51.838692 657 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 09:26:51.852497 1149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:51.847418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34234 (local address 127.11.99.193:38911)
0809 09:26:51.848059 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:51.848076 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:51.848101 (+ 25us) server_negotiation.cc:407] Connection header received
0809 09:26:51.848172 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:51.848177 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:51.848343 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:51.848492 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:51.848753 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.849859 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.851273 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.851781 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.851916 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:51.852122 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:51.852210 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 09:26:51.852320 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":154,"threads_started":1}
I20260809 09:26:51.852510 1148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:51.847083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:38911 (local address 127.0.0.1:34234)
0809 09:26:51.847537 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:51.847551 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:51.847635 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:51.848483 (+ 848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:51.848488 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:51.848508 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:51.848602 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:51.848608 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.849978 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.849984 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:51.851138 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:51.851148 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.851919 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.851923 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:51.852028 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:51.852067 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 09:26:51.852184 (+ 117us) client_negotiation.cc:240] Negotiation successful
0809 09:26:51.852318 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"mutex_wait_us":135,"thread_start_us":125,"threads_started":1}
I20260809 09:26:51.852562 1145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:51.846482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:35297 (local address 127.0.0.1:56940)
0809 09:26:51.847084 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:51.847155 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:51.847296 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:51.848318 (+ 1022us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:51.848321 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:51.848342 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:51.848440 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:51.848449 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.849543 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.849548 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:51.851108 (+ 1560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:51.851119 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.852141 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.852144 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:51.852249 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:51.852272 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 09:26:51.852326 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 09:26:51.852395 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"mutex_wait_us":101,"spinlock_wait_cycles":8192,"thread_start_us":90,"threads_started":1}
I20260809 09:26:51.852712 1146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:51.846417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.194:39691 (local address 127.0.0.1:42274)
0809 09:26:51.847084 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:51.847155 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:51.847296 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:51.848123 (+ 827us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:51.848131 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:51.848155 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:51.848289 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:51.848296 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.849851 (+ 1555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.849854 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:51.851108 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:51.851119 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.852361 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.852364 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:51.852448 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:51.852468 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 09:26:51.852530 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 09:26:51.852593 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"mutex_wait_us":74,"spinlock_wait_cycles":3712,"thread_start_us":68,"threads_started":1}
I20260809 09:26:51.853227 1147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:51.846562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42274 (local address 127.11.99.194:39691)
0809 09:26:51.846940 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:51.846954 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:51.847455 (+ 501us) server_negotiation.cc:407] Connection header received
0809 09:26:51.847560 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:51.847569 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:51.847774 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:51.847929 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:51.848441 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.849689 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.851255 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.852001 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.852116 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:51.852301 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:51.852981 (+ 680us) server_negotiation.cc:299] Negotiation successful
0809 09:26:51.853081 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":130,"threads_started":1}
I20260809 09:26:51.853925 1150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:51.847498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56940 (local address 127.11.99.195:35297)
0809 09:26:51.847894 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:51.847908 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:51.847930 (+ 22us) server_negotiation.cc:407] Connection header received
0809 09:26:51.847994 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:51.847999 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:51.848163 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:51.848594 (+ 431us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:51.848753 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.849429 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.851260 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:51.852001 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:51.852714 (+ 713us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:51.853596 (+ 882us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:51.853657 (+ 61us) server_negotiation.cc:299] Negotiation successful
0809 09:26:51.853768 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":126,"threads_started":1}
I20260809 09:26:51.855684 784 tablet_service.cc:1467] Processing CreateTablet for tablet 7dcfb9bfc1aa495abad3b37e94c2d43b (DEFAULT_TABLE table=test-table [id=44691f291a9f4c47ac6f3ca7358521aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:26:51.855744 925 tablet_service.cc:1467] Processing CreateTablet for tablet 7dcfb9bfc1aa495abad3b37e94c2d43b (DEFAULT_TABLE table=test-table [id=44691f291a9f4c47ac6f3ca7358521aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:26:51.856645 784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dcfb9bfc1aa495abad3b37e94c2d43b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:51.856762 925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dcfb9bfc1aa495abad3b37e94c2d43b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:51.857015 1064 tablet_service.cc:1467] Processing CreateTablet for tablet 7dcfb9bfc1aa495abad3b37e94c2d43b (DEFAULT_TABLE table=test-table [id=44691f291a9f4c47ac6f3ca7358521aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 09:26:51.857880 1064 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dcfb9bfc1aa495abad3b37e94c2d43b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:51.863289 1151 tablet_bootstrap.cc:492] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 97f04e85370f4cab9ff4f4029edde281: Bootstrap starting.
I20260809 09:26:51.864326 1152 tablet_bootstrap.cc:492] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473: Bootstrap starting.
I20260809 09:26:51.865164 1153 tablet_bootstrap.cc:492] T 7dcfb9bfc1aa495abad3b37e94c2d43b P b5d1401337814672a1404489e0f39330: Bootstrap starting.
I20260809 09:26:51.865613 1151 tablet_bootstrap.cc:654] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 97f04e85370f4cab9ff4f4029edde281: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:51.866305 1151 log.cc:824] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 97f04e85370f4cab9ff4f4029edde281: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:51.866444 1152 tablet_bootstrap.cc:654] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:51.867122 1153 tablet_bootstrap.cc:654] T 7dcfb9bfc1aa495abad3b37e94c2d43b P b5d1401337814672a1404489e0f39330: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:51.867237 1152 log.cc:824] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:51.867862 1153 log.cc:824] T 7dcfb9bfc1aa495abad3b37e94c2d43b P b5d1401337814672a1404489e0f39330: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:51.868325 1151 tablet_bootstrap.cc:492] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 97f04e85370f4cab9ff4f4029edde281: No bootstrap required, opened a new log
I20260809 09:26:51.868569 1151 ts_tablet_manager.cc:1397] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 97f04e85370f4cab9ff4f4029edde281: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 09:26:51.869364 1152 tablet_bootstrap.cc:492] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473: No bootstrap required, opened a new log
I20260809 09:26:51.869565 1152 ts_tablet_manager.cc:1397] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 09:26:51.869747 1153 tablet_bootstrap.cc:492] T 7dcfb9bfc1aa495abad3b37e94c2d43b P b5d1401337814672a1404489e0f39330: No bootstrap required, opened a new log
I20260809 09:26:51.869943 1153 ts_tablet_manager.cc:1397] T 7dcfb9bfc1aa495abad3b37e94c2d43b P b5d1401337814672a1404489e0f39330: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 09:26:51.871935 1151 raft_consensus.cc:348] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 97f04e85370f4cab9ff4f4029edde281 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ebc70a3b39456780a01fbd7478b473" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 39691 } } peers { permanent_uuid: "b5d1401337814672a1404489e0f39330" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35297 } } peers { permanent_uuid: "97f04e85370f4cab9ff4f4029edde281" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38911 } }
I20260809 09:26:51.872159 1151 raft_consensus.cc:374] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 97f04e85370f4cab9ff4f4029edde281 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:51.872210 1151 raft_consensus.cc:729] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 97f04e85370f4cab9ff4f4029edde281 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97f04e85370f4cab9ff4f4029edde281, State: Initialized, Role: FOLLOWER
I20260809 09:26:51.872656 1151 consensus_queue.cc:260] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 97f04e85370f4cab9ff4f4029edde281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ebc70a3b39456780a01fbd7478b473" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 39691 } } peers { permanent_uuid: "b5d1401337814672a1404489e0f39330" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35297 } } peers { permanent_uuid: "97f04e85370f4cab9ff4f4029edde281" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38911 } }
I20260809 09:26:51.873307 853 heartbeater.cc:503] Master 127.11.99.254:41415 was elected leader, sending a full tablet report...
I20260809 09:26:51.873618 1151 ts_tablet_manager.cc:1428] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 97f04e85370f4cab9ff4f4029edde281: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 09:26:51.874027 1153 raft_consensus.cc:348] T 7dcfb9bfc1aa495abad3b37e94c2d43b P b5d1401337814672a1404489e0f39330 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ebc70a3b39456780a01fbd7478b473" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 39691 } } peers { permanent_uuid: "b5d1401337814672a1404489e0f39330" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35297 } } peers { permanent_uuid: "97f04e85370f4cab9ff4f4029edde281" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38911 } }
I20260809 09:26:51.874271 1153 raft_consensus.cc:374] T 7dcfb9bfc1aa495abad3b37e94c2d43b P b5d1401337814672a1404489e0f39330 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:51.874328 1153 raft_consensus.cc:729] T 7dcfb9bfc1aa495abad3b37e94c2d43b P b5d1401337814672a1404489e0f39330 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5d1401337814672a1404489e0f39330, State: Initialized, Role: FOLLOWER
I20260809 09:26:51.874481 1152 raft_consensus.cc:348] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ebc70a3b39456780a01fbd7478b473" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 39691 } } peers { permanent_uuid: "b5d1401337814672a1404489e0f39330" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35297 } } peers { permanent_uuid: "97f04e85370f4cab9ff4f4029edde281" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38911 } }
I20260809 09:26:51.874756 1152 raft_consensus.cc:374] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:51.874809 1152 raft_consensus.cc:729] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ebc70a3b39456780a01fbd7478b473, State: Initialized, Role: FOLLOWER
I20260809 09:26:51.874768 1153 consensus_queue.cc:260] T 7dcfb9bfc1aa495abad3b37e94c2d43b P b5d1401337814672a1404489e0f39330 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ebc70a3b39456780a01fbd7478b473" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 39691 } } peers { permanent_uuid: "b5d1401337814672a1404489e0f39330" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35297 } } peers { permanent_uuid: "97f04e85370f4cab9ff4f4029edde281" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38911 } }
I20260809 09:26:51.875209 1152 consensus_queue.cc:260] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ebc70a3b39456780a01fbd7478b473" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 39691 } } peers { permanent_uuid: "b5d1401337814672a1404489e0f39330" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35297 } } peers { permanent_uuid: "97f04e85370f4cab9ff4f4029edde281" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38911 } }
I20260809 09:26:51.875734 1153 ts_tablet_manager.cc:1428] T 7dcfb9bfc1aa495abad3b37e94c2d43b P b5d1401337814672a1404489e0f39330: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 09:26:51.875854 994 heartbeater.cc:503] Master 127.11.99.254:41415 was elected leader, sending a full tablet report...
I20260809 09:26:51.876026 1134 heartbeater.cc:503] Master 127.11.99.254:41415 was elected leader, sending a full tablet report...
I20260809 09:26:51.876128 1152 ts_tablet_manager.cc:1428] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260809 09:26:51.877645 995 tablet.cc:2369] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 09:26:51.955708 854 tablet.cc:2369] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 97f04e85370f4cab9ff4f4029edde281: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:26:52.003373 1159 raft_consensus.cc:482] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 09:26:52.003597 1159 raft_consensus.cc:504] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ebc70a3b39456780a01fbd7478b473" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 39691 } } peers { permanent_uuid: "b5d1401337814672a1404489e0f39330" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35297 } } peers { permanent_uuid: "97f04e85370f4cab9ff4f4029edde281" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38911 } }
I20260809 09:26:52.004734 1159 leader_election.cc:288] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5d1401337814672a1404489e0f39330 (127.11.99.195:35297), 97f04e85370f4cab9ff4f4029edde281 (127.11.99.193:38911)
I20260809 09:26:52.008746 1150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:52.005067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:54201 (local address 127.11.99.195:35297)
0809 09:26:52.005240 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:52.005245 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:52.005279 (+ 34us) server_negotiation.cc:407] Connection header received
0809 09:26:52.005334 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:52.005337 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:52.005385 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:52.005471 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:52.005870 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:52.006506 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:52.007643 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:52.008101 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:52.008186 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:52.008222 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:52.008539 (+ 317us) server_negotiation.cc:299] Negotiation successful
0809 09:26:52.008607 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 09:26:52.008765 1149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:52.005374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.99.194:47505 (local address 127.11.99.193:38911)
0809 09:26:52.005526 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:52.005533 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:52.005722 (+ 189us) server_negotiation.cc:407] Connection header received
0809 09:26:52.005798 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:52.005804 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:52.005865 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:52.005931 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 09:26:52.006233 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:52.006776 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:52.007801 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:52.008200 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:52.008348 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:52.008404 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:52.008578 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 09:26:52.008644 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 09:26:52.008765 996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:52.004920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.195:35297 (local address 127.11.99.194:54201)
0809 09:26:52.005061 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:52.005077 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:52.005203 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:52.005577 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:52.005580 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:52.005608 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:52.005750 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:52.005759 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:52.006654 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:52.006658 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:52.007496 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:52.007505 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:52.008213 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:52.008218 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:52.008383 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:52.008406 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 09:26:52.008493 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 09:26:52.008578 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":20}
I20260809 09:26:52.008764 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:52.005252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:38911 (local address 127.11.99.194:47505)
0809 09:26:52.005627 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:52.005639 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:26:52.005720 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:26:52.005972 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:26:52.005974 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:26:52.005991 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 09:26:52.006122 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:52.006128 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:52.006878 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:52.006881 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:52.007681 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:26:52.007690 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:26:52.008328 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:26:52.008348 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:26:52.008445 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:52.008461 (+ 16us) client_negotiation.cc:769] Sending connection context
0809 09:26:52.008550 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 09:26:52.008607 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"mutex_wait_us":2,"thread_start_us":140,"threads_started":1}
I20260809 09:26:52.009518 804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7dcfb9bfc1aa495abad3b37e94c2d43b" candidate_uuid: "95ebc70a3b39456780a01fbd7478b473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97f04e85370f4cab9ff4f4029edde281" is_pre_election: true
I20260809 09:26:52.009533 1085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7dcfb9bfc1aa495abad3b37e94c2d43b" candidate_uuid: "95ebc70a3b39456780a01fbd7478b473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5d1401337814672a1404489e0f39330" is_pre_election: true
I20260809 09:26:52.009779 804 raft_consensus.cc:2454] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 97f04e85370f4cab9ff4f4029edde281 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ebc70a3b39456780a01fbd7478b473 in term 0.
I20260809 09:26:52.009809 1085 raft_consensus.cc:2454] T 7dcfb9bfc1aa495abad3b37e94c2d43b P b5d1401337814672a1404489e0f39330 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ebc70a3b39456780a01fbd7478b473 in term 0.
I20260809 09:26:52.010277 875 leader_election.cc:302] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95ebc70a3b39456780a01fbd7478b473, 97f04e85370f4cab9ff4f4029edde281; no voters:
I20260809 09:26:52.010531 1159 raft_consensus.cc:2781] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 09:26:52.010635 1159 raft_consensus.cc:482] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 09:26:52.010691 1159 raft_consensus.cc:3037] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:52.011713 1159 raft_consensus.cc:504] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ebc70a3b39456780a01fbd7478b473" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 39691 } } peers { permanent_uuid: "b5d1401337814672a1404489e0f39330" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35297 } } peers { permanent_uuid: "97f04e85370f4cab9ff4f4029edde281" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38911 } }
I20260809 09:26:52.012048 1159 leader_election.cc:288] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473 [CANDIDATE]: Term 1 election: Requested vote from peers b5d1401337814672a1404489e0f39330 (127.11.99.195:35297), 97f04e85370f4cab9ff4f4029edde281 (127.11.99.193:38911)
I20260809 09:26:52.012421 1085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7dcfb9bfc1aa495abad3b37e94c2d43b" candidate_uuid: "95ebc70a3b39456780a01fbd7478b473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5d1401337814672a1404489e0f39330"
I20260809 09:26:52.012514 804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7dcfb9bfc1aa495abad3b37e94c2d43b" candidate_uuid: "95ebc70a3b39456780a01fbd7478b473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97f04e85370f4cab9ff4f4029edde281"
I20260809 09:26:52.012548 1085 raft_consensus.cc:3037] T 7dcfb9bfc1aa495abad3b37e94c2d43b P b5d1401337814672a1404489e0f39330 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:52.012670 804 raft_consensus.cc:3037] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 97f04e85370f4cab9ff4f4029edde281 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:52.013597 1085 raft_consensus.cc:2454] T 7dcfb9bfc1aa495abad3b37e94c2d43b P b5d1401337814672a1404489e0f39330 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ebc70a3b39456780a01fbd7478b473 in term 1.
I20260809 09:26:52.013679 804 raft_consensus.cc:2454] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 97f04e85370f4cab9ff4f4029edde281 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ebc70a3b39456780a01fbd7478b473 in term 1.
I20260809 09:26:52.013944 875 leader_election.cc:302] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95ebc70a3b39456780a01fbd7478b473, b5d1401337814672a1404489e0f39330; no voters:
I20260809 09:26:52.014096 1159 raft_consensus.cc:2781] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:26:52.014303 1159 raft_consensus.cc:686] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473 [term 1 LEADER]: Becoming Leader. State: Replica: 95ebc70a3b39456780a01fbd7478b473, State: Running, Role: LEADER
I20260809 09:26:52.014673 1159 consensus_queue.cc:237] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ebc70a3b39456780a01fbd7478b473" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 39691 } } peers { permanent_uuid: "b5d1401337814672a1404489e0f39330" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35297 } } peers { permanent_uuid: "97f04e85370f4cab9ff4f4029edde281" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38911 } }
I20260809 09:26:52.017663 656 catalog_manager.cc:5495] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95ebc70a3b39456780a01fbd7478b473 (127.11.99.194). New cstate: current_term: 1 leader_uuid: "95ebc70a3b39456780a01fbd7478b473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ebc70a3b39456780a01fbd7478b473" member_type: VOTER last_known_addr { host: "127.11.99.194" port: 39691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5d1401337814672a1404489e0f39330" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97f04e85370f4cab9ff4f4029edde281" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38911 } health_report { overall_health: UNKNOWN } } }
I20260809 09:26:52.037516 1147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:52.034355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42284 (local address 127.11.99.194:39691)
0809 09:26:52.034465 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:52.034469 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:52.034480 (+ 11us) server_negotiation.cc:407] Connection header received
0809 09:26:52.034685 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:52.034687 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:52.034743 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:52.034824 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:26:52.035043 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:52.035489 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:52.036262 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:52.036476 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:52.036549 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:52.036785 (+ 236us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:26:52.037152 (+ 367us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:26:52.037236 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:52.037305 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 09:26:52.037344 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 09:26:52.042796 804 raft_consensus.cc:1261] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 97f04e85370f4cab9ff4f4029edde281 [term 1 FOLLOWER]: Refusing update from remote peer 95ebc70a3b39456780a01fbd7478b473: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:26:52.042877 1085 raft_consensus.cc:1261] T 7dcfb9bfc1aa495abad3b37e94c2d43b P b5d1401337814672a1404489e0f39330 [term 1 FOLLOWER]: Refusing update from remote peer 95ebc70a3b39456780a01fbd7478b473: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:26:52.043532 1159 consensus_queue.cc:1035] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97f04e85370f4cab9ff4f4029edde281" member_type: VOTER last_known_addr { host: "127.11.99.193" port: 38911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:26:52.043697 1161 consensus_queue.cc:1035] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5d1401337814672a1404489e0f39330" member_type: VOTER last_known_addr { host: "127.11.99.195" port: 35297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:26:52.050516 1164 mvcc.cc:205] Tried to move back new op lower bound from 7316552138920857600 to 7316552138814595072. Current Snapshot: MvccSnapshot[applied={T|T < 7316552138920857600}]
I20260809 09:26:52.051824 1166 mvcc.cc:205] Tried to move back new op lower bound from 7316552138920857600 to 7316552138814595072. Current Snapshot: MvccSnapshot[applied={T|T < 7316552138920857600}]
I20260809 09:26:52.058956 656 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39246:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:26:52.059118 656 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39246:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 09:26:52.061384 656 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f91ec2313d964f18b04fc6a149e54b50: Sending DeleteTablet for 3 replicas of tablet 7dcfb9bfc1aa495abad3b37e94c2d43b
I20260809 09:26:52.062088 1064 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dcfb9bfc1aa495abad3b37e94c2d43b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:26:52 UTC) from {username='slave'} at 127.0.0.1:56940
I20260809 09:26:52.062088 925 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dcfb9bfc1aa495abad3b37e94c2d43b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:26:52 UTC) from {username='slave'} at 127.0.0.1:42274
I20260809 09:26:52.062537 1174 tablet_replica.cc:330] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473: stopping tablet replica
I20260809 09:26:52.062840 1174 raft_consensus.cc:2229] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473 [term 1 LEADER]: Raft consensus shutting down.
I20260809 09:26:52.062959 784 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dcfb9bfc1aa495abad3b37e94c2d43b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 09:26:52 UTC) from {username='slave'} at 127.0.0.1:34234
I20260809 09:26:52.063172 1174 raft_consensus.cc:2258] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:26:52.063468 1173 tablet_replica.cc:330] T 7dcfb9bfc1aa495abad3b37e94c2d43b P b5d1401337814672a1404489e0f39330: stopping tablet replica
I20260809 09:26:52.063654 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 720
I20260809 09:26:52.064631 1173 raft_consensus.cc:2229] T 7dcfb9bfc1aa495abad3b37e94c2d43b P b5d1401337814672a1404489e0f39330 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 09:26:52.064867 1173 raft_consensus.cc:2258] T 7dcfb9bfc1aa495abad3b37e94c2d43b P b5d1401337814672a1404489e0f39330 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 09:26:52.066870 1174 ts_tablet_manager.cc:1905] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 09:26:52.069720 1174 ts_tablet_manager.cc:1918] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:26:52.069821 1174 log.cc:1196] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-1/wal/wals/7dcfb9bfc1aa495abad3b37e94c2d43b
I20260809 09:26:52.070153 1174 ts_tablet_manager.cc:1939] T 7dcfb9bfc1aa495abad3b37e94c2d43b P 95ebc70a3b39456780a01fbd7478b473: Deleting consensus metadata
I20260809 09:26:52.071260 641 catalog_manager.cc:4841] TS 95ebc70a3b39456780a01fbd7478b473 (127.11.99.194:39691): tablet 7dcfb9bfc1aa495abad3b37e94c2d43b (table test-table [id=44691f291a9f4c47ac6f3ca7358521aa]) successfully deleted
I20260809 09:26:52.072260 1173 ts_tablet_manager.cc:1905] T 7dcfb9bfc1aa495abad3b37e94c2d43b P b5d1401337814672a1404489e0f39330: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 09:26:52.073580 644 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.99.193:38911 (error 108)
I20260809 09:26:52.073700 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 856
I20260809 09:26:52.074729 1173 ts_tablet_manager.cc:1918] T 7dcfb9bfc1aa495abad3b37e94c2d43b P b5d1401337814672a1404489e0f39330: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 09:26:52.074801 1173 log.cc:1196] T 7dcfb9bfc1aa495abad3b37e94c2d43b P b5d1401337814672a1404489e0f39330: Deleting WAL directory at /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786267363058776-11663-0/minicluster-data/ts-2/wal/wals/7dcfb9bfc1aa495abad3b37e94c2d43b
I20260809 09:26:52.075075 1173 ts_tablet_manager.cc:1939] T 7dcfb9bfc1aa495abad3b37e94c2d43b P b5d1401337814672a1404489e0f39330: Deleting consensus metadata
I20260809 09:26:52.076130 644 catalog_manager.cc:4841] TS b5d1401337814672a1404489e0f39330 (127.11.99.195:35297): tablet 7dcfb9bfc1aa495abad3b37e94c2d43b (table test-table [id=44691f291a9f4c47ac6f3ca7358521aa]) successfully deleted
I20260809 09:26:52.076308 1148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:52.075989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.193:38911 (local address 127.0.0.1:34238)
0809 09:26:52.076119 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 09:26:52.076199 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.193:38911: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 09:26:52.076488 644 catalog_manager.cc:4584] TS 97f04e85370f4cab9ff4f4029edde281 (127.11.99.193:38911): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7dcfb9bfc1aa495abad3b37e94c2d43b: Network error: Client connection negotiation failed: client connection to 127.11.99.193:38911: connect: Connection refused (error 111)
I20260809 09:26:52.081455 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 997
I20260809 09:26:52.088160 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 625
2026-08-09T09:26:52Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1095 ms)
[----------] 6 tests from EncryptionPolicyTest (9810 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:26:52 dist-test-slave-pgkr krb5kdc[1179](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:26:52 dist-test-slave-pgkr krb5kdc[1179](info): set up 2 sockets
Aug 09 09:26:52 dist-test-slave-pgkr krb5kdc[1179](info): commencing operation
krb5kdc: starting...
W20260809 09:26:53.128180 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.019s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:26:53 dist-test-slave-pgkr krb5kdc[1179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267613, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:26:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:26:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 09:26:53.243089 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45443
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45443
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:26:53.351617 1195 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:53.351876 1195 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:53.351962 1195 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:53.355789 1195 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:26:53.355860 1195 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:53.355894 1195 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:53.355947 1195 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:26:53.355995 1195 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:26:53.360860 1195 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45443
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45443
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1195
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:53.361821 1195 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:53.362833 1195 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:53.370878 1200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:53.370899 1195 server_base.cc:1034] running on GCE node
W20260809 09:26:53.370880 1201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:53.370908 1203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:53.371590 1195 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:53.372627 1195 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:53.373813 1195 hybrid_clock.cc:648] HybridClock initialized: now 1786267613373801 us; error 31 us; skew 500 ppm
Aug 09 09:26:53 dist-test-slave-pgkr krb5kdc[1179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267613, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:26:53.376453 1195 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 09:26:53.377264 1195 webserver.cc:460] Webserver started at http://127.0.0.1:45219/ using document root <none> and password file <none>
I20260809 09:26:53.377799 1195 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:53.377889 1195 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:53.378137 1195 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:53.380061 1195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "187cb079d5364bff96d608a081bbe993"
format_stamp: "Formatted at 2026-08-09 09:26:53 on dist-test-slave-pgkr"
server_key: "322941644722779e7be85a0f11b0350a"
server_key_iv: "d0d83d041d559273295130482304a8a0"
server_key_version: "encryptionkey@0"
I20260809 09:26:53.380595 1195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "187cb079d5364bff96d608a081bbe993"
format_stamp: "Formatted at 2026-08-09 09:26:53 on dist-test-slave-pgkr"
server_key: "322941644722779e7be85a0f11b0350a"
server_key_iv: "d0d83d041d559273295130482304a8a0"
server_key_version: "encryptionkey@0"
I20260809 09:26:53.383948 1195 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 09:26:53.386094 1211 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:53.387279 1195 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:26:53.387419 1195 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "187cb079d5364bff96d608a081bbe993"
format_stamp: "Formatted at 2026-08-09 09:26:53 on dist-test-slave-pgkr"
server_key: "322941644722779e7be85a0f11b0350a"
server_key_iv: "d0d83d041d559273295130482304a8a0"
server_key_version: "encryptionkey@0"
I20260809 09:26:53.387519 1195 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:53.402840 1195 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:53.405735 1195 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:53.405992 1195 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:53.413251 1195 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45443
I20260809 09:26:53.413282 1266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45443 every 8 connection(s)
I20260809 09:26:53.414160 1195 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:26:53.416749 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:53.419400 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 1195
I20260809 09:26:53.419541 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:26:53.419844 11663 external_mini_cluster.cc:1428] Setting key 18036b4e6d085db451c270253b9a1f20
I20260809 09:26:53.422987 1267 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 187cb079d5364bff96d608a081bbe993: Bootstrap starting.
I20260809 09:26:53.425594 1267 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 187cb079d5364bff96d608a081bbe993: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:53.426296 1267 log.cc:824] T 00000000000000000000000000000000 P 187cb079d5364bff96d608a081bbe993: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:53.428125 1267 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 187cb079d5364bff96d608a081bbe993: No bootstrap required, opened a new log
Aug 09 09:26:53 dist-test-slave-pgkr krb5kdc[1179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267613, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 09:26:53.432269 1267 raft_consensus.cc:348] T 00000000000000000000000000000000 P 187cb079d5364bff96d608a081bbe993 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "187cb079d5364bff96d608a081bbe993" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45443 } }
I20260809 09:26:53.432530 1267 raft_consensus.cc:374] T 00000000000000000000000000000000 P 187cb079d5364bff96d608a081bbe993 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:53.432600 1267 raft_consensus.cc:729] T 00000000000000000000000000000000 P 187cb079d5364bff96d608a081bbe993 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 187cb079d5364bff96d608a081bbe993, State: Initialized, Role: FOLLOWER
I20260809 09:26:53.432999 1267 consensus_queue.cc:260] T 00000000000000000000000000000000 P 187cb079d5364bff96d608a081bbe993 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "187cb079d5364bff96d608a081bbe993" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45443 } }
I20260809 09:26:53.433167 1267 raft_consensus.cc:388] T 00000000000000000000000000000000 P 187cb079d5364bff96d608a081bbe993 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:26:53.433250 1267 raft_consensus.cc:482] T 00000000000000000000000000000000 P 187cb079d5364bff96d608a081bbe993 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:26:53.433348 1267 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 187cb079d5364bff96d608a081bbe993 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:53.434536 1267 raft_consensus.cc:504] T 00000000000000000000000000000000 P 187cb079d5364bff96d608a081bbe993 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "187cb079d5364bff96d608a081bbe993" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45443 } }
I20260809 09:26:53.434926 1267 leader_election.cc:302] T 00000000000000000000000000000000 P 187cb079d5364bff96d608a081bbe993 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 187cb079d5364bff96d608a081bbe993; no voters:
I20260809 09:26:53.435241 1267 leader_election.cc:288] T 00000000000000000000000000000000 P 187cb079d5364bff96d608a081bbe993 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:26:53.435326 1272 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 187cb079d5364bff96d608a081bbe993 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:26:53.435590 1272 raft_consensus.cc:686] T 00000000000000000000000000000000 P 187cb079d5364bff96d608a081bbe993 [term 1 LEADER]: Becoming Leader. State: Replica: 187cb079d5364bff96d608a081bbe993, State: Running, Role: LEADER
I20260809 09:26:53.435921 1272 consensus_queue.cc:237] T 00000000000000000000000000000000 P 187cb079d5364bff96d608a081bbe993 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "187cb079d5364bff96d608a081bbe993" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45443 } }
I20260809 09:26:53.435985 1270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:53.421286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54937 (local address 127.0.0.1:45443)
0809 09:26:53.421757 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:53.421780 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:53.421822 (+ 42us) server_negotiation.cc:407] Connection header received
0809 09:26:53.422603 (+ 781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:53.422654 (+ 51us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:53.423113 (+ 459us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:53.423461 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:53.424139 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:53.425581 (+ 1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:53.426413 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:53.427003 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:53.427163 (+ 160us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:53.429881 (+ 2718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:53.429888 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:53.429903 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:53.429935 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:53.432482 (+ 2547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:53.433127 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:53.433133 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:53.433138 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:53.433282 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:53.433662 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:53.433667 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:53.433669 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:53.434201 (+ 532us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:53.434415 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:53.434734 (+ 319us) server_negotiation.cc:299] Negotiation successful
0809 09:26:53.434955 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":147,"threads_started":1}
I20260809 09:26:53.436448 1267 sys_catalog.cc:564] T 00000000000000000000000000000000 P 187cb079d5364bff96d608a081bbe993 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:26:53.437662 1274 sys_catalog.cc:455] T 00000000000000000000000000000000 P 187cb079d5364bff96d608a081bbe993 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 187cb079d5364bff96d608a081bbe993. Latest consensus state: current_term: 1 leader_uuid: "187cb079d5364bff96d608a081bbe993" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "187cb079d5364bff96d608a081bbe993" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45443 } } }
I20260809 09:26:53.437781 1274 sys_catalog.cc:458] T 00000000000000000000000000000000 P 187cb079d5364bff96d608a081bbe993 [sys.catalog]: This master's current role is: LEADER
I20260809 09:26:53.438547 1273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 187cb079d5364bff96d608a081bbe993 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "187cb079d5364bff96d608a081bbe993" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "187cb079d5364bff96d608a081bbe993" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45443 } } }
I20260809 09:26:53.439041 1273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 187cb079d5364bff96d608a081bbe993 [sys.catalog]: This master's current role is: LEADER
I20260809 09:26:53.439363 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260809 09:26:53.441392 1288 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 187cb079d5364bff96d608a081bbe993: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 09:26:53.441463 1288 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 09:26:53.441538 1282 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:26:53.442246 1282 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:26:53.448347 1282 catalog_manager.cc:1347] Generated new cluster ID: 3e4f3317ea5943ad89ee0bb88e3e13ff
I20260809 09:26:53.448405 1282 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:26:53.449940 1270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:53.441597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41821 (local address 127.0.0.1:45443)
0809 09:26:53.441706 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:53.441710 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:53.441723 (+ 13us) server_negotiation.cc:407] Connection header received
0809 09:26:53.441913 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:53.441916 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:53.441956 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:53.442044 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:53.442809 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:53.443300 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:53.444196 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:53.444537 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:53.444661 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:53.446299 (+ 1638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:53.446303 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:53.446306 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:53.446348 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:53.448003 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:53.448674 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:53.448677 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:53.448679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:53.448760 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:53.449090 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:53.449093 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:53.449095 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:53.449275 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:53.449442 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:53.449697 (+ 255us) server_negotiation.cc:299] Negotiation successful
0809 09:26:53.449791 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 09:26:53.477459 1282 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:26:53.478543 1282 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:26:53.486642 1282 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 187cb079d5364bff96d608a081bbe993: Generated new TSK 0
I20260809 09:26:53.487301 1282 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:26:53.491365 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 1195
W20260809 09:26:53.499626 1177 connection.cc:535] client connection to 127.0.0.1:45443 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45443): Connection reset by peer (error 104)
2026-08-09T09:26:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1404 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:26:53 dist-test-slave-pgkr krb5kdc[1300](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:26:53 dist-test-slave-pgkr krb5kdc[1300](info): set up 2 sockets
Aug 09 09:26:53 dist-test-slave-pgkr krb5kdc[1300](info): commencing operation
krb5kdc: starting...
W20260809 09:26:54.523981 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.010s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:26:54 dist-test-slave-pgkr krb5kdc[1300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267614, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:26:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:26:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 09:26:54.641623 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36663
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36663
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:26:54.745316 1314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:54.745563 1314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:54.745630 1314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:54.749176 1314 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:26:54.749257 1314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:54.749292 1314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:54.749346 1314 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:26:54.749382 1314 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:26:54.754096 1314 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36663
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1314
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:54.755036 1314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:54.755949 1314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:54.763499 1320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:54.763618 1319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:54.763727 1314 server_base.cc:1034] running on GCE node
W20260809 09:26:54.763494 1322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:54.764295 1314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:54.765228 1314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:54.766410 1314 hybrid_clock.cc:648] HybridClock initialized: now 1786267614766384 us; error 37 us; skew 500 ppm
Aug 09 09:26:54 dist-test-slave-pgkr krb5kdc[1300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267614, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:26:54.769241 1314 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 09:26:54.770030 1314 webserver.cc:460] Webserver started at http://127.0.0.1:34427/ using document root <none> and password file <none>
I20260809 09:26:54.770501 1314 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:54.770563 1314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:54.770802 1314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:54.772753 1314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "fd2c4c9ecf444a29b9d5849619015345"
format_stamp: "Formatted at 2026-08-09 09:26:54 on dist-test-slave-pgkr"
server_key: "3b802179bcd6a3e35dfc701ba643960f"
server_key_iv: "7335b8acd15d68b52f7e5cb4ea99c0a6"
server_key_version: "encryptionkey@0"
I20260809 09:26:54.773273 1314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "fd2c4c9ecf444a29b9d5849619015345"
format_stamp: "Formatted at 2026-08-09 09:26:54 on dist-test-slave-pgkr"
server_key: "3b802179bcd6a3e35dfc701ba643960f"
server_key_iv: "7335b8acd15d68b52f7e5cb4ea99c0a6"
server_key_version: "encryptionkey@0"
I20260809 09:26:54.776832 1314 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:26:54.779101 1330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:54.780334 1314 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:26:54.780445 1314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "fd2c4c9ecf444a29b9d5849619015345"
format_stamp: "Formatted at 2026-08-09 09:26:54 on dist-test-slave-pgkr"
server_key: "3b802179bcd6a3e35dfc701ba643960f"
server_key_iv: "7335b8acd15d68b52f7e5cb4ea99c0a6"
server_key_version: "encryptionkey@0"
I20260809 09:26:54.780542 1314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:54.799865 1314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:54.803272 1314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:54.803459 1314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:54.810425 1314 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36663
I20260809 09:26:54.810520 1386 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36663 every 8 connection(s)
I20260809 09:26:54.811455 1314 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:26:54.814206 1387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:54.816838 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 1314
I20260809 09:26:54.816982 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:26:54.817286 11663 external_mini_cluster.cc:1428] Setting key 11aa0b5396fc89c977d65a318c69bc25
I20260809 09:26:54.820253 1387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd2c4c9ecf444a29b9d5849619015345: Bootstrap starting.
I20260809 09:26:54.822926 1387 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd2c4c9ecf444a29b9d5849619015345: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:54.823716 1387 log.cc:824] T 00000000000000000000000000000000 P fd2c4c9ecf444a29b9d5849619015345: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:54.825641 1387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd2c4c9ecf444a29b9d5849619015345: No bootstrap required, opened a new log
I20260809 09:26:54.826952 1391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:54.818689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40493 (local address 127.0.0.1:36663)
0809 09:26:54.819125 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:54.819143 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:54.819184 (+ 41us) server_negotiation.cc:407] Connection header received
0809 09:26:54.819947 (+ 763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:54.819968 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:54.820386 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:54.820720 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:54.821133 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:54.822661 (+ 1528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:54.823545 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:54.824214 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:54.824398 (+ 184us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:54.825247 (+ 849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:54.825257 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:54.825268 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:26:54.825627 (+ 359us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:54.825696 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:26:54.825718 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:54.825869 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:54.826026 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 09:26:54.826165 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":126,"threads_started":1}
I20260809 09:26:54.829797 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 09:26:54.829763 1387 raft_consensus.cc:348] T 00000000000000000000000000000000 P fd2c4c9ecf444a29b9d5849619015345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd2c4c9ecf444a29b9d5849619015345" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36663 } }
I20260809 09:26:54.830039 1387 raft_consensus.cc:374] T 00000000000000000000000000000000 P fd2c4c9ecf444a29b9d5849619015345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:54.830113 1387 raft_consensus.cc:729] T 00000000000000000000000000000000 P fd2c4c9ecf444a29b9d5849619015345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd2c4c9ecf444a29b9d5849619015345, State: Initialized, Role: FOLLOWER
I20260809 09:26:54.830471 1387 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd2c4c9ecf444a29b9d5849619015345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd2c4c9ecf444a29b9d5849619015345" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36663 } }
I20260809 09:26:54.830621 1387 raft_consensus.cc:388] T 00000000000000000000000000000000 P fd2c4c9ecf444a29b9d5849619015345 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:26:54.830724 1387 raft_consensus.cc:482] T 00000000000000000000000000000000 P fd2c4c9ecf444a29b9d5849619015345 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:26:54.830819 1387 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fd2c4c9ecf444a29b9d5849619015345 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:54.831617 1387 raft_consensus.cc:504] T 00000000000000000000000000000000 P fd2c4c9ecf444a29b9d5849619015345 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd2c4c9ecf444a29b9d5849619015345" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36663 } }
I20260809 09:26:54.831964 1387 leader_election.cc:302] T 00000000000000000000000000000000 P fd2c4c9ecf444a29b9d5849619015345 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd2c4c9ecf444a29b9d5849619015345; no voters:
I20260809 09:26:54.832288 1387 leader_election.cc:288] T 00000000000000000000000000000000 P fd2c4c9ecf444a29b9d5849619015345 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:26:54.832414 1398 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fd2c4c9ecf444a29b9d5849619015345 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:26:54.832686 1398 raft_consensus.cc:686] T 00000000000000000000000000000000 P fd2c4c9ecf444a29b9d5849619015345 [term 1 LEADER]: Becoming Leader. State: Replica: fd2c4c9ecf444a29b9d5849619015345, State: Running, Role: LEADER
I20260809 09:26:54.833032 1398 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd2c4c9ecf444a29b9d5849619015345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd2c4c9ecf444a29b9d5849619015345" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36663 } }
I20260809 09:26:54.833483 1387 sys_catalog.cc:564] T 00000000000000000000000000000000 P fd2c4c9ecf444a29b9d5849619015345 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:26:54.834103 1398 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd2c4c9ecf444a29b9d5849619015345 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd2c4c9ecf444a29b9d5849619015345. Latest consensus state: current_term: 1 leader_uuid: "fd2c4c9ecf444a29b9d5849619015345" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd2c4c9ecf444a29b9d5849619015345" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36663 } } }
I20260809 09:26:54.834219 1398 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd2c4c9ecf444a29b9d5849619015345 [sys.catalog]: This master's current role is: LEADER
I20260809 09:26:54.834729 1400 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd2c4c9ecf444a29b9d5849619015345 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd2c4c9ecf444a29b9d5849619015345" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd2c4c9ecf444a29b9d5849619015345" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36663 } } }
I20260809 09:26:54.834887 1400 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd2c4c9ecf444a29b9d5849619015345 [sys.catalog]: This master's current role is: LEADER
I20260809 09:26:54.837152 1391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:54.832053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60063 (local address 127.0.0.1:36663)
0809 09:26:54.832159 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:54.832163 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:54.832423 (+ 260us) server_negotiation.cc:407] Connection header received
0809 09:26:54.832597 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:54.832600 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:54.832642 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:54.832716 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:54.833094 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:54.833812 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:54.835037 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:54.835379 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:54.835463 (+ 84us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:54.836687 (+ 1224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:54.836690 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:54.836693 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:26:54.836705 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:54.836738 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:26:54.836750 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:54.836838 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:54.837011 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 09:26:54.837042 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260809 09:26:54.838413 1414 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fd2c4c9ecf444a29b9d5849619015345: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 09:26:54.838476 1414 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 09:26:54.838549 1406 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:26:54.839210 1406 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:26:54.843813 1406 catalog_manager.cc:1347] Generated new cluster ID: 07f9fe0fe2d7491c948065a46a0c599c
I20260809 09:26:54.843873 1406 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:26:54.852733 1406 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:26:54.853538 1406 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:26:54.864223 1406 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fd2c4c9ecf444a29b9d5849619015345: Generated new TSK 0
I20260809 09:26:54.864775 1406 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:26:54.873420 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 1314
W20260809 09:26:54.882541 1298 connection.cc:535] client connection to 127.0.0.1:36663 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36663): Connection reset by peer (error 104)
2026-08-09T09:26:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1382 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:26:54 dist-test-slave-pgkr krb5kdc[1420](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:26:54 dist-test-slave-pgkr krb5kdc[1420](info): set up 2 sockets
Aug 09 09:26:54 dist-test-slave-pgkr krb5kdc[1420](info): commencing operation
krb5kdc: starting...
W20260809 09:26:56.020277 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:26:56 dist-test-slave-pgkr krb5kdc[1420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267616, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:26:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:26:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 09:26:56.135831 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45237
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45237
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:26:56.240795 1433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:56.241012 1433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:56.241076 1433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:56.244729 1433 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:26:56.244781 1433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:56.244798 1433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:56.244839 1433 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:26:56.244872 1433 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:26:56.249677 1433 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45237
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:56.250558 1433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:56.251493 1433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:56.259328 1439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:56.259334 1441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:56.259367 1433 server_base.cc:1034] running on GCE node
W20260809 09:26:56.259332 1438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:56.260061 1433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:56.261025 1433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:56.262214 1433 hybrid_clock.cc:648] HybridClock initialized: now 1786267616262199 us; error 25 us; skew 500 ppm
Aug 09 09:26:56 dist-test-slave-pgkr krb5kdc[1420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267616, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:26:56.264865 1433 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 09:26:56.265640 1433 webserver.cc:460] Webserver started at http://127.0.0.1:40953/ using document root <none> and password file <none>
I20260809 09:26:56.266119 1433 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:56.266175 1433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:56.266397 1433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:56.268179 1433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "4d0e7f385206418ca9aa1ff3aefef548"
format_stamp: "Formatted at 2026-08-09 09:26:56 on dist-test-slave-pgkr"
server_key: "43fb32ca58535839cba3d8580dafe42f"
server_key_iv: "ab26bdde1bc1e8b458bf9793d83822b5"
server_key_version: "encryptionkey@0"
I20260809 09:26:56.268664 1433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "4d0e7f385206418ca9aa1ff3aefef548"
format_stamp: "Formatted at 2026-08-09 09:26:56 on dist-test-slave-pgkr"
server_key: "43fb32ca58535839cba3d8580dafe42f"
server_key_iv: "ab26bdde1bc1e8b458bf9793d83822b5"
server_key_version: "encryptionkey@0"
I20260809 09:26:56.271860 1433 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 09:26:56.273993 1449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:56.275080 1433 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:26:56.275198 1433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "4d0e7f385206418ca9aa1ff3aefef548"
format_stamp: "Formatted at 2026-08-09 09:26:56 on dist-test-slave-pgkr"
server_key: "43fb32ca58535839cba3d8580dafe42f"
server_key_iv: "ab26bdde1bc1e8b458bf9793d83822b5"
server_key_version: "encryptionkey@0"
I20260809 09:26:56.275290 1433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:56.279479 1433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:56.282387 1433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:56.282577 1433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:56.289139 1433 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45237
I20260809 09:26:56.289153 1503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45237 every 8 connection(s)
I20260809 09:26:56.289990 1433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:26:56.291419 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 1433
I20260809 09:26:56.291587 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:26:56.291910 11663 external_mini_cluster.cc:1428] Setting key 69d118e072797213e189f2722785ce05
I20260809 09:26:56.293249 1505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:56.297119 1508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:56.293188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43835 (local address 127.0.0.1:45237)
0809 09:26:56.293613 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:56.293631 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:56.293672 (+ 41us) server_negotiation.cc:407] Connection header received
0809 09:26:56.294472 (+ 800us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:56.294492 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:56.294872 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:56.295199 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:56.295845 (+ 646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:56.295851 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:56.295864 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:26:56.295874 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:56.295931 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:26:56.295955 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:56.296089 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:56.296152 (+ 63us) server_negotiation.cc:299] Negotiation successful
0809 09:26:56.296291 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":153,"threads_started":1}
I20260809 09:26:56.299698 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 09:26:56.299880 1505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d0e7f385206418ca9aa1ff3aefef548: Bootstrap starting.
I20260809 09:26:56.302099 1505 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d0e7f385206418ca9aa1ff3aefef548: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:56.303021 1505 log.cc:824] T 00000000000000000000000000000000 P 4d0e7f385206418ca9aa1ff3aefef548: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:56.303443 1508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:56.301719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44887 (local address 127.0.0.1:45237)
0809 09:26:56.301835 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:56.301839 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:56.302110 (+ 271us) server_negotiation.cc:407] Connection header received
0809 09:26:56.302263 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:56.302271 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:56.302298 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:56.302359 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:56.303042 (+ 683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:56.303044 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:56.303046 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:26:56.303056 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:56.303076 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:26:56.303085 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:56.303185 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:56.303293 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 09:26:56.303319 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 09:26:56.304857 1505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d0e7f385206418ca9aa1ff3aefef548: No bootstrap required, opened a new log
I20260809 09:26:56.308046 1505 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d0e7f385206418ca9aa1ff3aefef548 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d0e7f385206418ca9aa1ff3aefef548" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45237 } }
I20260809 09:26:56.308255 1505 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4d0e7f385206418ca9aa1ff3aefef548 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:56.308346 1505 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d0e7f385206418ca9aa1ff3aefef548 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d0e7f385206418ca9aa1ff3aefef548, State: Initialized, Role: FOLLOWER
I20260809 09:26:56.308754 1505 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d0e7f385206418ca9aa1ff3aefef548 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d0e7f385206418ca9aa1ff3aefef548" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45237 } }
I20260809 09:26:56.308884 1505 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4d0e7f385206418ca9aa1ff3aefef548 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:26:56.308944 1505 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d0e7f385206418ca9aa1ff3aefef548 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:26:56.309032 1505 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d0e7f385206418ca9aa1ff3aefef548 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:56.309842 1505 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d0e7f385206418ca9aa1ff3aefef548 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d0e7f385206418ca9aa1ff3aefef548" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45237 } }
I20260809 09:26:56.310158 1505 leader_election.cc:302] T 00000000000000000000000000000000 P 4d0e7f385206418ca9aa1ff3aefef548 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4d0e7f385206418ca9aa1ff3aefef548; no voters:
I20260809 09:26:56.310467 1505 leader_election.cc:288] T 00000000000000000000000000000000 P 4d0e7f385206418ca9aa1ff3aefef548 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:26:56.310575 1515 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d0e7f385206418ca9aa1ff3aefef548 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:26:56.310827 1515 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4d0e7f385206418ca9aa1ff3aefef548 [term 1 LEADER]: Becoming Leader. State: Replica: 4d0e7f385206418ca9aa1ff3aefef548, State: Running, Role: LEADER
I20260809 09:26:56.311136 1515 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d0e7f385206418ca9aa1ff3aefef548 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d0e7f385206418ca9aa1ff3aefef548" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45237 } }
I20260809 09:26:56.311693 1505 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d0e7f385206418ca9aa1ff3aefef548 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:26:56.312840 1516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d0e7f385206418ca9aa1ff3aefef548 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4d0e7f385206418ca9aa1ff3aefef548" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d0e7f385206418ca9aa1ff3aefef548" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45237 } } }
I20260809 09:26:56.312855 1517 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d0e7f385206418ca9aa1ff3aefef548 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d0e7f385206418ca9aa1ff3aefef548. Latest consensus state: current_term: 1 leader_uuid: "4d0e7f385206418ca9aa1ff3aefef548" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d0e7f385206418ca9aa1ff3aefef548" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45237 } } }
I20260809 09:26:56.313056 1517 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d0e7f385206418ca9aa1ff3aefef548 [sys.catalog]: This master's current role is: LEADER
I20260809 09:26:56.313050 1516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d0e7f385206418ca9aa1ff3aefef548 [sys.catalog]: This master's current role is: LEADER
I20260809 09:26:56.314073 1524 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:26:56.316605 1524 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:26:56.321213 1524 catalog_manager.cc:1347] Generated new cluster ID: 69ade1b833314d2cb80f26ae1ed80162
I20260809 09:26:56.321272 1524 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:26:56.337311 1524 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:26:56.337595 1524 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:26:56.345719 1524 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4d0e7f385206418ca9aa1ff3aefef548: Generated new TSK 0
I20260809 09:26:56.346279 1524 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:26:56.351164 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 1433
2026-08-09T09:26:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1477 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:26:56 dist-test-slave-pgkr krb5kdc[1539](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:26:56 dist-test-slave-pgkr krb5kdc[1539](info): set up 2 sockets
Aug 09 09:26:56 dist-test-slave-pgkr krb5kdc[1539](info): commencing operation
krb5kdc: starting...
W20260809 09:26:57.393569 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.020s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:26:57 dist-test-slave-pgkr krb5kdc[1539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267617, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:26:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:26:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 09:26:57.509177 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34707
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34707
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:26:57.612715 1555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:57.612983 1555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:57.613054 1555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:57.616811 1555 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:26:57.616897 1555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:57.616937 1555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:57.617005 1555 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:26:57.617041 1555 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:26:57.621804 1555 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34707
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1555
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:57.622761 1555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:57.623708 1555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:57.631845 1560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:57.631852 1561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:57.631852 1563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:57.632066 1555 server_base.cc:1034] running on GCE node
I20260809 09:26:57.632649 1555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:57.633680 1555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:57.634840 1555 hybrid_clock.cc:648] HybridClock initialized: now 1786267617634822 us; error 28 us; skew 500 ppm
Aug 09 09:26:57 dist-test-slave-pgkr krb5kdc[1539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267617, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:26:57.637542 1555 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 09:26:57.638383 1555 webserver.cc:460] Webserver started at http://127.0.0.1:35635/ using document root <none> and password file <none>
I20260809 09:26:57.638936 1555 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:57.639010 1555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:57.639165 1555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:57.640991 1555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "386de3aa7f1145d38c410a1186338d21"
format_stamp: "Formatted at 2026-08-09 09:26:57 on dist-test-slave-pgkr"
server_key: "7a48a78de5dbf9f76c6df6780aeccb87"
server_key_iv: "6ecc6bc896c40244c9fb2c5548f9bc3f"
server_key_version: "encryptionkey@0"
I20260809 09:26:57.641486 1555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "386de3aa7f1145d38c410a1186338d21"
format_stamp: "Formatted at 2026-08-09 09:26:57 on dist-test-slave-pgkr"
server_key: "7a48a78de5dbf9f76c6df6780aeccb87"
server_key_iv: "6ecc6bc896c40244c9fb2c5548f9bc3f"
server_key_version: "encryptionkey@0"
I20260809 09:26:57.644932 1555 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260809 09:26:57.647063 1570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:57.648159 1555 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:26:57.648291 1555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "386de3aa7f1145d38c410a1186338d21"
format_stamp: "Formatted at 2026-08-09 09:26:57 on dist-test-slave-pgkr"
server_key: "7a48a78de5dbf9f76c6df6780aeccb87"
server_key_iv: "6ecc6bc896c40244c9fb2c5548f9bc3f"
server_key_version: "encryptionkey@0"
I20260809 09:26:57.648387 1555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:57.662312 1555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:57.664889 1555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:57.665078 1555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:57.671628 1555 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34707
I20260809 09:26:57.671653 1625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34707 every 8 connection(s)
I20260809 09:26:57.672477 1555 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:26:57.674346 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 1555
I20260809 09:26:57.674479 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:26:57.674818 11663 external_mini_cluster.cc:1428] Setting key 50628da7cff1d3dd4647dc5220c6e1ad
I20260809 09:26:57.675352 1626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:57.680631 1626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 386de3aa7f1145d38c410a1186338d21: Bootstrap starting.
I20260809 09:26:57.682695 1626 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 386de3aa7f1145d38c410a1186338d21: Neither blocks nor log segments found. Creating new log.
Aug 09 09:26:57 dist-test-slave-pgkr krb5kdc[1539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267617, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 09:26:57.683434 1626 log.cc:824] T 00000000000000000000000000000000 P 386de3aa7f1145d38c410a1186338d21: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:57.685184 1626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 386de3aa7f1145d38c410a1186338d21: No bootstrap required, opened a new log
I20260809 09:26:57.688369 1626 raft_consensus.cc:348] T 00000000000000000000000000000000 P 386de3aa7f1145d38c410a1186338d21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "386de3aa7f1145d38c410a1186338d21" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34707 } }
I20260809 09:26:57.688601 1626 raft_consensus.cc:374] T 00000000000000000000000000000000 P 386de3aa7f1145d38c410a1186338d21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:57.688685 1626 raft_consensus.cc:729] T 00000000000000000000000000000000 P 386de3aa7f1145d38c410a1186338d21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386de3aa7f1145d38c410a1186338d21, State: Initialized, Role: FOLLOWER
I20260809 09:26:57.689158 1626 consensus_queue.cc:260] T 00000000000000000000000000000000 P 386de3aa7f1145d38c410a1186338d21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "386de3aa7f1145d38c410a1186338d21" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34707 } }
I20260809 09:26:57.689333 1626 raft_consensus.cc:388] T 00000000000000000000000000000000 P 386de3aa7f1145d38c410a1186338d21 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:26:57.689401 1626 raft_consensus.cc:482] T 00000000000000000000000000000000 P 386de3aa7f1145d38c410a1186338d21 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:26:57.689507 1626 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 386de3aa7f1145d38c410a1186338d21 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:57.690644 1626 raft_consensus.cc:504] T 00000000000000000000000000000000 P 386de3aa7f1145d38c410a1186338d21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "386de3aa7f1145d38c410a1186338d21" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34707 } }
I20260809 09:26:57.690973 1626 leader_election.cc:302] T 00000000000000000000000000000000 P 386de3aa7f1145d38c410a1186338d21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 386de3aa7f1145d38c410a1186338d21; no voters:
I20260809 09:26:57.691273 1626 leader_election.cc:288] T 00000000000000000000000000000000 P 386de3aa7f1145d38c410a1186338d21 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:26:57.691370 1631 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 386de3aa7f1145d38c410a1186338d21 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:26:57.691684 1631 raft_consensus.cc:686] T 00000000000000000000000000000000 P 386de3aa7f1145d38c410a1186338d21 [term 1 LEADER]: Becoming Leader. State: Replica: 386de3aa7f1145d38c410a1186338d21, State: Running, Role: LEADER
I20260809 09:26:57.691998 1631 consensus_queue.cc:237] T 00000000000000000000000000000000 P 386de3aa7f1145d38c410a1186338d21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "386de3aa7f1145d38c410a1186338d21" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34707 } }
I20260809 09:26:57.692492 1626 sys_catalog.cc:564] T 00000000000000000000000000000000 P 386de3aa7f1145d38c410a1186338d21 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:26:57.693710 1633 sys_catalog.cc:455] T 00000000000000000000000000000000 P 386de3aa7f1145d38c410a1186338d21 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 386de3aa7f1145d38c410a1186338d21. Latest consensus state: current_term: 1 leader_uuid: "386de3aa7f1145d38c410a1186338d21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "386de3aa7f1145d38c410a1186338d21" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34707 } } }
I20260809 09:26:57.693833 1633 sys_catalog.cc:458] T 00000000000000000000000000000000 P 386de3aa7f1145d38c410a1186338d21 [sys.catalog]: This master's current role is: LEADER
I20260809 09:26:57.693931 1629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:57.676052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58513 (local address 127.0.0.1:34707)
0809 09:26:57.676447 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:57.676460 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:57.676490 (+ 30us) server_negotiation.cc:407] Connection header received
0809 09:26:57.677088 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:57.677103 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:57.677384 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:57.677689 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:57.678497 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:57.679465 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:57.680321 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:57.680810 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:57.680974 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:57.683515 (+ 2541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:57.683520 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:57.683557 (+ 37us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:57.683590 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:57.690735 (+ 7145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:57.691159 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:57.691165 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:57.691170 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:57.691314 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:57.691725 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:57.691728 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:57.691729 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:57.692185 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:57.692394 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:57.692685 (+ 291us) server_negotiation.cc:299] Negotiation successful
0809 09:26:57.692971 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":129,"threads_started":1}
I20260809 09:26:57.694151 1632 sys_catalog.cc:455] T 00000000000000000000000000000000 P 386de3aa7f1145d38c410a1186338d21 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "386de3aa7f1145d38c410a1186338d21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "386de3aa7f1145d38c410a1186338d21" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34707 } } }
I20260809 09:26:57.694232 1632 sys_catalog.cc:458] T 00000000000000000000000000000000 P 386de3aa7f1145d38c410a1186338d21 [sys.catalog]: This master's current role is: LEADER
I20260809 09:26:57.696939 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260809 09:26:57.697084 1646 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 386de3aa7f1145d38c410a1186338d21: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 09:26:57.697160 1646 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 09:26:57.697265 1640 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:26:57.697911 1640 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:26:57.703183 1640 catalog_manager.cc:1347] Generated new cluster ID: dc9cb91e11ed45e18d3eac9e98f80def
I20260809 09:26:57.703238 1640 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:26:57.707695 1629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:57.698916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57481 (local address 127.0.0.1:34707)
0809 09:26:57.699016 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:57.699020 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:57.699892 (+ 872us) server_negotiation.cc:407] Connection header received
0809 09:26:57.700009 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:57.700011 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:57.700056 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:57.700142 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:57.700906 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:57.701492 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:57.702523 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:57.702895 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:57.702996 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:57.704579 (+ 1583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:57.704582 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:57.704585 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:26:57.704607 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:57.706097 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:57.706561 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:57.706564 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:57.706565 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:57.706659 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:26:57.706931 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:26:57.706933 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:26:57.706935 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:26:57.707112 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:57.707219 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:57.707460 (+ 241us) server_negotiation.cc:299] Negotiation successful
0809 09:26:57.707559 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 09:26:57.714327 1640 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:26:57.715167 1640 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:26:57.728485 1640 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 386de3aa7f1145d38c410a1186338d21: Generated new TSK 0
I20260809 09:26:57.729097 1640 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:26:57.740790 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 1555
2026-08-09T09:26:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1387 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:26:57 dist-test-slave-pgkr krb5kdc[1657](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:26:57 dist-test-slave-pgkr krb5kdc[1657](info): set up 2 sockets
Aug 09 09:26:57 dist-test-slave-pgkr krb5kdc[1657](info): commencing operation
krb5kdc: starting...
W20260809 09:26:58.765836 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.004s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:26:58 dist-test-slave-pgkr krb5kdc[1657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:26:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:26:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 09:26:58.883363 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46729
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46729
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:26:58.987519 1671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:26:58.987756 1671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:26:58.987872 1671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:26:58.991614 1671 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:26:58.991668 1671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:26:58.991691 1671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:26:58.991710 1671 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:26:58.991729 1671 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:26:58.996625 1671 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46729
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46729
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:26:58.997478 1671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:26:58.998478 1671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:26:59.006567 1676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:59.006706 1679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:26:59.006578 1677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:26:59.006647 1671 server_base.cc:1034] running on GCE node
I20260809 09:26:59.007324 1671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:26:59.008353 1671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:26:59.009553 1671 hybrid_clock.cc:648] HybridClock initialized: now 1786267619009540 us; error 38 us; skew 500 ppm
Aug 09 09:26:59 dist-test-slave-pgkr krb5kdc[1657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267619, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:26:59.012369 1671 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 09:26:59.013214 1671 webserver.cc:460] Webserver started at http://127.0.0.1:33805/ using document root <none> and password file <none>
I20260809 09:26:59.013744 1671 fs_manager.cc:359] Metadata directory not provided
I20260809 09:26:59.013845 1671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:26:59.014098 1671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:26:59.016324 1671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "a4311c6f6cec477db582ca164ca55b07"
format_stamp: "Formatted at 2026-08-09 09:26:59 on dist-test-slave-pgkr"
server_key: "ee9787211bc931007b6460664f1012be"
server_key_iv: "6428efe2852743e2ae869c7865230080"
server_key_version: "encryptionkey@0"
I20260809 09:26:59.016973 1671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "a4311c6f6cec477db582ca164ca55b07"
format_stamp: "Formatted at 2026-08-09 09:26:59 on dist-test-slave-pgkr"
server_key: "ee9787211bc931007b6460664f1012be"
server_key_iv: "6428efe2852743e2ae869c7865230080"
server_key_version: "encryptionkey@0"
I20260809 09:26:59.020713 1671 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:26:59.023036 1686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:26:59.024190 1671 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:26:59.024323 1671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "a4311c6f6cec477db582ca164ca55b07"
format_stamp: "Formatted at 2026-08-09 09:26:59 on dist-test-slave-pgkr"
server_key: "ee9787211bc931007b6460664f1012be"
server_key_iv: "6428efe2852743e2ae869c7865230080"
server_key_version: "encryptionkey@0"
I20260809 09:26:59.024425 1671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:26:59.036020 1671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:26:59.038781 1671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:26:59.038975 1671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:26:59.045688 1671 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46729
I20260809 09:26:59.045719 1742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46729 every 8 connection(s)
I20260809 09:26:59.046537 1671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:26:59.048950 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 1671
I20260809 09:26:59.049093 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:26:59.049258 1743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:26:59.049408 11663 external_mini_cluster.cc:1428] Setting key c4bdad0b31e31b2a514e4a4c653a3894
I20260809 09:26:59.056481 1743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4311c6f6cec477db582ca164ca55b07: Bootstrap starting.
I20260809 09:26:59.059145 1743 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a4311c6f6cec477db582ca164ca55b07: Neither blocks nor log segments found. Creating new log.
I20260809 09:26:59.059454 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:59.050771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58155 (local address 127.0.0.1:46729)
0809 09:26:59.051215 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:59.051244 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:59.051287 (+ 43us) server_negotiation.cc:407] Connection header received
0809 09:26:59.052081 (+ 794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:59.052104 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:59.052534 (+ 430us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:59.052889 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:59.053303 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:59.054796 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:59.055761 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:59.056467 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:59.056636 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:59.057517 (+ 881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:59.057523 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:59.057550 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:26:59.058039 (+ 489us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:59.058102 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:26:59.058130 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:59.058217 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:59.058319 (+ 102us) server_negotiation.cc:299] Negotiation successful
0809 09:26:59.058508 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":134,"threads_started":1}
I20260809 09:26:59.059983 1743 log.cc:824] T 00000000000000000000000000000000 P a4311c6f6cec477db582ca164ca55b07: Log is configured to *not* fsync() on all Append() calls
I20260809 09:26:59.062052 1743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4311c6f6cec477db582ca164ca55b07: No bootstrap required, opened a new log
I20260809 09:26:59.062155 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 09:26:59.065335 1743 raft_consensus.cc:348] T 00000000000000000000000000000000 P a4311c6f6cec477db582ca164ca55b07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4311c6f6cec477db582ca164ca55b07" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46729 } }
I20260809 09:26:59.065557 1743 raft_consensus.cc:374] T 00000000000000000000000000000000 P a4311c6f6cec477db582ca164ca55b07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:26:59.065634 1743 raft_consensus.cc:729] T 00000000000000000000000000000000 P a4311c6f6cec477db582ca164ca55b07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4311c6f6cec477db582ca164ca55b07, State: Initialized, Role: FOLLOWER
I20260809 09:26:59.066064 1743 consensus_queue.cc:260] T 00000000000000000000000000000000 P a4311c6f6cec477db582ca164ca55b07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4311c6f6cec477db582ca164ca55b07" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46729 } }
I20260809 09:26:59.066207 1743 raft_consensus.cc:388] T 00000000000000000000000000000000 P a4311c6f6cec477db582ca164ca55b07 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:26:59.066290 1743 raft_consensus.cc:482] T 00000000000000000000000000000000 P a4311c6f6cec477db582ca164ca55b07 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:26:59.066381 1743 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a4311c6f6cec477db582ca164ca55b07 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:26:59.067296 1743 raft_consensus.cc:504] T 00000000000000000000000000000000 P a4311c6f6cec477db582ca164ca55b07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4311c6f6cec477db582ca164ca55b07" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46729 } }
I20260809 09:26:59.067631 1743 leader_election.cc:302] T 00000000000000000000000000000000 P a4311c6f6cec477db582ca164ca55b07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a4311c6f6cec477db582ca164ca55b07; no voters:
I20260809 09:26:59.067973 1743 leader_election.cc:288] T 00000000000000000000000000000000 P a4311c6f6cec477db582ca164ca55b07 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:26:59.068037 1754 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a4311c6f6cec477db582ca164ca55b07 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:26:59.068167 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:26:59.064656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51775 (local address 127.0.0.1:46729)
0809 09:26:59.064760 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0809 09:26:59.064763 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:26:59.064772 (+ 9us) server_negotiation.cc:407] Connection header received
0809 09:26:59.064797 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:26:59.064799 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:26:59.064827 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:26:59.064904 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:26:59.065156 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:59.065662 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:59.066488 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:26:59.066769 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:26:59.066867 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:26:59.067651 (+ 784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:26:59.067654 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:26:59.067657 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:26:59.067667 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:26:59.067691 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:26:59.067706 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:26:59.067775 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 09:26:59.067861 (+ 86us) server_negotiation.cc:299] Negotiation successful
0809 09:26:59.067904 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 09:26:59.068239 1754 raft_consensus.cc:686] T 00000000000000000000000000000000 P a4311c6f6cec477db582ca164ca55b07 [term 1 LEADER]: Becoming Leader. State: Replica: a4311c6f6cec477db582ca164ca55b07, State: Running, Role: LEADER
I20260809 09:26:59.068486 1754 consensus_queue.cc:237] T 00000000000000000000000000000000 P a4311c6f6cec477db582ca164ca55b07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4311c6f6cec477db582ca164ca55b07" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46729 } }
I20260809 09:26:59.069141 1743 sys_catalog.cc:564] T 00000000000000000000000000000000 P a4311c6f6cec477db582ca164ca55b07 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:26:59.069633 1756 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4311c6f6cec477db582ca164ca55b07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a4311c6f6cec477db582ca164ca55b07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4311c6f6cec477db582ca164ca55b07" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46729 } } }
I20260809 09:26:59.069777 1756 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4311c6f6cec477db582ca164ca55b07 [sys.catalog]: This master's current role is: LEADER
I20260809 09:26:59.070139 1755 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4311c6f6cec477db582ca164ca55b07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a4311c6f6cec477db582ca164ca55b07. Latest consensus state: current_term: 1 leader_uuid: "a4311c6f6cec477db582ca164ca55b07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4311c6f6cec477db582ca164ca55b07" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46729 } } }
I20260809 09:26:59.070317 1755 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4311c6f6cec477db582ca164ca55b07 [sys.catalog]: This master's current role is: LEADER
I20260809 09:26:59.071249 1759 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:26:59.073818 1759 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:26:59.079173 1759 catalog_manager.cc:1347] Generated new cluster ID: b9ec8e3ef9574c5c892ac8f06bc5011f
I20260809 09:26:59.079228 1759 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:26:59.090929 1759 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:26:59.092042 1759 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:26:59.111837 1759 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a4311c6f6cec477db582ca164ca55b07: Generated new TSK 0
I20260809 09:26:59.112471 1759 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:26:59.122190 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 1671
2026-08-09T09:26:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1381 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:26:59 dist-test-slave-pgkr krb5kdc[1776](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:26:59 dist-test-slave-pgkr krb5kdc[1776](info): set up 2 sockets
Aug 09 09:26:59 dist-test-slave-pgkr krb5kdc[1776](info): commencing operation
krb5kdc: starting...
W20260809 09:27:00.167536 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.025s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:27:00 dist-test-slave-pgkr krb5kdc[1776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267620, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:27:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:27:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 09:27:00.281644 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45281
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45281
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:27:00.388342 1789 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:27:00.388599 1789 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:27:00.388640 1789 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:27:00.392652 1789 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:27:00.392710 1789 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:27:00.392735 1789 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:27:00.392751 1789 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:27:00.392765 1789 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:27:00.397820 1789 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45281
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1789
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:27:00.398838 1789 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:27:00.399811 1789 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:27:00.408274 1797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:00.408278 1794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:00.408303 1795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:00.408507 1789 server_base.cc:1034] running on GCE node
I20260809 09:27:00.409257 1789 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:27:00.410399 1789 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:27:00.411581 1789 hybrid_clock.cc:648] HybridClock initialized: now 1786267620411545 us; error 36 us; skew 500 ppm
Aug 09 09:27:00 dist-test-slave-pgkr krb5kdc[1776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267620, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:27:00.414317 1789 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 09:27:00.415242 1789 webserver.cc:460] Webserver started at http://127.0.0.1:44189/ using document root <none> and password file <none>
I20260809 09:27:00.415807 1789 fs_manager.cc:359] Metadata directory not provided
I20260809 09:27:00.415903 1789 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:27:00.416153 1789 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:27:00.418205 1789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "257ac8fb1b094e4a9d2e9faef910e3c3"
format_stamp: "Formatted at 2026-08-09 09:27:00 on dist-test-slave-pgkr"
server_key: "04c4204e44376509da6b78390ef9d37f"
server_key_iv: "e16f2f084a05034ba9503561ab4194aa"
server_key_version: "encryptionkey@0"
I20260809 09:27:00.418833 1789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "257ac8fb1b094e4a9d2e9faef910e3c3"
format_stamp: "Formatted at 2026-08-09 09:27:00 on dist-test-slave-pgkr"
server_key: "04c4204e44376509da6b78390ef9d37f"
server_key_iv: "e16f2f084a05034ba9503561ab4194aa"
server_key_version: "encryptionkey@0"
I20260809 09:27:00.422654 1789 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 09:27:00.425086 1804 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:27:00.426218 1789 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:27:00.426375 1789 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "257ac8fb1b094e4a9d2e9faef910e3c3"
format_stamp: "Formatted at 2026-08-09 09:27:00 on dist-test-slave-pgkr"
server_key: "04c4204e44376509da6b78390ef9d37f"
server_key_iv: "e16f2f084a05034ba9503561ab4194aa"
server_key_version: "encryptionkey@0"
I20260809 09:27:00.426488 1789 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:27:00.431074 1789 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:27:00.433810 1789 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:27:00.433992 1789 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:27:00.440938 1789 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45281
I20260809 09:27:00.441009 1860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45281 every 8 connection(s)
I20260809 09:27:00.441847 1789 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:27:00.444547 1861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:27:00.447150 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 1789
I20260809 09:27:00.447317 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:27:00.447587 11663 external_mini_cluster.cc:1428] Setting key 2eee0a646e1d4f23f041521324d3f955
I20260809 09:27:00.450295 1861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 257ac8fb1b094e4a9d2e9faef910e3c3: Bootstrap starting.
I20260809 09:27:00.452976 1866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:00.448898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60221 (local address 127.0.0.1:45281)
0809 09:27:00.449335 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:00.449350 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:00.449384 (+ 34us) server_negotiation.cc:407] Connection header received
0809 09:27:00.449947 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:00.449962 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:00.450218 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:00.450533 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:00.451378 (+ 845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:00.451386 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:00.451402 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:27:00.451420 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:00.451489 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:27:00.451516 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:00.451682 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:00.451896 (+ 214us) server_negotiation.cc:299] Negotiation successful
0809 09:27:00.452164 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":144,"threads_started":1}
I20260809 09:27:00.453117 1861 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 257ac8fb1b094e4a9d2e9faef910e3c3: Neither blocks nor log segments found. Creating new log.
I20260809 09:27:00.453891 1861 log.cc:824] T 00000000000000000000000000000000 P 257ac8fb1b094e4a9d2e9faef910e3c3: Log is configured to *not* fsync() on all Append() calls
I20260809 09:27:00.455742 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 09:27:00.455901 1861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 257ac8fb1b094e4a9d2e9faef910e3c3: No bootstrap required, opened a new log
I20260809 09:27:00.459697 1866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:00.458024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49963 (local address 127.0.0.1:45281)
0809 09:27:00.458154 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:00.458158 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:00.458403 (+ 245us) server_negotiation.cc:407] Connection header received
0809 09:27:00.458500 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:00.458503 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:00.458531 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:00.458597 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:00.459288 (+ 691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:00.459291 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:00.459293 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:27:00.459303 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:00.459326 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:27:00.459335 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:00.459403 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:00.459534 (+ 131us) server_negotiation.cc:299] Negotiation successful
0809 09:27:00.459566 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 09:27:00.460688 1861 raft_consensus.cc:348] T 00000000000000000000000000000000 P 257ac8fb1b094e4a9d2e9faef910e3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "257ac8fb1b094e4a9d2e9faef910e3c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45281 } }
I20260809 09:27:00.460934 1861 raft_consensus.cc:374] T 00000000000000000000000000000000 P 257ac8fb1b094e4a9d2e9faef910e3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:27:00.460994 1861 raft_consensus.cc:729] T 00000000000000000000000000000000 P 257ac8fb1b094e4a9d2e9faef910e3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257ac8fb1b094e4a9d2e9faef910e3c3, State: Initialized, Role: FOLLOWER
I20260809 09:27:00.461374 1861 consensus_queue.cc:260] T 00000000000000000000000000000000 P 257ac8fb1b094e4a9d2e9faef910e3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "257ac8fb1b094e4a9d2e9faef910e3c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45281 } }
I20260809 09:27:00.461527 1861 raft_consensus.cc:388] T 00000000000000000000000000000000 P 257ac8fb1b094e4a9d2e9faef910e3c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:27:00.461622 1861 raft_consensus.cc:482] T 00000000000000000000000000000000 P 257ac8fb1b094e4a9d2e9faef910e3c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:27:00.461722 1861 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 257ac8fb1b094e4a9d2e9faef910e3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:27:00.462766 1861 raft_consensus.cc:504] T 00000000000000000000000000000000 P 257ac8fb1b094e4a9d2e9faef910e3c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "257ac8fb1b094e4a9d2e9faef910e3c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45281 } }
I20260809 09:27:00.463040 1861 leader_election.cc:302] T 00000000000000000000000000000000 P 257ac8fb1b094e4a9d2e9faef910e3c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 257ac8fb1b094e4a9d2e9faef910e3c3; no voters:
I20260809 09:27:00.463274 1861 leader_election.cc:288] T 00000000000000000000000000000000 P 257ac8fb1b094e4a9d2e9faef910e3c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:27:00.463402 1873 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 257ac8fb1b094e4a9d2e9faef910e3c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:27:00.463629 1873 raft_consensus.cc:686] T 00000000000000000000000000000000 P 257ac8fb1b094e4a9d2e9faef910e3c3 [term 1 LEADER]: Becoming Leader. State: Replica: 257ac8fb1b094e4a9d2e9faef910e3c3, State: Running, Role: LEADER
I20260809 09:27:00.463958 1873 consensus_queue.cc:237] T 00000000000000000000000000000000 P 257ac8fb1b094e4a9d2e9faef910e3c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "257ac8fb1b094e4a9d2e9faef910e3c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45281 } }
I20260809 09:27:00.464387 1861 sys_catalog.cc:564] T 00000000000000000000000000000000 P 257ac8fb1b094e4a9d2e9faef910e3c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:27:00.465529 1877 sys_catalog.cc:455] T 00000000000000000000000000000000 P 257ac8fb1b094e4a9d2e9faef910e3c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 257ac8fb1b094e4a9d2e9faef910e3c3. Latest consensus state: current_term: 1 leader_uuid: "257ac8fb1b094e4a9d2e9faef910e3c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "257ac8fb1b094e4a9d2e9faef910e3c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45281 } } }
I20260809 09:27:00.465659 1877 sys_catalog.cc:458] T 00000000000000000000000000000000 P 257ac8fb1b094e4a9d2e9faef910e3c3 [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:00.466001 1875 sys_catalog.cc:455] T 00000000000000000000000000000000 P 257ac8fb1b094e4a9d2e9faef910e3c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "257ac8fb1b094e4a9d2e9faef910e3c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "257ac8fb1b094e4a9d2e9faef910e3c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45281 } } }
I20260809 09:27:00.466126 1875 sys_catalog.cc:458] T 00000000000000000000000000000000 P 257ac8fb1b094e4a9d2e9faef910e3c3 [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:00.466058 1884 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:27:00.469661 1884 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:27:00.474968 1884 catalog_manager.cc:1347] Generated new cluster ID: 9fd9997f959b46aa9c09387b21db7aa6
I20260809 09:27:00.475054 1884 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:27:00.491914 1884 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:27:00.492261 1884 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:27:00.498755 1884 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 257ac8fb1b094e4a9d2e9faef910e3c3: Generated new TSK 0
I20260809 09:27:00.499393 1884 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:27:00.503839 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 1789
2026-08-09T09:27:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1383 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:27:00 dist-test-slave-pgkr krb5kdc[1898](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:27:00 dist-test-slave-pgkr krb5kdc[1898](info): set up 2 sockets
Aug 09 09:27:00 dist-test-slave-pgkr krb5kdc[1898](info): commencing operation
krb5kdc: starting...
W20260809 09:27:01.554853 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.028s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:27:01 dist-test-slave-pgkr krb5kdc[1898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267621, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:27:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:27:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 09:27:01.670861 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41315
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41315
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:27:01.773062 1912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:27:01.773288 1912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:27:01.773329 1912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:27:01.777052 1912 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:27:01.777099 1912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:27:01.777118 1912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:27:01.777134 1912 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:27:01.777148 1912 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:27:01.781687 1912 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41315
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1912
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:27:01.782495 1912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:27:01.783354 1912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:27:01.791182 1920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:01.791378 1912 server_base.cc:1034] running on GCE node
W20260809 09:27:01.791186 1917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:01.791196 1918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:01.792021 1912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:27:01.793030 1912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:27:01.794188 1912 hybrid_clock.cc:648] HybridClock initialized: now 1786267621794162 us; error 39 us; skew 500 ppm
Aug 09 09:27:01 dist-test-slave-pgkr krb5kdc[1898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267621, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:27:01.796849 1912 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 09:27:01.797667 1912 webserver.cc:460] Webserver started at http://127.0.0.1:44797/ using document root <none> and password file <none>
I20260809 09:27:01.798131 1912 fs_manager.cc:359] Metadata directory not provided
I20260809 09:27:01.798188 1912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:27:01.798359 1912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:27:01.800341 1912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "f3e9f81a5dae4cc5b17416f36d875563"
format_stamp: "Formatted at 2026-08-09 09:27:01 on dist-test-slave-pgkr"
server_key: "1424bfee41d92a40505ebcadf0498c53"
server_key_iv: "7f427c8b21bcb4782fa3258b56bf5bd3"
server_key_version: "encryptionkey@0"
I20260809 09:27:01.800869 1912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "f3e9f81a5dae4cc5b17416f36d875563"
format_stamp: "Formatted at 2026-08-09 09:27:01 on dist-test-slave-pgkr"
server_key: "1424bfee41d92a40505ebcadf0498c53"
server_key_iv: "7f427c8b21bcb4782fa3258b56bf5bd3"
server_key_version: "encryptionkey@0"
I20260809 09:27:01.804337 1912 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 09:27:01.806327 1927 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:27:01.807451 1912 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:27:01.807582 1912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "f3e9f81a5dae4cc5b17416f36d875563"
format_stamp: "Formatted at 2026-08-09 09:27:01 on dist-test-slave-pgkr"
server_key: "1424bfee41d92a40505ebcadf0498c53"
server_key_iv: "7f427c8b21bcb4782fa3258b56bf5bd3"
server_key_version: "encryptionkey@0"
I20260809 09:27:01.807687 1912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:27:01.824792 1912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:27:01.827661 1912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:27:01.827868 1912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:27:01.834740 1912 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41315
I20260809 09:27:01.834756 1981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41315 every 8 connection(s)
I20260809 09:27:01.835670 1912 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:27:01.836515 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 1912
I20260809 09:27:01.836664 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:27:01.836963 11663 external_mini_cluster.cc:1428] Setting key 3e0e95c46bf3006a7a749687da63a679
I20260809 09:27:01.838865 1982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:27:01.844131 1982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3e9f81a5dae4cc5b17416f36d875563: Bootstrap starting.
Aug 09 09:27:01 dist-test-slave-pgkr krb5kdc[1898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267621, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 09:27:01.846134 1982 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f3e9f81a5dae4cc5b17416f36d875563: Neither blocks nor log segments found. Creating new log.
I20260809 09:27:01.846923 1982 log.cc:824] T 00000000000000000000000000000000 P f3e9f81a5dae4cc5b17416f36d875563: Log is configured to *not* fsync() on all Append() calls
I20260809 09:27:01.848719 1982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3e9f81a5dae4cc5b17416f36d875563: No bootstrap required, opened a new log
I20260809 09:27:01.851066 1985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:01.838425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.175:46157 (local address 127.0.0.1:41315)
0809 09:27:01.838853 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:01.838866 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:01.838900 (+ 34us) server_negotiation.cc:407] Connection header received
0809 09:27:01.839555 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:01.839571 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:01.839890 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:01.840215 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:01.841005 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:01.842063 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:01.843031 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:01.843485 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:01.843641 (+ 156us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:01.845973 (+ 2332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:01.845978 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:01.845988 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:01.846011 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:01.847919 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:01.848435 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:01.848439 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:01.848443 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:01.848549 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:01.848946 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:01.848949 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:01.848951 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:01.849423 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:01.849629 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:01.849849 (+ 220us) server_negotiation.cc:299] Negotiation successful
0809 09:27:01.850055 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":158,"threads_started":1}
I20260809 09:27:01.852948 1982 raft_consensus.cc:348] T 00000000000000000000000000000000 P f3e9f81a5dae4cc5b17416f36d875563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3e9f81a5dae4cc5b17416f36d875563" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41315 } }
I20260809 09:27:01.853165 1982 raft_consensus.cc:374] T 00000000000000000000000000000000 P f3e9f81a5dae4cc5b17416f36d875563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:27:01.853248 1982 raft_consensus.cc:729] T 00000000000000000000000000000000 P f3e9f81a5dae4cc5b17416f36d875563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3e9f81a5dae4cc5b17416f36d875563, State: Initialized, Role: FOLLOWER
I20260809 09:27:01.853693 1982 consensus_queue.cc:260] T 00000000000000000000000000000000 P f3e9f81a5dae4cc5b17416f36d875563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3e9f81a5dae4cc5b17416f36d875563" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41315 } }
I20260809 09:27:01.853847 1982 raft_consensus.cc:388] T 00000000000000000000000000000000 P f3e9f81a5dae4cc5b17416f36d875563 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:27:01.853919 1982 raft_consensus.cc:482] T 00000000000000000000000000000000 P f3e9f81a5dae4cc5b17416f36d875563 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:27:01.853973 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 09:27:01.854007 1982 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f3e9f81a5dae4cc5b17416f36d875563 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:27:01.854852 1982 raft_consensus.cc:504] T 00000000000000000000000000000000 P f3e9f81a5dae4cc5b17416f36d875563 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3e9f81a5dae4cc5b17416f36d875563" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41315 } }
I20260809 09:27:01.855203 1982 leader_election.cc:302] T 00000000000000000000000000000000 P f3e9f81a5dae4cc5b17416f36d875563 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f3e9f81a5dae4cc5b17416f36d875563; no voters:
I20260809 09:27:01.855571 1982 leader_election.cc:288] T 00000000000000000000000000000000 P f3e9f81a5dae4cc5b17416f36d875563 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:27:01.855639 1991 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f3e9f81a5dae4cc5b17416f36d875563 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:27:01.855885 1991 raft_consensus.cc:686] T 00000000000000000000000000000000 P f3e9f81a5dae4cc5b17416f36d875563 [term 1 LEADER]: Becoming Leader. State: Replica: f3e9f81a5dae4cc5b17416f36d875563, State: Running, Role: LEADER
I20260809 09:27:01.856221 1991 consensus_queue.cc:237] T 00000000000000000000000000000000 P f3e9f81a5dae4cc5b17416f36d875563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3e9f81a5dae4cc5b17416f36d875563" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41315 } }
I20260809 09:27:01.856837 1982 sys_catalog.cc:564] T 00000000000000000000000000000000 P f3e9f81a5dae4cc5b17416f36d875563 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:27:01.857548 1994 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3e9f81a5dae4cc5b17416f36d875563 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3e9f81a5dae4cc5b17416f36d875563. Latest consensus state: current_term: 1 leader_uuid: "f3e9f81a5dae4cc5b17416f36d875563" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3e9f81a5dae4cc5b17416f36d875563" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41315 } } }
I20260809 09:27:01.858281 1994 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3e9f81a5dae4cc5b17416f36d875563 [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:01.858166 1993 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3e9f81a5dae4cc5b17416f36d875563 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f3e9f81a5dae4cc5b17416f36d875563" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3e9f81a5dae4cc5b17416f36d875563" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41315 } } }
I20260809 09:27:01.858588 1993 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3e9f81a5dae4cc5b17416f36d875563 [sys.catalog]: This master's current role is: LEADER
W20260809 09:27:01.861526 2008 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f3e9f81a5dae4cc5b17416f36d875563: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 09:27:01.861635 2008 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 09:27:01.861845 2004 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:27:01.862854 2004 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:27:01.865427 1985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:01.856294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.175:55437 (local address 127.0.0.1:41315)
0809 09:27:01.856424 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:01.856428 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:01.856589 (+ 161us) server_negotiation.cc:407] Connection header received
0809 09:27:01.856726 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:01.856730 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:01.856783 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:01.856848 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:01.857702 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:01.858489 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:01.859599 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:01.859842 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:01.859952 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:01.861308 (+ 1356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:01.861313 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:01.861319 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:01.861343 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:01.863120 (+ 1777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:01.863765 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:01.863768 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:01.863770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:01.863857 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:01.864280 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:01.864285 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:01.864288 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:01.864502 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:01.864663 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:01.864985 (+ 322us) server_negotiation.cc:299] Negotiation successful
0809 09:27:01.865263 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 09:27:01.868391 2004 catalog_manager.cc:1347] Generated new cluster ID: cb0dc7b8bf284cfc9727005e99f877e9
I20260809 09:27:01.868455 2004 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:27:01.876469 2004 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:27:01.877305 2004 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:27:01.882746 2004 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f3e9f81a5dae4cc5b17416f36d875563: Generated new TSK 0
I20260809 09:27:01.883474 2004 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:27:01.893460 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 1912
W20260809 09:27:01.901109 1896 connection.cc:535] client connection to 127.0.0.1:41315 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41315): Connection reset by peer (error 104)
2026-08-09T09:27:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1388 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:27:01 dist-test-slave-pgkr krb5kdc[2014](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:27:01 dist-test-slave-pgkr krb5kdc[2014](info): set up 2 sockets
Aug 09 09:27:01 dist-test-slave-pgkr krb5kdc[2014](info): commencing operation
krb5kdc: starting...
W20260809 09:27:02.960614 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.045s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:27:03 dist-test-slave-pgkr krb5kdc[2014](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267623, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:27:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:27:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 09:27:03.075826 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33195
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33195
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:27:03.181069 2027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:27:03.181285 2027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:27:03.181353 2027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:27:03.185134 2027 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:27:03.185184 2027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:27:03.185200 2027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:27:03.185256 2027 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:27:03.185286 2027 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:27:03.190085 2027 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33195
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33195
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2027
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:27:03.191007 2027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:27:03.191893 2027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:27:03.200029 2032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:03.200058 2033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:03.200129 2027 server_base.cc:1034] running on GCE node
W20260809 09:27:03.200028 2035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:03.200798 2027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:27:03.201861 2027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:27:03.203017 2027 hybrid_clock.cc:648] HybridClock initialized: now 1786267623202999 us; error 49 us; skew 500 ppm
Aug 09 09:27:03 dist-test-slave-pgkr krb5kdc[2014](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267623, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:27:03.205574 2027 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 09:27:03.206426 2027 webserver.cc:460] Webserver started at http://127.0.0.1:45407/ using document root <none> and password file <none>
I20260809 09:27:03.206992 2027 fs_manager.cc:359] Metadata directory not provided
I20260809 09:27:03.207054 2027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:27:03.207286 2027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:27:03.209159 2027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "e4762f430bf240b2b1298595713a9d3e"
format_stamp: "Formatted at 2026-08-09 09:27:03 on dist-test-slave-pgkr"
server_key: "632b3eb6f9643f64b301a81e2394fcbf"
server_key_iv: "e554f85ed84fa218e129d0c81bae22ba"
server_key_version: "encryptionkey@0"
I20260809 09:27:03.209704 2027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "e4762f430bf240b2b1298595713a9d3e"
format_stamp: "Formatted at 2026-08-09 09:27:03 on dist-test-slave-pgkr"
server_key: "632b3eb6f9643f64b301a81e2394fcbf"
server_key_iv: "e554f85ed84fa218e129d0c81bae22ba"
server_key_version: "encryptionkey@0"
I20260809 09:27:03.213279 2027 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 09:27:03.215461 2043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:27:03.216586 2027 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:27:03.216711 2027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "e4762f430bf240b2b1298595713a9d3e"
format_stamp: "Formatted at 2026-08-09 09:27:03 on dist-test-slave-pgkr"
server_key: "632b3eb6f9643f64b301a81e2394fcbf"
server_key_iv: "e554f85ed84fa218e129d0c81bae22ba"
server_key_version: "encryptionkey@0"
I20260809 09:27:03.216811 2027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:27:03.245976 2027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:27:03.249586 2027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:27:03.249781 2027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:27:03.255962 2027 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33195
I20260809 09:27:03.256047 2098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33195 every 8 connection(s)
I20260809 09:27:03.256855 2027 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:27:03.259516 2099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:27:03.261183 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 2027
I20260809 09:27:03.261312 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:27:03.261592 11663 external_mini_cluster.cc:1428] Setting key 4901149cd34e154e992b823409bed695
I20260809 09:27:03.265446 2099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4762f430bf240b2b1298595713a9d3e: Bootstrap starting.
I20260809 09:27:03.267896 2099 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e4762f430bf240b2b1298595713a9d3e: Neither blocks nor log segments found. Creating new log.
I20260809 09:27:03.268635 2099 log.cc:824] T 00000000000000000000000000000000 P e4762f430bf240b2b1298595713a9d3e: Log is configured to *not* fsync() on all Append() calls
I20260809 09:27:03.269771 2103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:03.262818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.175:55621 (local address 127.0.0.1:33195)
0809 09:27:03.263206 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:03.263230 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:03.263263 (+ 33us) server_negotiation.cc:407] Connection header received
0809 09:27:03.263906 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:03.263921 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:03.264212 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:03.264453 (+ 241us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:03.264836 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:03.265772 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:03.266899 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:03.267333 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:03.267450 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:03.268199 (+ 749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:03.268203 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:03.268213 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:27:03.268579 (+ 366us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:03.268625 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:27:03.268644 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:03.268777 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:03.268928 (+ 151us) server_negotiation.cc:299] Negotiation successful
0809 09:27:03.269042 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":142,"threads_started":1}
I20260809 09:27:03.270460 2099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4762f430bf240b2b1298595713a9d3e: No bootstrap required, opened a new log
I20260809 09:27:03.272377 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 09:27:03.274154 2099 raft_consensus.cc:348] T 00000000000000000000000000000000 P e4762f430bf240b2b1298595713a9d3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4762f430bf240b2b1298595713a9d3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33195 } }
I20260809 09:27:03.274416 2099 raft_consensus.cc:374] T 00000000000000000000000000000000 P e4762f430bf240b2b1298595713a9d3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:27:03.274502 2099 raft_consensus.cc:729] T 00000000000000000000000000000000 P e4762f430bf240b2b1298595713a9d3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4762f430bf240b2b1298595713a9d3e, State: Initialized, Role: FOLLOWER
I20260809 09:27:03.274886 2099 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4762f430bf240b2b1298595713a9d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4762f430bf240b2b1298595713a9d3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33195 } }
I20260809 09:27:03.275027 2099 raft_consensus.cc:388] T 00000000000000000000000000000000 P e4762f430bf240b2b1298595713a9d3e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:27:03.275107 2099 raft_consensus.cc:482] T 00000000000000000000000000000000 P e4762f430bf240b2b1298595713a9d3e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:27:03.275198 2099 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e4762f430bf240b2b1298595713a9d3e [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:27:03.276015 2099 raft_consensus.cc:504] T 00000000000000000000000000000000 P e4762f430bf240b2b1298595713a9d3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4762f430bf240b2b1298595713a9d3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33195 } }
I20260809 09:27:03.276341 2099 leader_election.cc:302] T 00000000000000000000000000000000 P e4762f430bf240b2b1298595713a9d3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4762f430bf240b2b1298595713a9d3e; no voters:
I20260809 09:27:03.276701 2099 leader_election.cc:288] T 00000000000000000000000000000000 P e4762f430bf240b2b1298595713a9d3e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:27:03.276803 2112 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e4762f430bf240b2b1298595713a9d3e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:27:03.277029 2112 raft_consensus.cc:686] T 00000000000000000000000000000000 P e4762f430bf240b2b1298595713a9d3e [term 1 LEADER]: Becoming Leader. State: Replica: e4762f430bf240b2b1298595713a9d3e, State: Running, Role: LEADER
I20260809 09:27:03.277343 2112 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4762f430bf240b2b1298595713a9d3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4762f430bf240b2b1298595713a9d3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33195 } }
I20260809 09:27:03.277936 2099 sys_catalog.cc:564] T 00000000000000000000000000000000 P e4762f430bf240b2b1298595713a9d3e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:27:03.278677 2103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:03.274243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.175:42335 (local address 127.0.0.1:33195)
0809 09:27:03.274358 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:03.274362 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:03.274555 (+ 193us) server_negotiation.cc:407] Connection header received
0809 09:27:03.274788 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:03.274793 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:03.274832 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:03.274908 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:03.275175 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:03.275737 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:03.276676 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:03.276980 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:03.277087 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:03.278042 (+ 955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:03.278048 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:03.278052 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:27:03.278067 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:03.278092 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:27:03.278104 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:03.278171 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:03.278489 (+ 318us) server_negotiation.cc:299] Negotiation successful
0809 09:27:03.278520 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 09:27:03.279301 2113 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4762f430bf240b2b1298595713a9d3e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4762f430bf240b2b1298595713a9d3e. Latest consensus state: current_term: 1 leader_uuid: "e4762f430bf240b2b1298595713a9d3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4762f430bf240b2b1298595713a9d3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33195 } } }
I20260809 09:27:03.279441 2113 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4762f430bf240b2b1298595713a9d3e [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:03.279855 2124 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:27:03.279812 2114 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4762f430bf240b2b1298595713a9d3e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e4762f430bf240b2b1298595713a9d3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4762f430bf240b2b1298595713a9d3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33195 } } }
I20260809 09:27:03.279915 2114 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4762f430bf240b2b1298595713a9d3e [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:03.282845 2124 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:27:03.287395 2124 catalog_manager.cc:1347] Generated new cluster ID: 2c8bb0ea74d641dba46e9bb8f22de2ee
I20260809 09:27:03.287488 2124 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:27:03.302388 2124 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:27:03.303637 2124 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:27:03.313627 2124 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e4762f430bf240b2b1298595713a9d3e: Generated new TSK 0
I20260809 09:27:03.314288 2124 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:27:03.319525 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 2027
W20260809 09:27:03.327255 2012 connection.cc:535] client connection to 127.0.0.1:33195 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33195): Connection reset by peer (error 104)
2026-08-09T09:27:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1426 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:27:03 dist-test-slave-pgkr krb5kdc[2134](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:27:03 dist-test-slave-pgkr krb5kdc[2134](info): set up 2 sockets
Aug 09 09:27:03 dist-test-slave-pgkr krb5kdc[2134](info): commencing operation
krb5kdc: starting...
W20260809 09:27:04.352893 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.011s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:27:04 dist-test-slave-pgkr krb5kdc[2134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267624, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:27:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:27:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 09:27:04.467166 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43237
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43237
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:27:04.577682 2147 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:27:04.577936 2147 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:27:04.577976 2147 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:27:04.582468 2147 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:27:04.582527 2147 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:27:04.582546 2147 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:27:04.582562 2147 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:27:04.582576 2147 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:27:04.587807 2147 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43237
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2147
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:27:04.588768 2147 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:27:04.589679 2147 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:27:04.597998 2152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:04.598085 2155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:04.598002 2153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:04.598248 2147 server_base.cc:1034] running on GCE node
I20260809 09:27:04.598946 2147 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:27:04.599949 2147 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:27:04.601130 2147 hybrid_clock.cc:648] HybridClock initialized: now 1786267624601110 us; error 27 us; skew 500 ppm
Aug 09 09:27:04 dist-test-slave-pgkr krb5kdc[2134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267624, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:27:04.603906 2147 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 09:27:04.604719 2147 webserver.cc:460] Webserver started at http://127.0.0.1:44303/ using document root <none> and password file <none>
I20260809 09:27:04.605270 2147 fs_manager.cc:359] Metadata directory not provided
I20260809 09:27:04.605338 2147 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:27:04.605634 2147 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:27:04.607657 2147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "c52816d5102d4b3bae715877d6b4d67d"
format_stamp: "Formatted at 2026-08-09 09:27:04 on dist-test-slave-pgkr"
server_key: "5018a9db9ba9712c6fac20ef4e1c2ed6"
server_key_iv: "40288e5f3458e42e1b80c3d34e42a464"
server_key_version: "encryptionkey@0"
I20260809 09:27:04.608223 2147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "c52816d5102d4b3bae715877d6b4d67d"
format_stamp: "Formatted at 2026-08-09 09:27:04 on dist-test-slave-pgkr"
server_key: "5018a9db9ba9712c6fac20ef4e1c2ed6"
server_key_iv: "40288e5f3458e42e1b80c3d34e42a464"
server_key_version: "encryptionkey@0"
I20260809 09:27:04.611675 2147 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260809 09:27:04.613958 2163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:27:04.615186 2147 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:27:04.615319 2147 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "c52816d5102d4b3bae715877d6b4d67d"
format_stamp: "Formatted at 2026-08-09 09:27:04 on dist-test-slave-pgkr"
server_key: "5018a9db9ba9712c6fac20ef4e1c2ed6"
server_key_iv: "40288e5f3458e42e1b80c3d34e42a464"
server_key_version: "encryptionkey@0"
I20260809 09:27:04.615422 2147 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:27:04.619709 2147 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:27:04.622427 2147 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:27:04.622653 2147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:27:04.629073 2147 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43237
I20260809 09:27:04.629123 2221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43237 every 8 connection(s)
I20260809 09:27:04.629920 2147 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:27:04.632540 2222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:27:04.632608 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 2147
I20260809 09:27:04.632756 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:27:04.633038 11663 external_mini_cluster.cc:1428] Setting key 7a3283f1b1835b0645860ac5643604fc
I20260809 09:27:04.638933 2225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:04.634209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.175:34029 (local address 127.0.0.1:43237)
0809 09:27:04.634682 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:04.634700 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:04.634748 (+ 48us) server_negotiation.cc:407] Connection header received
0809 09:27:04.635916 (+ 1168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:04.635939 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:04.636276 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:04.636612 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:04.637555 (+ 943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:04.637561 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:04.637577 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:27:04.637587 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:04.637642 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:27:04.637666 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:04.637821 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:04.637889 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 09:27:04.638037 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":110,"threads_started":1}
I20260809 09:27:04.639730 2222 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c52816d5102d4b3bae715877d6b4d67d: Bootstrap starting.
I20260809 09:27:04.641510 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 09:27:04.641927 2222 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c52816d5102d4b3bae715877d6b4d67d: Neither blocks nor log segments found. Creating new log.
I20260809 09:27:04.642865 2222 log.cc:824] T 00000000000000000000000000000000 P c52816d5102d4b3bae715877d6b4d67d: Log is configured to *not* fsync() on all Append() calls
I20260809 09:27:04.645149 2222 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c52816d5102d4b3bae715877d6b4d67d: No bootstrap required, opened a new log
I20260809 09:27:04.645473 2225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:04.643908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.175:41065 (local address 127.0.0.1:43237)
0809 09:27:04.644023 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:04.644027 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:04.644170 (+ 143us) server_negotiation.cc:407] Connection header received
0809 09:27:04.644278 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:04.644281 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:04.644318 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:04.644408 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:04.645060 (+ 652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:04.645063 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:04.645065 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:27:04.645077 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:04.645103 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:27:04.645115 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:04.645212 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:04.645322 (+ 110us) server_negotiation.cc:299] Negotiation successful
0809 09:27:04.645361 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 09:27:04.648921 2222 raft_consensus.cc:348] T 00000000000000000000000000000000 P c52816d5102d4b3bae715877d6b4d67d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c52816d5102d4b3bae715877d6b4d67d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43237 } }
I20260809 09:27:04.649122 2222 raft_consensus.cc:374] T 00000000000000000000000000000000 P c52816d5102d4b3bae715877d6b4d67d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:27:04.649200 2222 raft_consensus.cc:729] T 00000000000000000000000000000000 P c52816d5102d4b3bae715877d6b4d67d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c52816d5102d4b3bae715877d6b4d67d, State: Initialized, Role: FOLLOWER
I20260809 09:27:04.649659 2222 consensus_queue.cc:260] T 00000000000000000000000000000000 P c52816d5102d4b3bae715877d6b4d67d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c52816d5102d4b3bae715877d6b4d67d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43237 } }
I20260809 09:27:04.649830 2222 raft_consensus.cc:388] T 00000000000000000000000000000000 P c52816d5102d4b3bae715877d6b4d67d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:27:04.649911 2222 raft_consensus.cc:482] T 00000000000000000000000000000000 P c52816d5102d4b3bae715877d6b4d67d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:27:04.650014 2222 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c52816d5102d4b3bae715877d6b4d67d [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:27:04.650943 2222 raft_consensus.cc:504] T 00000000000000000000000000000000 P c52816d5102d4b3bae715877d6b4d67d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c52816d5102d4b3bae715877d6b4d67d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43237 } }
I20260809 09:27:04.651271 2222 leader_election.cc:302] T 00000000000000000000000000000000 P c52816d5102d4b3bae715877d6b4d67d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c52816d5102d4b3bae715877d6b4d67d; no voters:
I20260809 09:27:04.651573 2222 leader_election.cc:288] T 00000000000000000000000000000000 P c52816d5102d4b3bae715877d6b4d67d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:27:04.651649 2232 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c52816d5102d4b3bae715877d6b4d67d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:27:04.651895 2232 raft_consensus.cc:686] T 00000000000000000000000000000000 P c52816d5102d4b3bae715877d6b4d67d [term 1 LEADER]: Becoming Leader. State: Replica: c52816d5102d4b3bae715877d6b4d67d, State: Running, Role: LEADER
I20260809 09:27:04.652256 2232 consensus_queue.cc:237] T 00000000000000000000000000000000 P c52816d5102d4b3bae715877d6b4d67d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c52816d5102d4b3bae715877d6b4d67d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43237 } }
I20260809 09:27:04.652835 2222 sys_catalog.cc:564] T 00000000000000000000000000000000 P c52816d5102d4b3bae715877d6b4d67d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:27:04.653918 2234 sys_catalog.cc:455] T 00000000000000000000000000000000 P c52816d5102d4b3bae715877d6b4d67d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c52816d5102d4b3bae715877d6b4d67d. Latest consensus state: current_term: 1 leader_uuid: "c52816d5102d4b3bae715877d6b4d67d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c52816d5102d4b3bae715877d6b4d67d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43237 } } }
I20260809 09:27:04.654048 2234 sys_catalog.cc:458] T 00000000000000000000000000000000 P c52816d5102d4b3bae715877d6b4d67d [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:04.654435 2241 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:27:04.657466 2241 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:27:04.654446 2233 sys_catalog.cc:455] T 00000000000000000000000000000000 P c52816d5102d4b3bae715877d6b4d67d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c52816d5102d4b3bae715877d6b4d67d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c52816d5102d4b3bae715877d6b4d67d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43237 } } }
I20260809 09:27:04.658149 2233 sys_catalog.cc:458] T 00000000000000000000000000000000 P c52816d5102d4b3bae715877d6b4d67d [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:04.664081 2241 catalog_manager.cc:1347] Generated new cluster ID: 3fac80633baf4be4a76dddb0c6d8febb
I20260809 09:27:04.664150 2241 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:27:04.681459 2241 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:27:04.681774 2241 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:27:04.692284 2241 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c52816d5102d4b3bae715877d6b4d67d: Generated new TSK 0
I20260809 09:27:04.693049 2241 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:27:04.701236 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 2147
2026-08-09T09:27:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1382 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:27:04 dist-test-slave-pgkr krb5kdc[2254](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:27:04 dist-test-slave-pgkr krb5kdc[2254](info): set up 2 sockets
Aug 09 09:27:04 dist-test-slave-pgkr krb5kdc[2254](info): commencing operation
krb5kdc: starting...
W20260809 09:27:05.737515 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.013s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:27:05 dist-test-slave-pgkr krb5kdc[2254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:27:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:27:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 09:27:05.855059 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37567
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37567
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:27:05.961308 2267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:27:05.961572 2267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:27:05.961648 2267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:27:05.965483 2267 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:27:05.965569 2267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:27:05.965605 2267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:27:05.965659 2267 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:27:05.965695 2267 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:27:05.970572 2267 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37567
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37567
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:27:05.971506 2267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:27:05.972426 2267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:27:05.980274 2273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:05.980269 2272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:05.980511 2267 server_base.cc:1034] running on GCE node
W20260809 09:27:05.980278 2276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:05.981125 2267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:27:05.982030 2267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:27:05.983204 2267 hybrid_clock.cc:648] HybridClock initialized: now 1786267625983181 us; error 35 us; skew 500 ppm
Aug 09 09:27:05 dist-test-slave-pgkr krb5kdc[2254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267625, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:27:05.985765 2267 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 09:27:05.986526 2267 webserver.cc:460] Webserver started at http://127.0.0.1:41255/ using document root <none> and password file <none>
I20260809 09:27:05.987051 2267 fs_manager.cc:359] Metadata directory not provided
I20260809 09:27:05.987140 2267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:27:05.987357 2267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:27:05.989274 2267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "1f41b28248fc4454b37b1640e3216e08"
format_stamp: "Formatted at 2026-08-09 09:27:05 on dist-test-slave-pgkr"
server_key: "d8b20f45af9b27cca7018b1ba1d1a667"
server_key_iv: "445d074ba56038f4b6e2c1f6eb323023"
server_key_version: "encryptionkey@0"
I20260809 09:27:05.989902 2267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "1f41b28248fc4454b37b1640e3216e08"
format_stamp: "Formatted at 2026-08-09 09:27:05 on dist-test-slave-pgkr"
server_key: "d8b20f45af9b27cca7018b1ba1d1a667"
server_key_iv: "445d074ba56038f4b6e2c1f6eb323023"
server_key_version: "encryptionkey@0"
I20260809 09:27:05.993389 2267 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 09:27:05.996250 2283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:27:05.997430 2267 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 09:27:05.997591 2267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "1f41b28248fc4454b37b1640e3216e08"
format_stamp: "Formatted at 2026-08-09 09:27:05 on dist-test-slave-pgkr"
server_key: "d8b20f45af9b27cca7018b1ba1d1a667"
server_key_iv: "445d074ba56038f4b6e2c1f6eb323023"
server_key_version: "encryptionkey@0"
I20260809 09:27:05.997704 2267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:27:06.016638 2267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:27:06.019265 2267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:27:06.019479 2267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:27:06.026221 2267 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37567
I20260809 09:27:06.026296 2338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37567 every 8 connection(s)
I20260809 09:27:06.027163 2267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:27:06.029824 2340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:27:06.030253 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 2267
I20260809 09:27:06.030397 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:27:06.030743 11663 external_mini_cluster.cc:1428] Setting key f298256f85b10de68d2ba1318bfb8c4d
I20260809 09:27:06.036973 2340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f41b28248fc4454b37b1640e3216e08: Bootstrap starting.
I20260809 09:27:06.039237 2340 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f41b28248fc4454b37b1640e3216e08: Neither blocks nor log segments found. Creating new log.
Aug 09 09:27:06 dist-test-slave-pgkr krb5kdc[2254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 09:27:06.039945 2340 log.cc:824] T 00000000000000000000000000000000 P 1f41b28248fc4454b37b1640e3216e08: Log is configured to *not* fsync() on all Append() calls
I20260809 09:27:06.042135 2340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f41b28248fc4454b37b1640e3216e08: No bootstrap required, opened a new log
I20260809 09:27:06.045781 2343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:06.032067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.175:59169 (local address 127.0.0.1:37567)
0809 09:27:06.032529 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:06.032547 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:06.032588 (+ 41us) server_negotiation.cc:407] Connection header received
0809 09:27:06.033331 (+ 743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:06.033354 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:06.033764 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:06.034123 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:06.034967 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:06.036394 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:06.037223 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:06.037821 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:06.037975 (+ 154us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:06.040623 (+ 2648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:06.040628 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:06.040638 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:06.040661 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:06.042694 (+ 2033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:06.043208 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:06.043214 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:06.043219 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:06.043359 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:06.043666 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:06.043669 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:06.043670 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:06.044189 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:06.044440 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:06.044711 (+ 271us) server_negotiation.cc:299] Negotiation successful
0809 09:27:06.044910 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":165,"threads_started":1}
I20260809 09:27:06.046475 2340 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f41b28248fc4454b37b1640e3216e08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f41b28248fc4454b37b1640e3216e08" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37567 } }
I20260809 09:27:06.046774 2340 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f41b28248fc4454b37b1640e3216e08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:27:06.046880 2340 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f41b28248fc4454b37b1640e3216e08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f41b28248fc4454b37b1640e3216e08, State: Initialized, Role: FOLLOWER
I20260809 09:27:06.047326 2340 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f41b28248fc4454b37b1640e3216e08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f41b28248fc4454b37b1640e3216e08" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37567 } }
I20260809 09:27:06.047477 2340 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f41b28248fc4454b37b1640e3216e08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:27:06.047545 2340 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f41b28248fc4454b37b1640e3216e08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:27:06.047657 2340 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f41b28248fc4454b37b1640e3216e08 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:27:06.048652 2340 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f41b28248fc4454b37b1640e3216e08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f41b28248fc4454b37b1640e3216e08" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37567 } }
I20260809 09:27:06.048789 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 09:27:06.049000 2340 leader_election.cc:302] T 00000000000000000000000000000000 P 1f41b28248fc4454b37b1640e3216e08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f41b28248fc4454b37b1640e3216e08; no voters:
I20260809 09:27:06.049360 2340 leader_election.cc:288] T 00000000000000000000000000000000 P 1f41b28248fc4454b37b1640e3216e08 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:27:06.049484 2345 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f41b28248fc4454b37b1640e3216e08 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:27:06.049759 2345 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f41b28248fc4454b37b1640e3216e08 [term 1 LEADER]: Becoming Leader. State: Replica: 1f41b28248fc4454b37b1640e3216e08, State: Running, Role: LEADER
I20260809 09:27:06.050129 2345 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f41b28248fc4454b37b1640e3216e08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f41b28248fc4454b37b1640e3216e08" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37567 } }
I20260809 09:27:06.050590 2340 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f41b28248fc4454b37b1640e3216e08 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:27:06.051620 2346 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f41b28248fc4454b37b1640e3216e08 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f41b28248fc4454b37b1640e3216e08. Latest consensus state: current_term: 1 leader_uuid: "1f41b28248fc4454b37b1640e3216e08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f41b28248fc4454b37b1640e3216e08" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37567 } } }
I20260809 09:27:06.051767 2346 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f41b28248fc4454b37b1640e3216e08 [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:06.052532 2347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f41b28248fc4454b37b1640e3216e08 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f41b28248fc4454b37b1640e3216e08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f41b28248fc4454b37b1640e3216e08" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37567 } } }
I20260809 09:27:06.052640 2347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f41b28248fc4454b37b1640e3216e08 [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:06.053314 2359 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:27:06.056372 2359 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:27:06.059943 2343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:06.050966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.175:46333 (local address 127.0.0.1:37567)
0809 09:27:06.051076 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:06.051082 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:06.051400 (+ 318us) server_negotiation.cc:407] Connection header received
0809 09:27:06.051637 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:06.051641 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:06.051689 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:06.051755 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:06.052785 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:06.053559 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:06.054676 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:06.054924 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:06.055051 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:06.056478 (+ 1427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:06.056483 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:06.056485 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:06.056511 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:06.057953 (+ 1442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:06.058484 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:06.058488 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:06.058490 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:06.058575 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:06.058991 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:06.058994 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:06.058996 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:06.059186 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:06.059344 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:06.059649 (+ 305us) server_negotiation.cc:299] Negotiation successful
0809 09:27:06.059746 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 09:27:06.062000 2359 catalog_manager.cc:1347] Generated new cluster ID: c42b1ea4fc9b43f7bff49613bcc5636a
I20260809 09:27:06.062068 2359 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:27:06.072011 2359 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:27:06.072836 2359 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:27:06.080197 2359 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f41b28248fc4454b37b1640e3216e08: Generated new TSK 0
I20260809 09:27:06.080890 2359 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:27:06.086357 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 2267
W20260809 09:27:06.094061 2252 connection.cc:535] client connection to 127.0.0.1:37567 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37567): Connection reset by peer (error 104)
2026-08-09T09:27:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1384 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:27:06 dist-test-slave-pgkr krb5kdc[2372](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:27:06 dist-test-slave-pgkr krb5kdc[2372](info): set up 2 sockets
Aug 09 09:27:06 dist-test-slave-pgkr krb5kdc[2372](info): commencing operation
krb5kdc: starting...
W20260809 09:27:07.151491 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.043s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:27:07 dist-test-slave-pgkr krb5kdc[2372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267627, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:27:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:27:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 09:27:07.269773 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44529
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44529
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:27:07.372421 2386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:27:07.372668 2386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:27:07.372709 2386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:27:07.376437 2386 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:27:07.376489 2386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:27:07.376508 2386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:27:07.376524 2386 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:27:07.376539 2386 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:27:07.381353 2386 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44529
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44529
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2386
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:27:07.382216 2386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:27:07.383114 2386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 09:27:07.390815 2386 server_base.cc:1034] running on GCE node
W20260809 09:27:07.390841 2394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:07.390866 2392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:07.390832 2391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:07.391585 2386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:27:07.392558 2386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:27:07.393719 2386 hybrid_clock.cc:648] HybridClock initialized: now 1786267627393703 us; error 29 us; skew 500 ppm
Aug 09 09:27:07 dist-test-slave-pgkr krb5kdc[2372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267627, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:27:07.396343 2386 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 09:27:07.397078 2386 webserver.cc:460] Webserver started at http://127.0.0.1:34371/ using document root <none> and password file <none>
I20260809 09:27:07.397547 2386 fs_manager.cc:359] Metadata directory not provided
I20260809 09:27:07.397603 2386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:27:07.397760 2386 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:27:07.399660 2386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "0bf6fa059a144c3bb170926d033cfb01"
format_stamp: "Formatted at 2026-08-09 09:27:07 on dist-test-slave-pgkr"
server_key: "d3e703e3b44175b85eaf4d63c7bb55c2"
server_key_iv: "d5b24e3d0357efd985f0efb23645612b"
server_key_version: "encryptionkey@0"
I20260809 09:27:07.400203 2386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "0bf6fa059a144c3bb170926d033cfb01"
format_stamp: "Formatted at 2026-08-09 09:27:07 on dist-test-slave-pgkr"
server_key: "d3e703e3b44175b85eaf4d63c7bb55c2"
server_key_iv: "d5b24e3d0357efd985f0efb23645612b"
server_key_version: "encryptionkey@0"
I20260809 09:27:07.403692 2386 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 09:27:07.405778 2401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:27:07.406903 2386 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:27:07.407024 2386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "0bf6fa059a144c3bb170926d033cfb01"
format_stamp: "Formatted at 2026-08-09 09:27:07 on dist-test-slave-pgkr"
server_key: "d3e703e3b44175b85eaf4d63c7bb55c2"
server_key_iv: "d5b24e3d0357efd985f0efb23645612b"
server_key_version: "encryptionkey@0"
I20260809 09:27:07.407119 2386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:27:07.426247 2386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:27:07.429169 2386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:27:07.429406 2386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:27:07.436692 2386 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44529
I20260809 09:27:07.436719 2459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44529 every 8 connection(s)
I20260809 09:27:07.437570 2386 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:27:07.440343 2460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:27:07.445382 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 2386
I20260809 09:27:07.445495 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:27:07.445783 11663 external_mini_cluster.cc:1428] Setting key f9cd29c99e6b5f9274856749ed917fe8
I20260809 09:27:07.445873 2460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0bf6fa059a144c3bb170926d033cfb01: Bootstrap starting.
I20260809 09:27:07.448604 2460 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0bf6fa059a144c3bb170926d033cfb01: Neither blocks nor log segments found. Creating new log.
I20260809 09:27:07.449494 2460 log.cc:824] T 00000000000000000000000000000000 P 0bf6fa059a144c3bb170926d033cfb01: Log is configured to *not* fsync() on all Append() calls
I20260809 09:27:07.451571 2460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0bf6fa059a144c3bb170926d033cfb01: No bootstrap required, opened a new log
I20260809 09:27:07.455883 2463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:07.447182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.175:35155 (local address 127.0.0.1:44529)
0809 09:27:07.447626 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:07.447646 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:07.447688 (+ 42us) server_negotiation.cc:407] Connection header received
0809 09:27:07.448550 (+ 862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:07.448575 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:07.449001 (+ 426us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:07.449346 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:07.449785 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:07.451138 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:07.452047 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:07.452772 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:07.452961 (+ 189us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:07.453765 (+ 804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:07.453772 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:07.453786 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:27:07.454290 (+ 504us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:07.454380 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:27:07.454419 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:07.454644 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:07.454835 (+ 191us) server_negotiation.cc:299] Negotiation successful
0809 09:27:07.454967 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":99,"threads_started":1}
I20260809 09:27:07.456090 2460 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0bf6fa059a144c3bb170926d033cfb01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bf6fa059a144c3bb170926d033cfb01" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44529 } }
I20260809 09:27:07.456348 2460 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0bf6fa059a144c3bb170926d033cfb01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:27:07.456434 2460 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0bf6fa059a144c3bb170926d033cfb01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bf6fa059a144c3bb170926d033cfb01, State: Initialized, Role: FOLLOWER
I20260809 09:27:07.456878 2460 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0bf6fa059a144c3bb170926d033cfb01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bf6fa059a144c3bb170926d033cfb01" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44529 } }
I20260809 09:27:07.457038 2460 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0bf6fa059a144c3bb170926d033cfb01 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:27:07.457126 2460 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0bf6fa059a144c3bb170926d033cfb01 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:27:07.457227 2460 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0bf6fa059a144c3bb170926d033cfb01 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:27:07.458246 2460 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0bf6fa059a144c3bb170926d033cfb01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bf6fa059a144c3bb170926d033cfb01" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44529 } }
I20260809 09:27:07.458563 2460 leader_election.cc:302] T 00000000000000000000000000000000 P 0bf6fa059a144c3bb170926d033cfb01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0bf6fa059a144c3bb170926d033cfb01; no voters:
I20260809 09:27:07.458755 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 09:27:07.458904 2460 leader_election.cc:288] T 00000000000000000000000000000000 P 0bf6fa059a144c3bb170926d033cfb01 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:27:07.458986 2465 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0bf6fa059a144c3bb170926d033cfb01 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:27:07.459220 2465 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0bf6fa059a144c3bb170926d033cfb01 [term 1 LEADER]: Becoming Leader. State: Replica: 0bf6fa059a144c3bb170926d033cfb01, State: Running, Role: LEADER
I20260809 09:27:07.459581 2465 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0bf6fa059a144c3bb170926d033cfb01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bf6fa059a144c3bb170926d033cfb01" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44529 } }
I20260809 09:27:07.460160 2460 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0bf6fa059a144c3bb170926d033cfb01 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:27:07.460734 2465 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bf6fa059a144c3bb170926d033cfb01 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0bf6fa059a144c3bb170926d033cfb01. Latest consensus state: current_term: 1 leader_uuid: "0bf6fa059a144c3bb170926d033cfb01" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bf6fa059a144c3bb170926d033cfb01" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44529 } } }
I20260809 09:27:07.460918 2465 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bf6fa059a144c3bb170926d033cfb01 [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:07.461163 2466 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bf6fa059a144c3bb170926d033cfb01 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0bf6fa059a144c3bb170926d033cfb01" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bf6fa059a144c3bb170926d033cfb01" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44529 } } }
I20260809 09:27:07.461268 2466 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bf6fa059a144c3bb170926d033cfb01 [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:07.461319 2475 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:27:07.464272 2475 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:27:07.466774 2463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:07.461959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.175:42813 (local address 127.0.0.1:44529)
0809 09:27:07.462048 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:07.462052 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:07.462064 (+ 12us) server_negotiation.cc:407] Connection header received
0809 09:27:07.462094 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:07.462097 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:07.462132 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:07.462211 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:07.462586 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:07.463335 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:07.464780 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:07.465110 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:07.465217 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:07.466242 (+ 1025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:07.466245 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:07.466248 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:27:07.466260 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:07.466286 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:27:07.466299 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:07.466392 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:07.466596 (+ 204us) server_negotiation.cc:299] Negotiation successful
0809 09:27:07.466651 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 09:27:07.469763 2475 catalog_manager.cc:1347] Generated new cluster ID: c3fa2b49d81842249067ff2f1bf59a65
I20260809 09:27:07.469820 2475 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:27:07.487017 2475 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:27:07.487859 2475 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:27:07.497108 2475 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0bf6fa059a144c3bb170926d033cfb01: Generated new TSK 0
I20260809 09:27:07.497666 2475 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:27:07.503468 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 2386
W20260809 09:27:07.510313 2370 connection.cc:535] client connection to 127.0.0.1:44529 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44529): Connection reset by peer (error 104)
2026-08-09T09:27:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1416 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:27:07 dist-test-slave-pgkr krb5kdc[2491](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:27:07 dist-test-slave-pgkr krb5kdc[2491](info): set up 2 sockets
Aug 09 09:27:07 dist-test-slave-pgkr krb5kdc[2491](info): commencing operation
krb5kdc: starting...
W20260809 09:27:08.534922 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.010s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:27:08 dist-test-slave-pgkr krb5kdc[2491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:27:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:27:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 09:27:08.648344 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34677
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34677
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:27:08.755573 2505 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:27:08.755818 2505 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:27:08.755915 2505 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:27:08.759773 2505 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:27:08.759825 2505 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:27:08.759846 2505 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:27:08.759905 2505 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:27:08.759963 2505 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:27:08.764950 2505 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34677
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2505
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:27:08.765906 2505 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:27:08.766904 2505 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:27:08.775249 2511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:08.775354 2505 server_base.cc:1034] running on GCE node
W20260809 09:27:08.775300 2514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:08.775250 2512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:08.776129 2505 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:27:08.777077 2505 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:27:08.778236 2505 hybrid_clock.cc:648] HybridClock initialized: now 1786267628778207 us; error 44 us; skew 500 ppm
Aug 09 09:27:08 dist-test-slave-pgkr krb5kdc[2491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267628, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:27:08.784039 2505 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 09:27:08.784904 2505 webserver.cc:460] Webserver started at http://127.0.0.1:39021/ using document root <none> and password file <none>
I20260809 09:27:08.785472 2505 fs_manager.cc:359] Metadata directory not provided
I20260809 09:27:08.785544 2505 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:27:08.785787 2505 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:27:08.787763 2505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "2dd986186cd44dac8d84080f2d5f5cbe"
format_stamp: "Formatted at 2026-08-09 09:27:08 on dist-test-slave-pgkr"
server_key: "03e275d3a90f3cd8311d908297080b7f"
server_key_iv: "d5eaca2332a84e8b6b060ca3ef35efe9"
server_key_version: "encryptionkey@0"
I20260809 09:27:08.788313 2505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "2dd986186cd44dac8d84080f2d5f5cbe"
format_stamp: "Formatted at 2026-08-09 09:27:08 on dist-test-slave-pgkr"
server_key: "03e275d3a90f3cd8311d908297080b7f"
server_key_iv: "d5eaca2332a84e8b6b060ca3ef35efe9"
server_key_version: "encryptionkey@0"
I20260809 09:27:08.791895 2505 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 09:27:08.794176 2523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:27:08.795373 2505 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 09:27:08.795526 2505 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "2dd986186cd44dac8d84080f2d5f5cbe"
format_stamp: "Formatted at 2026-08-09 09:27:08 on dist-test-slave-pgkr"
server_key: "03e275d3a90f3cd8311d908297080b7f"
server_key_iv: "d5eaca2332a84e8b6b060ca3ef35efe9"
server_key_version: "encryptionkey@0"
I20260809 09:27:08.795632 2505 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:27:08.799963 2505 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:27:08.802737 2505 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:27:08.802932 2505 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:27:08.809716 2505 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34677
I20260809 09:27:08.809755 2578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34677 every 8 connection(s)
I20260809 09:27:08.810644 2505 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:27:08.813427 2579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:27:08.813467 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 2505
I20260809 09:27:08.813616 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:27:08.813933 11663 external_mini_cluster.cc:1428] Setting key 29c85ff9832516f21b37baa8bd222155
I20260809 09:27:08.819168 2582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:08.815443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.175:45475 (local address 127.0.0.1:34677)
0809 09:27:08.815883 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:08.815898 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:08.815930 (+ 32us) server_negotiation.cc:407] Connection header received
0809 09:27:08.816542 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:08.816557 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:08.816843 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:08.817159 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:08.817981 (+ 822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:08.817985 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:08.817996 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:27:08.818006 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:08.818056 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:27:08.818074 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:08.818216 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:08.818291 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 09:27:08.818443 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":136,"threads_started":1}
I20260809 09:27:08.820981 2579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dd986186cd44dac8d84080f2d5f5cbe: Bootstrap starting.
I20260809 09:27:08.821934 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 09:27:08.823526 2579 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2dd986186cd44dac8d84080f2d5f5cbe: Neither blocks nor log segments found. Creating new log.
I20260809 09:27:08.824326 2579 log.cc:824] T 00000000000000000000000000000000 P 2dd986186cd44dac8d84080f2d5f5cbe: Log is configured to *not* fsync() on all Append() calls
I20260809 09:27:08.825825 2582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:08.824065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.175:45783 (local address 127.0.0.1:34677)
0809 09:27:08.824190 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:08.824196 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:08.824393 (+ 197us) server_negotiation.cc:407] Connection header received
0809 09:27:08.824538 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:08.824541 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:08.824575 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:08.824675 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:08.825405 (+ 730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:08.825408 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:08.825411 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:27:08.825431 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:08.825457 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:27:08.825469 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:08.825571 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:08.825652 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 09:27:08.825694 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 09:27:08.826316 2579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dd986186cd44dac8d84080f2d5f5cbe: No bootstrap required, opened a new log
I20260809 09:27:08.829942 2579 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2dd986186cd44dac8d84080f2d5f5cbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dd986186cd44dac8d84080f2d5f5cbe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34677 } }
I20260809 09:27:08.830147 2579 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2dd986186cd44dac8d84080f2d5f5cbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:27:08.830211 2579 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2dd986186cd44dac8d84080f2d5f5cbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dd986186cd44dac8d84080f2d5f5cbe, State: Initialized, Role: FOLLOWER
I20260809 09:27:08.830647 2579 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2dd986186cd44dac8d84080f2d5f5cbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dd986186cd44dac8d84080f2d5f5cbe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34677 } }
I20260809 09:27:08.830812 2579 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2dd986186cd44dac8d84080f2d5f5cbe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:27:08.830893 2579 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2dd986186cd44dac8d84080f2d5f5cbe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:27:08.830998 2579 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2dd986186cd44dac8d84080f2d5f5cbe [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:27:08.831802 2579 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2dd986186cd44dac8d84080f2d5f5cbe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dd986186cd44dac8d84080f2d5f5cbe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34677 } }
I20260809 09:27:08.832114 2579 leader_election.cc:302] T 00000000000000000000000000000000 P 2dd986186cd44dac8d84080f2d5f5cbe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2dd986186cd44dac8d84080f2d5f5cbe; no voters:
I20260809 09:27:08.832432 2579 leader_election.cc:288] T 00000000000000000000000000000000 P 2dd986186cd44dac8d84080f2d5f5cbe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:27:08.832556 2589 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2dd986186cd44dac8d84080f2d5f5cbe [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:27:08.832803 2589 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2dd986186cd44dac8d84080f2d5f5cbe [term 1 LEADER]: Becoming Leader. State: Replica: 2dd986186cd44dac8d84080f2d5f5cbe, State: Running, Role: LEADER
I20260809 09:27:08.833128 2589 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2dd986186cd44dac8d84080f2d5f5cbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dd986186cd44dac8d84080f2d5f5cbe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34677 } }
I20260809 09:27:08.833659 2579 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2dd986186cd44dac8d84080f2d5f5cbe [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:27:08.834821 2591 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dd986186cd44dac8d84080f2d5f5cbe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2dd986186cd44dac8d84080f2d5f5cbe. Latest consensus state: current_term: 1 leader_uuid: "2dd986186cd44dac8d84080f2d5f5cbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dd986186cd44dac8d84080f2d5f5cbe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34677 } } }
I20260809 09:27:08.834946 2591 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dd986186cd44dac8d84080f2d5f5cbe [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:08.834949 2590 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dd986186cd44dac8d84080f2d5f5cbe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2dd986186cd44dac8d84080f2d5f5cbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dd986186cd44dac8d84080f2d5f5cbe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34677 } } }
I20260809 09:27:08.835095 2590 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dd986186cd44dac8d84080f2d5f5cbe [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:08.835336 2595 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:27:08.838097 2595 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:27:08.842926 2595 catalog_manager.cc:1347] Generated new cluster ID: 96afca82203144bbb8841f234c230648
I20260809 09:27:08.842994 2595 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:27:08.872361 2595 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:27:08.872694 2595 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:27:08.886276 2595 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2dd986186cd44dac8d84080f2d5f5cbe: Generated new TSK 0
I20260809 09:27:08.886893 2595 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:27:08.894070 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 2505
2026-08-09T09:27:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1390 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:27:08 dist-test-slave-pgkr krb5kdc[2611](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:27:08 dist-test-slave-pgkr krb5kdc[2611](info): set up 2 sockets
Aug 09 09:27:08 dist-test-slave-pgkr krb5kdc[2611](info): commencing operation
krb5kdc: starting...
W20260809 09:27:09.924634 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.009s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:27:10 dist-test-slave-pgkr krb5kdc[2611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267630, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:27:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:27:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:27:10.041422 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:36843
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:41601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:36843
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:27:10.145051 2626 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:27:10.145315 2626 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:27:10.145387 2626 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:27:10.148965 2626 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:27:10.149044 2626 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:27:10.149084 2626 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:27:10.149152 2626 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:27:10.149185 2626 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:27:10.153983 2626 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:41601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:36843
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:36843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2626
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:27:10.154881 2626 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:27:10.155779 2626 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 09:27:10.163973 2626 server_base.cc:1034] running on GCE node
W20260809 09:27:10.163957 2631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:10.163937 2632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:10.163940 2634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:10.164860 2626 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:27:10.165915 2626 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:27:10.167097 2626 hybrid_clock.cc:648] HybridClock initialized: now 1786267630167075 us; error 43 us; skew 500 ppm
Aug 09 09:27:10 dist-test-slave-pgkr krb5kdc[2611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267630, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:27:10.169581 2626 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:27:10.170399 2626 webserver.cc:460] Webserver started at http://127.11.99.254:36147/ using document root <none> and password file <none>
I20260809 09:27:10.170975 2626 fs_manager.cc:359] Metadata directory not provided
I20260809 09:27:10.171067 2626 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:27:10.171319 2626 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:27:10.173301 2626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "97e6f8576a714deea391b8cdfabb447d"
format_stamp: "Formatted at 2026-08-09 09:27:10 on dist-test-slave-pgkr"
server_key: "2c510e911fc75df3d3af36552ca39eeb"
server_key_iv: "f218c7ef5f449d1b53d053babdcec46a"
server_key_version: "encryptionkey@0"
I20260809 09:27:10.173869 2626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "97e6f8576a714deea391b8cdfabb447d"
format_stamp: "Formatted at 2026-08-09 09:27:10 on dist-test-slave-pgkr"
server_key: "2c510e911fc75df3d3af36552ca39eeb"
server_key_iv: "f218c7ef5f449d1b53d053babdcec46a"
server_key_version: "encryptionkey@0"
I20260809 09:27:10.177316 2626 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 09:27:10.179539 2643 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:27:10.180655 2626 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:27:10.180791 2626 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "97e6f8576a714deea391b8cdfabb447d"
format_stamp: "Formatted at 2026-08-09 09:27:10 on dist-test-slave-pgkr"
server_key: "2c510e911fc75df3d3af36552ca39eeb"
server_key_iv: "f218c7ef5f449d1b53d053babdcec46a"
server_key_version: "encryptionkey@0"
I20260809 09:27:10.180898 2626 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:27:10.190728 2626 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:27:10.193202 2626 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:27:10.193395 2626 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:27:10.200067 2626 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:36843
I20260809 09:27:10.200094 2697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:36843 every 8 connection(s)
I20260809 09:27:10.200929 2626 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:27:10.203557 2698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:27:10.206777 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 2626
I20260809 09:27:10.206920 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:27:10.207194 11663 external_mini_cluster.cc:1428] Setting key 067b24bb35ed77d9f9851c7f0689b4c1
I20260809 09:27:10.208986 2698 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97e6f8576a714deea391b8cdfabb447d: Bootstrap starting.
I20260809 09:27:10.211057 2698 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 97e6f8576a714deea391b8cdfabb447d: Neither blocks nor log segments found. Creating new log.
I20260809 09:27:10.211742 2698 log.cc:824] T 00000000000000000000000000000000 P 97e6f8576a714deea391b8cdfabb447d: Log is configured to *not* fsync() on all Append() calls
I20260809 09:27:10.213407 2698 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97e6f8576a714deea391b8cdfabb447d: No bootstrap required, opened a new log
Aug 09 09:27:10 dist-test-slave-pgkr krb5kdc[2611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267630, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:27:10.216825 2698 raft_consensus.cc:348] T 00000000000000000000000000000000 P 97e6f8576a714deea391b8cdfabb447d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97e6f8576a714deea391b8cdfabb447d" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 36843 } }
I20260809 09:27:10.217058 2698 raft_consensus.cc:374] T 00000000000000000000000000000000 P 97e6f8576a714deea391b8cdfabb447d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:27:10.217134 2698 raft_consensus.cc:729] T 00000000000000000000000000000000 P 97e6f8576a714deea391b8cdfabb447d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e6f8576a714deea391b8cdfabb447d, State: Initialized, Role: FOLLOWER
I20260809 09:27:10.217514 2698 consensus_queue.cc:260] T 00000000000000000000000000000000 P 97e6f8576a714deea391b8cdfabb447d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97e6f8576a714deea391b8cdfabb447d" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 36843 } }
I20260809 09:27:10.217649 2698 raft_consensus.cc:388] T 00000000000000000000000000000000 P 97e6f8576a714deea391b8cdfabb447d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:27:10.217725 2698 raft_consensus.cc:482] T 00000000000000000000000000000000 P 97e6f8576a714deea391b8cdfabb447d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:27:10.217811 2698 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 97e6f8576a714deea391b8cdfabb447d [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:27:10.218567 2698 raft_consensus.cc:504] T 00000000000000000000000000000000 P 97e6f8576a714deea391b8cdfabb447d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97e6f8576a714deea391b8cdfabb447d" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 36843 } }
I20260809 09:27:10.218917 2698 leader_election.cc:302] T 00000000000000000000000000000000 P 97e6f8576a714deea391b8cdfabb447d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 97e6f8576a714deea391b8cdfabb447d; no voters:
I20260809 09:27:10.219169 2698 leader_election.cc:288] T 00000000000000000000000000000000 P 97e6f8576a714deea391b8cdfabb447d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:27:10.219290 2704 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 97e6f8576a714deea391b8cdfabb447d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:27:10.219517 2704 raft_consensus.cc:686] T 00000000000000000000000000000000 P 97e6f8576a714deea391b8cdfabb447d [term 1 LEADER]: Becoming Leader. State: Replica: 97e6f8576a714deea391b8cdfabb447d, State: Running, Role: LEADER
I20260809 09:27:10.219851 2704 consensus_queue.cc:237] T 00000000000000000000000000000000 P 97e6f8576a714deea391b8cdfabb447d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97e6f8576a714deea391b8cdfabb447d" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 36843 } }
I20260809 09:27:10.220360 2698 sys_catalog.cc:564] T 00000000000000000000000000000000 P 97e6f8576a714deea391b8cdfabb447d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:27:10.221007 2702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:10.208481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37453 (local address 127.11.99.254:36843)
0809 09:27:10.208881 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:10.208894 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:10.208926 (+ 32us) server_negotiation.cc:407] Connection header received
0809 09:27:10.209554 (+ 628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:10.209570 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:10.209877 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:10.210185 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:10.211029 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:10.212055 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:10.212903 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:10.213345 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:10.213508 (+ 163us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:10.215966 (+ 2458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:10.215971 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:10.215981 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:10.216005 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:10.217675 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:10.218196 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:10.218202 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:10.218207 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:10.218317 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:10.218685 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:10.218688 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:10.218690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:10.219101 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:10.219314 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:10.219888 (+ 574us) server_negotiation.cc:299] Negotiation successful
0809 09:27:10.220092 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":123,"threads_started":1}
I20260809 09:27:10.221244 2705 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97e6f8576a714deea391b8cdfabb447d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "97e6f8576a714deea391b8cdfabb447d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97e6f8576a714deea391b8cdfabb447d" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 36843 } } }
I20260809 09:27:10.221377 2705 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97e6f8576a714deea391b8cdfabb447d [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:10.221673 2706 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97e6f8576a714deea391b8cdfabb447d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 97e6f8576a714deea391b8cdfabb447d. Latest consensus state: current_term: 1 leader_uuid: "97e6f8576a714deea391b8cdfabb447d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97e6f8576a714deea391b8cdfabb447d" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 36843 } } }
I20260809 09:27:10.221728 2713 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:27:10.221912 2706 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97e6f8576a714deea391b8cdfabb447d [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:10.224215 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 09:27:10.225059 2713 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:27:10.230427 2713 catalog_manager.cc:1347] Generated new cluster ID: ea1fed10fc0c4fda83c851d4c257e96c
I20260809 09:27:10.230482 2713 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:27:10.234758 2702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:10.226178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34481 (local address 127.11.99.254:36843)
0809 09:27:10.226274 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:10.226277 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:10.226475 (+ 198us) server_negotiation.cc:407] Connection header received
0809 09:27:10.226604 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:10.226624 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:10.226669 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:10.226746 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:10.227441 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:10.228132 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:10.229375 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:10.229611 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:10.229710 (+ 99us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:10.231280 (+ 1570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:10.231284 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:10.231287 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:10.231311 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:10.232925 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:10.233410 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:10.233413 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:10.233415 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:10.233498 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:10.233825 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:10.233828 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:10.233830 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:10.234058 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:10.234203 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:10.234456 (+ 253us) server_negotiation.cc:299] Negotiation successful
0809 09:27:10.234548 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 09:27:10.240144 2713 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:27:10.240860 2713 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:27:10.247421 2713 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 97e6f8576a714deea391b8cdfabb447d: Generated new TSK 0
I20260809 09:27:10.247947 2713 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:27:10.252888 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 2626
W20260809 09:27:10.259910 2609 connection.cc:535] client connection to 127.11.99.254:36843 recv error: Network error: failed to read from TLS socket (remote: 127.11.99.254:36843): Connection reset by peer (error 104)
2026-08-09T09:27:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1358 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:27:10 dist-test-slave-pgkr krb5kdc[2732](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:27:10 dist-test-slave-pgkr krb5kdc[2732](info): set up 2 sockets
Aug 09 09:27:10 dist-test-slave-pgkr krb5kdc[2732](info): commencing operation
krb5kdc: starting...
W20260809 09:27:11.306316 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.032s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:27:11 dist-test-slave-pgkr krb5kdc[2732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267631, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:27:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:27:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:27:11.419652 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:34141
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:41105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:34141
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:27:11.526005 2748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:27:11.526309 2748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:27:11.526388 2748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:27:11.530079 2748 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:27:11.530161 2748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:27:11.530196 2748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:27:11.530261 2748 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:27:11.530298 2748 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:27:11.535260 2748 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:41105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:34141
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:34141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2748
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:27:11.536278 2748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:27:11.537285 2748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:27:11.545656 2753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:11.545656 2756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:11.545714 2754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:11.546084 2748 server_base.cc:1034] running on GCE node
I20260809 09:27:11.546583 2748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:27:11.547608 2748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:27:11.548768 2748 hybrid_clock.cc:648] HybridClock initialized: now 1786267631548751 us; error 29 us; skew 500 ppm
Aug 09 09:27:11 dist-test-slave-pgkr krb5kdc[2732](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267631, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:27:11.551397 2748 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:27:11.552191 2748 webserver.cc:460] Webserver started at http://127.11.99.254:41077/ using document root <none> and password file <none>
I20260809 09:27:11.552731 2748 fs_manager.cc:359] Metadata directory not provided
I20260809 09:27:11.552793 2748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:27:11.553040 2748 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:27:11.555038 2748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "5732528701ba4e96940aa7ed51cf6575"
format_stamp: "Formatted at 2026-08-09 09:27:11 on dist-test-slave-pgkr"
server_key: "9bf19180f1d858cc595bfefa7d50c2e0"
server_key_iv: "3d457133bc6d412dd9df4a3630f47f09"
server_key_version: "encryptionkey@0"
I20260809 09:27:11.555576 2748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "5732528701ba4e96940aa7ed51cf6575"
format_stamp: "Formatted at 2026-08-09 09:27:11 on dist-test-slave-pgkr"
server_key: "9bf19180f1d858cc595bfefa7d50c2e0"
server_key_iv: "3d457133bc6d412dd9df4a3630f47f09"
server_key_version: "encryptionkey@0"
I20260809 09:27:11.559113 2748 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 09:27:11.561367 2763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:27:11.562553 2748 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:27:11.562707 2748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "5732528701ba4e96940aa7ed51cf6575"
format_stamp: "Formatted at 2026-08-09 09:27:11 on dist-test-slave-pgkr"
server_key: "9bf19180f1d858cc595bfefa7d50c2e0"
server_key_iv: "3d457133bc6d412dd9df4a3630f47f09"
server_key_version: "encryptionkey@0"
I20260809 09:27:11.562844 2748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:27:11.580289 2748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:27:11.583092 2748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:27:11.583276 2748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:27:11.590214 2748 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:34141
I20260809 09:27:11.590246 2817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:34141 every 8 connection(s)
I20260809 09:27:11.591143 2748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:27:11.593755 2818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:27:11.595229 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 2748
I20260809 09:27:11.595376 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:27:11.595721 11663 external_mini_cluster.cc:1428] Setting key b1dbbbaadbf272e67371d4d0577ae8ca
I20260809 09:27:11.600494 2818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5732528701ba4e96940aa7ed51cf6575: Bootstrap starting.
I20260809 09:27:11.603415 2818 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5732528701ba4e96940aa7ed51cf6575: Neither blocks nor log segments found. Creating new log.
I20260809 09:27:11.604275 2818 log.cc:824] T 00000000000000000000000000000000 P 5732528701ba4e96940aa7ed51cf6575: Log is configured to *not* fsync() on all Append() calls
I20260809 09:27:11.605801 2821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:11.596978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32829 (local address 127.11.99.254:34141)
0809 09:27:11.597380 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:11.597400 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:11.597444 (+ 44us) server_negotiation.cc:407] Connection header received
0809 09:27:11.598276 (+ 832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:11.598298 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:11.598725 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:11.599070 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:11.599474 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:11.600852 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:11.602344 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:11.603058 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:11.603246 (+ 188us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:11.604053 (+ 807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:11.604062 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:11.604079 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:27:11.604579 (+ 500us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:11.604645 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:27:11.604685 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:11.604839 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:11.605035 (+ 196us) server_negotiation.cc:299] Negotiation successful
0809 09:27:11.605167 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":104,"threads_started":1}
I20260809 09:27:11.606182 2818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5732528701ba4e96940aa7ed51cf6575: No bootstrap required, opened a new log
I20260809 09:27:11.608603 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 09:27:11.610061 2818 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5732528701ba4e96940aa7ed51cf6575 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5732528701ba4e96940aa7ed51cf6575" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34141 } }
I20260809 09:27:11.610297 2818 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5732528701ba4e96940aa7ed51cf6575 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:27:11.610351 2818 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5732528701ba4e96940aa7ed51cf6575 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5732528701ba4e96940aa7ed51cf6575, State: Initialized, Role: FOLLOWER
I20260809 09:27:11.610821 2818 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5732528701ba4e96940aa7ed51cf6575 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5732528701ba4e96940aa7ed51cf6575" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34141 } }
I20260809 09:27:11.610999 2818 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5732528701ba4e96940aa7ed51cf6575 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:27:11.611060 2818 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5732528701ba4e96940aa7ed51cf6575 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:27:11.611150 2818 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5732528701ba4e96940aa7ed51cf6575 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:27:11.611888 2818 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5732528701ba4e96940aa7ed51cf6575 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5732528701ba4e96940aa7ed51cf6575" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34141 } }
I20260809 09:27:11.612195 2818 leader_election.cc:302] T 00000000000000000000000000000000 P 5732528701ba4e96940aa7ed51cf6575 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5732528701ba4e96940aa7ed51cf6575; no voters:
I20260809 09:27:11.612542 2818 leader_election.cc:288] T 00000000000000000000000000000000 P 5732528701ba4e96940aa7ed51cf6575 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:27:11.612646 2829 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5732528701ba4e96940aa7ed51cf6575 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:27:11.612870 2829 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5732528701ba4e96940aa7ed51cf6575 [term 1 LEADER]: Becoming Leader. State: Replica: 5732528701ba4e96940aa7ed51cf6575, State: Running, Role: LEADER
I20260809 09:27:11.613245 2829 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5732528701ba4e96940aa7ed51cf6575 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5732528701ba4e96940aa7ed51cf6575" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34141 } }
I20260809 09:27:11.613716 2818 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5732528701ba4e96940aa7ed51cf6575 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:27:11.615227 2830 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5732528701ba4e96940aa7ed51cf6575 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5732528701ba4e96940aa7ed51cf6575" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5732528701ba4e96940aa7ed51cf6575" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34141 } } }
I20260809 09:27:11.615365 2830 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5732528701ba4e96940aa7ed51cf6575 [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:11.615551 2821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:11.610713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38797 (local address 127.11.99.254:34141)
0809 09:27:11.610834 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:11.610836 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:11.611095 (+ 259us) server_negotiation.cc:407] Connection header received
0809 09:27:11.611210 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:11.611214 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:11.611258 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:11.611349 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:11.611605 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:11.612140 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:11.613305 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:11.613626 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:11.613754 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:11.614734 (+ 980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:11.614738 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:11.614741 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:27:11.614756 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:11.614787 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:27:11.614812 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:11.614920 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:11.615320 (+ 400us) server_negotiation.cc:299] Negotiation successful
0809 09:27:11.615356 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 09:27:11.615942 2831 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5732528701ba4e96940aa7ed51cf6575 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5732528701ba4e96940aa7ed51cf6575. Latest consensus state: current_term: 1 leader_uuid: "5732528701ba4e96940aa7ed51cf6575" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5732528701ba4e96940aa7ed51cf6575" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34141 } } }
I20260809 09:27:11.616326 2831 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5732528701ba4e96940aa7ed51cf6575 [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:11.616569 2843 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:27:11.619195 2843 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:27:11.624531 2843 catalog_manager.cc:1347] Generated new cluster ID: 146363ce27404b8194a424de27e6c888
I20260809 09:27:11.624598 2843 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:27:11.646762 2843 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:27:11.647609 2843 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:27:11.658361 2843 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5732528701ba4e96940aa7ed51cf6575: Generated new TSK 0
I20260809 09:27:11.659116 2843 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:27:11.670151 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 2748
W20260809 09:27:11.677939 2730 connection.cc:535] client connection to 127.11.99.254:34141 recv error: Network error: failed to read from TLS socket (remote: 127.11.99.254:34141): Connection reset by peer (error 104)
2026-08-09T09:27:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1417 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:27:11 dist-test-slave-pgkr krb5kdc[2853](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:27:11 dist-test-slave-pgkr krb5kdc[2853](info): set up 2 sockets
Aug 09 09:27:11 dist-test-slave-pgkr krb5kdc[2853](info): commencing operation
krb5kdc: starting...
W20260809 09:27:12.714972 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.023s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:27:12 dist-test-slave-pgkr krb5kdc[2853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267632, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:27:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:27:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:27:12.839071 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:41601
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:39497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:41601
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:27:12.945849 2868 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:27:12.946105 2868 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:27:12.946148 2868 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:27:12.949921 2868 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:27:12.949980 2868 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:27:12.950001 2868 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:27:12.950018 2868 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:27:12.950091 2868 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:27:12.955058 2868 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:39497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:41601
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:41601
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2868
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:27:12.956017 2868 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:27:12.957046 2868 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:27:12.965157 2873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:12.965166 2874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:12.965361 2868 server_base.cc:1034] running on GCE node
W20260809 09:27:12.965170 2877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:12.965981 2868 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:27:12.967118 2868 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:27:12.968283 2868 hybrid_clock.cc:648] HybridClock initialized: now 1786267632968265 us; error 30 us; skew 500 ppm
Aug 09 09:27:12 dist-test-slave-pgkr krb5kdc[2853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267632, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:27:12.971215 2868 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:27:12.971995 2868 webserver.cc:460] Webserver started at http://127.11.99.254:42687/ using document root <none> and password file <none>
I20260809 09:27:12.972550 2868 fs_manager.cc:359] Metadata directory not provided
I20260809 09:27:12.972627 2868 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:27:12.972865 2868 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:27:12.974788 2868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "1507eb32a8b44dc4993148ab67c7f703"
format_stamp: "Formatted at 2026-08-09 09:27:12 on dist-test-slave-pgkr"
server_key: "02e0e32e196f2f5f22d72d5d2ac6794f"
server_key_iv: "543216245d9bcce2193ae6786dbe2489"
server_key_version: "encryptionkey@0"
I20260809 09:27:12.975332 2868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "1507eb32a8b44dc4993148ab67c7f703"
format_stamp: "Formatted at 2026-08-09 09:27:12 on dist-test-slave-pgkr"
server_key: "02e0e32e196f2f5f22d72d5d2ac6794f"
server_key_iv: "543216245d9bcce2193ae6786dbe2489"
server_key_version: "encryptionkey@0"
I20260809 09:27:12.978586 2868 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 09:27:12.980736 2885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:27:12.981775 2868 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 09:27:12.981904 2868 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "1507eb32a8b44dc4993148ab67c7f703"
format_stamp: "Formatted at 2026-08-09 09:27:12 on dist-test-slave-pgkr"
server_key: "02e0e32e196f2f5f22d72d5d2ac6794f"
server_key_iv: "543216245d9bcce2193ae6786dbe2489"
server_key_version: "encryptionkey@0"
I20260809 09:27:12.982012 2868 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:27:12.986347 2868 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:27:12.989187 2868 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:27:12.989362 2868 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:27:12.995466 2868 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:41601
I20260809 09:27:12.995478 2938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:41601 every 8 connection(s)
I20260809 09:27:12.996258 2868 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:27:12.998792 2939 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:27:13.003918 2939 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1507eb32a8b44dc4993148ab67c7f703: Bootstrap starting.
I20260809 09:27:13.005262 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 2868
I20260809 09:27:13.005395 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:27:13.005707 11663 external_mini_cluster.cc:1428] Setting key 28cac9043345057508fd077700ec5365
I20260809 09:27:13.006414 2939 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1507eb32a8b44dc4993148ab67c7f703: Neither blocks nor log segments found. Creating new log.
I20260809 09:27:13.007357 2939 log.cc:824] T 00000000000000000000000000000000 P 1507eb32a8b44dc4993148ab67c7f703: Log is configured to *not* fsync() on all Append() calls
I20260809 09:27:13.009469 2939 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1507eb32a8b44dc4993148ab67c7f703: No bootstrap required, opened a new log
I20260809 09:27:13.010797 2942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:13.006797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33489 (local address 127.11.99.254:41601)
0809 09:27:13.007265 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:13.007282 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:13.007323 (+ 41us) server_negotiation.cc:407] Connection header received
0809 09:27:13.008057 (+ 734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:13.008078 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:13.008399 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:13.008726 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:13.009407 (+ 681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:13.009413 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:13.009426 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:27:13.009437 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:13.009502 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:27:13.009531 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:13.009681 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:13.009784 (+ 103us) server_negotiation.cc:299] Negotiation successful
0809 09:27:13.009930 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":123,"threads_started":1}
I20260809 09:27:13.013475 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 09:27:13.013761 2939 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1507eb32a8b44dc4993148ab67c7f703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1507eb32a8b44dc4993148ab67c7f703" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 41601 } }
I20260809 09:27:13.013962 2939 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1507eb32a8b44dc4993148ab67c7f703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:27:13.014034 2939 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1507eb32a8b44dc4993148ab67c7f703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1507eb32a8b44dc4993148ab67c7f703, State: Initialized, Role: FOLLOWER
I20260809 09:27:13.014498 2939 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1507eb32a8b44dc4993148ab67c7f703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1507eb32a8b44dc4993148ab67c7f703" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 41601 } }
I20260809 09:27:13.014671 2939 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1507eb32a8b44dc4993148ab67c7f703 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:27:13.014745 2939 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1507eb32a8b44dc4993148ab67c7f703 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:27:13.014887 2939 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1507eb32a8b44dc4993148ab67c7f703 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:27:13.015879 2939 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1507eb32a8b44dc4993148ab67c7f703 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1507eb32a8b44dc4993148ab67c7f703" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 41601 } }
I20260809 09:27:13.016249 2939 leader_election.cc:302] T 00000000000000000000000000000000 P 1507eb32a8b44dc4993148ab67c7f703 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1507eb32a8b44dc4993148ab67c7f703; no voters:
I20260809 09:27:13.016604 2939 leader_election.cc:288] T 00000000000000000000000000000000 P 1507eb32a8b44dc4993148ab67c7f703 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:27:13.016788 2949 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1507eb32a8b44dc4993148ab67c7f703 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:27:13.017098 2949 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1507eb32a8b44dc4993148ab67c7f703 [term 1 LEADER]: Becoming Leader. State: Replica: 1507eb32a8b44dc4993148ab67c7f703, State: Running, Role: LEADER
I20260809 09:27:13.017277 2942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:13.015600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43517 (local address 127.11.99.254:41601)
0809 09:27:13.015720 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:13.015726 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:13.015904 (+ 178us) server_negotiation.cc:407] Connection header received
0809 09:27:13.016033 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:13.016036 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:13.016069 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:13.016141 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:13.016826 (+ 685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:13.016830 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:13.016832 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:27:13.016844 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:13.016872 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:27:13.016885 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:13.016974 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:13.017139 (+ 165us) server_negotiation.cc:299] Negotiation successful
0809 09:27:13.017176 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 09:27:13.017596 2949 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1507eb32a8b44dc4993148ab67c7f703 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1507eb32a8b44dc4993148ab67c7f703" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 41601 } }
I20260809 09:27:13.017858 2939 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1507eb32a8b44dc4993148ab67c7f703 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:27:13.019326 2950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1507eb32a8b44dc4993148ab67c7f703 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1507eb32a8b44dc4993148ab67c7f703" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1507eb32a8b44dc4993148ab67c7f703" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 41601 } } }
I20260809 09:27:13.019310 2951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1507eb32a8b44dc4993148ab67c7f703 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1507eb32a8b44dc4993148ab67c7f703. Latest consensus state: current_term: 1 leader_uuid: "1507eb32a8b44dc4993148ab67c7f703" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1507eb32a8b44dc4993148ab67c7f703" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 41601 } } }
I20260809 09:27:13.019444 2950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1507eb32a8b44dc4993148ab67c7f703 [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:13.019444 2951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1507eb32a8b44dc4993148ab67c7f703 [sys.catalog]: This master's current role is: LEADER
W20260809 09:27:13.022389 2965 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1507eb32a8b44dc4993148ab67c7f703: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 09:27:13.022469 2965 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 09:27:13.022544 2964 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:27:13.023275 2964 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:27:13.028374 2964 catalog_manager.cc:1347] Generated new cluster ID: 1e007c833b934bec91c69205d08763ca
I20260809 09:27:13.028432 2964 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:27:13.041954 2964 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:27:13.042264 2964 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:27:13.052428 2964 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1507eb32a8b44dc4993148ab67c7f703: Generated new TSK 0
I20260809 09:27:13.053123 2964 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:27:13.063462 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 2868
2026-08-09T09:27:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1392 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:27:13 dist-test-slave-pgkr krb5kdc[2971](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:27:13 dist-test-slave-pgkr krb5kdc[2971](info): set up 2 sockets
Aug 09 09:27:13 dist-test-slave-pgkr krb5kdc[2971](info): commencing operation
krb5kdc: starting...
W20260809 09:27:14.109814 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.025s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:27:14 dist-test-slave-pgkr krb5kdc[2971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267634, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:27:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:27:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:27:14.227695 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:37269
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:39601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:37269
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:27:14.330380 2986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:27:14.330590 2986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:27:14.330643 2986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:27:14.334227 2986 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:27:14.334272 2986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:27:14.334291 2986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:27:14.334306 2986 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:27:14.334321 2986 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:27:14.338882 2986 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:39601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:37269
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:37269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2986
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:27:14.339700 2986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:27:14.340543 2986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:27:14.348464 2992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:14.348484 2994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:14.348536 2986 server_base.cc:1034] running on GCE node
W20260809 09:27:14.348501 2991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:14.349316 2986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:27:14.350394 2986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:27:14.351616 2986 hybrid_clock.cc:648] HybridClock initialized: now 1786267634351590 us; error 40 us; skew 500 ppm
Aug 09 09:27:14 dist-test-slave-pgkr krb5kdc[2971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267634, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:27:14.358865 2986 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:27:14.359716 2986 webserver.cc:460] Webserver started at http://127.11.99.254:38067/ using document root <none> and password file <none>
I20260809 09:27:14.360204 2986 fs_manager.cc:359] Metadata directory not provided
I20260809 09:27:14.360262 2986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:27:14.360416 2986 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:27:14.362284 2986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "089dd6cf59aa49dab32b881fa62b2df9"
format_stamp: "Formatted at 2026-08-09 09:27:14 on dist-test-slave-pgkr"
server_key: "52f6e3ebb35736c2d047148e51b99f5c"
server_key_iv: "6e45456267b6b725a1246c52120854e9"
server_key_version: "encryptionkey@0"
I20260809 09:27:14.362844 2986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "089dd6cf59aa49dab32b881fa62b2df9"
format_stamp: "Formatted at 2026-08-09 09:27:14 on dist-test-slave-pgkr"
server_key: "52f6e3ebb35736c2d047148e51b99f5c"
server_key_iv: "6e45456267b6b725a1246c52120854e9"
server_key_version: "encryptionkey@0"
I20260809 09:27:14.366173 2986 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260809 09:27:14.368464 3004 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:27:14.369659 2986 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:27:14.369757 2986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "089dd6cf59aa49dab32b881fa62b2df9"
format_stamp: "Formatted at 2026-08-09 09:27:14 on dist-test-slave-pgkr"
server_key: "52f6e3ebb35736c2d047148e51b99f5c"
server_key_iv: "6e45456267b6b725a1246c52120854e9"
server_key_version: "encryptionkey@0"
I20260809 09:27:14.369916 2986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:27:14.405043 2986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:27:14.408294 2986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:27:14.408497 2986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:27:14.415318 2986 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:37269
I20260809 09:27:14.415349 3058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:37269 every 8 connection(s)
I20260809 09:27:14.416224 2986 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:27:14.418912 3059 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:27:14.423822 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 2986
I20260809 09:27:14.423961 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:27:14.424268 11663 external_mini_cluster.cc:1428] Setting key 78dcc9c1997d1ce8fa6d3ea47b93b576
I20260809 09:27:14.424311 3059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 089dd6cf59aa49dab32b881fa62b2df9: Bootstrap starting.
I20260809 09:27:14.426810 3059 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 089dd6cf59aa49dab32b881fa62b2df9: Neither blocks nor log segments found. Creating new log.
I20260809 09:27:14.427527 3059 log.cc:824] T 00000000000000000000000000000000 P 089dd6cf59aa49dab32b881fa62b2df9: Log is configured to *not* fsync() on all Append() calls
I20260809 09:27:14.429318 3059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 089dd6cf59aa49dab32b881fa62b2df9: No bootstrap required, opened a new log
Aug 09 09:27:14 dist-test-slave-pgkr krb5kdc[2971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267634, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:27:14.433734 3059 raft_consensus.cc:348] T 00000000000000000000000000000000 P 089dd6cf59aa49dab32b881fa62b2df9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "089dd6cf59aa49dab32b881fa62b2df9" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 37269 } }
I20260809 09:27:14.433974 3059 raft_consensus.cc:374] T 00000000000000000000000000000000 P 089dd6cf59aa49dab32b881fa62b2df9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:27:14.434059 3059 raft_consensus.cc:729] T 00000000000000000000000000000000 P 089dd6cf59aa49dab32b881fa62b2df9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 089dd6cf59aa49dab32b881fa62b2df9, State: Initialized, Role: FOLLOWER
I20260809 09:27:14.434490 3059 consensus_queue.cc:260] T 00000000000000000000000000000000 P 089dd6cf59aa49dab32b881fa62b2df9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "089dd6cf59aa49dab32b881fa62b2df9" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 37269 } }
I20260809 09:27:14.434665 3059 raft_consensus.cc:388] T 00000000000000000000000000000000 P 089dd6cf59aa49dab32b881fa62b2df9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:27:14.434754 3059 raft_consensus.cc:482] T 00000000000000000000000000000000 P 089dd6cf59aa49dab32b881fa62b2df9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:27:14.434871 3059 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 089dd6cf59aa49dab32b881fa62b2df9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:27:14.436041 3059 raft_consensus.cc:504] T 00000000000000000000000000000000 P 089dd6cf59aa49dab32b881fa62b2df9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "089dd6cf59aa49dab32b881fa62b2df9" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 37269 } }
I20260809 09:27:14.436410 3059 leader_election.cc:302] T 00000000000000000000000000000000 P 089dd6cf59aa49dab32b881fa62b2df9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 089dd6cf59aa49dab32b881fa62b2df9; no voters:
I20260809 09:27:14.436794 3059 leader_election.cc:288] T 00000000000000000000000000000000 P 089dd6cf59aa49dab32b881fa62b2df9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:27:14.436895 3064 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 089dd6cf59aa49dab32b881fa62b2df9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:27:14.437127 3064 raft_consensus.cc:686] T 00000000000000000000000000000000 P 089dd6cf59aa49dab32b881fa62b2df9 [term 1 LEADER]: Becoming Leader. State: Replica: 089dd6cf59aa49dab32b881fa62b2df9, State: Running, Role: LEADER
I20260809 09:27:14.437430 3064 consensus_queue.cc:237] T 00000000000000000000000000000000 P 089dd6cf59aa49dab32b881fa62b2df9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "089dd6cf59aa49dab32b881fa62b2df9" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 37269 } }
I20260809 09:27:14.438048 3059 sys_catalog.cc:564] T 00000000000000000000000000000000 P 089dd6cf59aa49dab32b881fa62b2df9 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:27:14.439245 3066 sys_catalog.cc:455] T 00000000000000000000000000000000 P 089dd6cf59aa49dab32b881fa62b2df9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 089dd6cf59aa49dab32b881fa62b2df9. Latest consensus state: current_term: 1 leader_uuid: "089dd6cf59aa49dab32b881fa62b2df9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "089dd6cf59aa49dab32b881fa62b2df9" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 37269 } } }
I20260809 09:27:14.439227 3065 sys_catalog.cc:455] T 00000000000000000000000000000000 P 089dd6cf59aa49dab32b881fa62b2df9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "089dd6cf59aa49dab32b881fa62b2df9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "089dd6cf59aa49dab32b881fa62b2df9" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 37269 } } }
I20260809 09:27:14.439445 3065 sys_catalog.cc:458] T 00000000000000000000000000000000 P 089dd6cf59aa49dab32b881fa62b2df9 [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:14.439472 3066 sys_catalog.cc:458] T 00000000000000000000000000000000 P 089dd6cf59aa49dab32b881fa62b2df9 [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:14.439684 3062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:14.425626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42231 (local address 127.11.99.254:37269)
0809 09:27:14.426131 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:14.426146 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:14.426180 (+ 34us) server_negotiation.cc:407] Connection header received
0809 09:27:14.426915 (+ 735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:14.426938 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:14.427269 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:14.427604 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:14.428413 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:14.429374 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:14.430508 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:14.431022 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:14.431135 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:14.434006 (+ 2871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:14.434012 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:14.434040 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:14.434088 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:14.436268 (+ 2180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:14.436741 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:14.436749 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:14.436755 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:14.436904 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:14.437314 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:14.437317 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:14.437319 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:14.437807 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:14.437983 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:14.438313 (+ 330us) server_negotiation.cc:299] Negotiation successful
0809 09:27:14.438637 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":117,"threads_started":1}
I20260809 09:27:14.442632 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260809 09:27:14.442816 3080 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 089dd6cf59aa49dab32b881fa62b2df9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 09:27:14.442881 3080 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 09:27:14.442936 3076 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:27:14.443778 3076 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:27:14.449329 3076 catalog_manager.cc:1347] Generated new cluster ID: ec773e799d374ff9a70e5876b7668180
I20260809 09:27:14.449404 3076 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:27:14.453069 3062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:14.444828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50945 (local address 127.11.99.254:37269)
0809 09:27:14.444927 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:14.444932 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:14.445161 (+ 229us) server_negotiation.cc:407] Connection header received
0809 09:27:14.445276 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:14.445279 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:14.445317 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:14.445419 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:14.446200 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:14.447016 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:14.448016 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:14.448372 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:14.448489 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:14.449998 (+ 1509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:14.450002 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:14.450004 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:14.450034 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:14.451442 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:14.451822 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:14.451826 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:14.451828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:14.451905 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:14.452183 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:14.452188 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:14.452189 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:14.452390 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:14.452522 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:14.452765 (+ 243us) server_negotiation.cc:299] Negotiation successful
0809 09:27:14.452882 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 09:27:14.460280 3076 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:27:14.461081 3076 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:27:14.477733 3076 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 089dd6cf59aa49dab32b881fa62b2df9: Generated new TSK 0
I20260809 09:27:14.478358 3076 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:27:14.489488 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 2986
2026-08-09T09:27:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1426 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:27:14 dist-test-slave-pgkr krb5kdc[3091](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:27:14 dist-test-slave-pgkr krb5kdc[3091](info): set up 2 sockets
Aug 09 09:27:14 dist-test-slave-pgkr krb5kdc[3091](info): commencing operation
krb5kdc: starting...
W20260809 09:27:15.536335 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.025s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:27:15 dist-test-slave-pgkr krb5kdc[3091](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267635, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:27:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:27:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:27:15.652750 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:46381
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:36359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:46381
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:27:15.756668 3105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:27:15.756934 3105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:27:15.757017 3105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:27:15.760874 3105 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:27:15.760951 3105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:27:15.760988 3105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:27:15.761022 3105 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:27:15.761075 3105 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:27:15.765940 3105 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:36359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:46381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:46381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3105
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:27:15.766909 3105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:27:15.767858 3105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:27:15.776147 3112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:15.776203 3114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:15.776156 3111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:15.776377 3105 server_base.cc:1034] running on GCE node
I20260809 09:27:15.777001 3105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:27:15.778012 3105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:27:15.779198 3105 hybrid_clock.cc:648] HybridClock initialized: now 1786267635779180 us; error 29 us; skew 500 ppm
Aug 09 09:27:15 dist-test-slave-pgkr krb5kdc[3091](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267635, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:27:15.781858 3105 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:27:15.782694 3105 webserver.cc:460] Webserver started at http://127.11.99.254:34255/ using document root <none> and password file <none>
I20260809 09:27:15.783232 3105 fs_manager.cc:359] Metadata directory not provided
I20260809 09:27:15.783334 3105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:27:15.783553 3105 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:27:15.785475 3105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "a4644d9229c04377b43e69d357fcc0b8"
format_stamp: "Formatted at 2026-08-09 09:27:15 on dist-test-slave-pgkr"
server_key: "0c51c65cecd6f4b289748ed95b9713b6"
server_key_iv: "031147134ede922d0ad43e356f0d6e8b"
server_key_version: "encryptionkey@0"
I20260809 09:27:15.786022 3105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "a4644d9229c04377b43e69d357fcc0b8"
format_stamp: "Formatted at 2026-08-09 09:27:15 on dist-test-slave-pgkr"
server_key: "0c51c65cecd6f4b289748ed95b9713b6"
server_key_iv: "031147134ede922d0ad43e356f0d6e8b"
server_key_version: "encryptionkey@0"
I20260809 09:27:15.789507 3105 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 09:27:15.791860 3121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:27:15.792964 3105 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 09:27:15.793104 3105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "a4644d9229c04377b43e69d357fcc0b8"
format_stamp: "Formatted at 2026-08-09 09:27:15 on dist-test-slave-pgkr"
server_key: "0c51c65cecd6f4b289748ed95b9713b6"
server_key_iv: "031147134ede922d0ad43e356f0d6e8b"
server_key_version: "encryptionkey@0"
I20260809 09:27:15.793233 3105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:27:15.809566 3105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:27:15.812182 3105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:27:15.812374 3105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:27:15.819119 3105 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:46381
I20260809 09:27:15.819186 3176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:46381 every 8 connection(s)
I20260809 09:27:15.820043 3105 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:27:15.822661 3177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:27:15.827982 3177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4644d9229c04377b43e69d357fcc0b8: Bootstrap starting.
I20260809 09:27:15.828326 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 3105
I20260809 09:27:15.828476 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:27:15.828750 11663 external_mini_cluster.cc:1428] Setting key 267bec76c6fcde98a35ea4f371bd399c
I20260809 09:27:15.830497 3177 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a4644d9229c04377b43e69d357fcc0b8: Neither blocks nor log segments found. Creating new log.
I20260809 09:27:15.831189 3177 log.cc:824] T 00000000000000000000000000000000 P a4644d9229c04377b43e69d357fcc0b8: Log is configured to *not* fsync() on all Append() calls
I20260809 09:27:15.832890 3177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4644d9229c04377b43e69d357fcc0b8: No bootstrap required, opened a new log
I20260809 09:27:15.836267 3177 raft_consensus.cc:348] T 00000000000000000000000000000000 P a4644d9229c04377b43e69d357fcc0b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4644d9229c04377b43e69d357fcc0b8" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46381 } }
I20260809 09:27:15.836565 3177 raft_consensus.cc:374] T 00000000000000000000000000000000 P a4644d9229c04377b43e69d357fcc0b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:27:15.836643 3177 raft_consensus.cc:729] T 00000000000000000000000000000000 P a4644d9229c04377b43e69d357fcc0b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4644d9229c04377b43e69d357fcc0b8, State: Initialized, Role: FOLLOWER
I20260809 09:27:15.837038 3177 consensus_queue.cc:260] T 00000000000000000000000000000000 P a4644d9229c04377b43e69d357fcc0b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4644d9229c04377b43e69d357fcc0b8" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46381 } }
I20260809 09:27:15.837148 3177 raft_consensus.cc:388] T 00000000000000000000000000000000 P a4644d9229c04377b43e69d357fcc0b8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:27:15.837225 3177 raft_consensus.cc:482] T 00000000000000000000000000000000 P a4644d9229c04377b43e69d357fcc0b8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:27:15.837322 3177 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a4644d9229c04377b43e69d357fcc0b8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:27:15.837479 3180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:15.830021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48433 (local address 127.11.99.254:46381)
0809 09:27:15.830434 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:15.830447 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:15.830481 (+ 34us) server_negotiation.cc:407] Connection header received
0809 09:27:15.831136 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:15.831151 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:15.831514 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:15.831819 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:15.832194 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:15.833210 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:15.834093 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:15.834563 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:15.834800 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:15.835671 (+ 871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:15.835676 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:15.835687 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:27:15.836047 (+ 360us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:15.836094 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:27:15.836115 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:15.836217 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:15.836373 (+ 156us) server_negotiation.cc:299] Negotiation successful
0809 09:27:15.836581 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":133,"threads_started":1}
I20260809 09:27:15.838171 3177 raft_consensus.cc:504] T 00000000000000000000000000000000 P a4644d9229c04377b43e69d357fcc0b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4644d9229c04377b43e69d357fcc0b8" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46381 } }
I20260809 09:27:15.838501 3177 leader_election.cc:302] T 00000000000000000000000000000000 P a4644d9229c04377b43e69d357fcc0b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a4644d9229c04377b43e69d357fcc0b8; no voters:
I20260809 09:27:15.838788 3177 leader_election.cc:288] T 00000000000000000000000000000000 P a4644d9229c04377b43e69d357fcc0b8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:27:15.838884 3182 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a4644d9229c04377b43e69d357fcc0b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:27:15.839120 3182 raft_consensus.cc:686] T 00000000000000000000000000000000 P a4644d9229c04377b43e69d357fcc0b8 [term 1 LEADER]: Becoming Leader. State: Replica: a4644d9229c04377b43e69d357fcc0b8, State: Running, Role: LEADER
I20260809 09:27:15.839454 3182 consensus_queue.cc:237] T 00000000000000000000000000000000 P a4644d9229c04377b43e69d357fcc0b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4644d9229c04377b43e69d357fcc0b8" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46381 } }
I20260809 09:27:15.839921 3177 sys_catalog.cc:564] T 00000000000000000000000000000000 P a4644d9229c04377b43e69d357fcc0b8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:27:15.840056 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 09:27:15.840598 3182 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4644d9229c04377b43e69d357fcc0b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a4644d9229c04377b43e69d357fcc0b8. Latest consensus state: current_term: 1 leader_uuid: "a4644d9229c04377b43e69d357fcc0b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4644d9229c04377b43e69d357fcc0b8" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46381 } } }
I20260809 09:27:15.840801 3182 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4644d9229c04377b43e69d357fcc0b8 [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:15.841041 3184 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4644d9229c04377b43e69d357fcc0b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a4644d9229c04377b43e69d357fcc0b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4644d9229c04377b43e69d357fcc0b8" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 46381 } } }
I20260809 09:27:15.841185 3184 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4644d9229c04377b43e69d357fcc0b8 [sys.catalog]: This master's current role is: LEADER
W20260809 09:27:15.845002 3201 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a4644d9229c04377b43e69d357fcc0b8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 09:27:15.845089 3201 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 09:27:15.845201 3191 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:27:15.846074 3191 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:27:15.846724 3180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:15.842341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46639 (local address 127.11.99.254:46381)
0809 09:27:15.842456 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:15.842459 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:15.842919 (+ 460us) server_negotiation.cc:407] Connection header received
0809 09:27:15.843056 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:15.843059 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:15.843102 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:15.843145 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:15.843488 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:15.844180 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:15.845243 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:15.845521 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:15.845620 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:15.846344 (+ 724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:15.846348 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:15.846350 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:27:15.846360 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:15.846384 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:27:15.846396 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:15.846470 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:15.846538 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 09:27:15.846582 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 09:27:15.851166 3191 catalog_manager.cc:1347] Generated new cluster ID: 784f29f16abf4727ae2f92f2b94926d3
I20260809 09:27:15.851225 3191 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:27:15.860056 3191 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:27:15.861119 3191 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:27:15.876427 3191 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a4644d9229c04377b43e69d357fcc0b8: Generated new TSK 0
I20260809 09:27:15.877122 3191 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:27:15.882236 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 3105
2026-08-09T09:27:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1393 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:27:15 dist-test-slave-pgkr krb5kdc[3208](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:27:15 dist-test-slave-pgkr krb5kdc[3208](info): set up 2 sockets
Aug 09 09:27:15 dist-test-slave-pgkr krb5kdc[3208](info): commencing operation
krb5kdc: starting...
W20260809 09:27:16.932962 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.028s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:27:17 dist-test-slave-pgkr krb5kdc[3208](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267637, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:27:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:27:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:27:17.054900 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:35143
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:42885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:35143
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:27:17.160475 3221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:27:17.160696 3221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:27:17.160734 3221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:27:17.164497 3221 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:27:17.164541 3221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:27:17.164558 3221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:27:17.164573 3221 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:27:17.164587 3221 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:27:17.169059 3221 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:42885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:35143
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:35143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3221
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:27:17.169828 3221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:27:17.170688 3221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:27:17.178535 3227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:17.178694 3228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:17.178738 3221 server_base.cc:1034] running on GCE node
W20260809 09:27:17.178696 3230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:17.179422 3221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:27:17.180537 3221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:27:17.181733 3221 hybrid_clock.cc:648] HybridClock initialized: now 1786267637181711 us; error 43 us; skew 500 ppm
Aug 09 09:27:17 dist-test-slave-pgkr krb5kdc[3208](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267637, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:27:17.184607 3221 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:27:17.185348 3221 webserver.cc:460] Webserver started at http://127.11.99.254:38185/ using document root <none> and password file <none>
I20260809 09:27:17.185839 3221 fs_manager.cc:359] Metadata directory not provided
I20260809 09:27:17.185913 3221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:27:17.186072 3221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:27:17.187885 3221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "066aa4569a2d40b48bd2fe9bee75e9bd"
format_stamp: "Formatted at 2026-08-09 09:27:17 on dist-test-slave-pgkr"
server_key: "4b95c81bf346a53d23935bfcce05ff83"
server_key_iv: "3db0f2899ddeed1a48e8f97e7fe49839"
server_key_version: "encryptionkey@0"
I20260809 09:27:17.188354 3221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "066aa4569a2d40b48bd2fe9bee75e9bd"
format_stamp: "Formatted at 2026-08-09 09:27:17 on dist-test-slave-pgkr"
server_key: "4b95c81bf346a53d23935bfcce05ff83"
server_key_iv: "3db0f2899ddeed1a48e8f97e7fe49839"
server_key_version: "encryptionkey@0"
I20260809 09:27:17.191870 3221 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 09:27:17.194031 3238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:27:17.195281 3221 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:27:17.195380 3221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "066aa4569a2d40b48bd2fe9bee75e9bd"
format_stamp: "Formatted at 2026-08-09 09:27:17 on dist-test-slave-pgkr"
server_key: "4b95c81bf346a53d23935bfcce05ff83"
server_key_iv: "3db0f2899ddeed1a48e8f97e7fe49839"
server_key_version: "encryptionkey@0"
I20260809 09:27:17.195488 3221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:27:17.199682 3221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:27:17.202730 3221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:27:17.202864 3221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:27:17.208849 3221 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:35143
I20260809 09:27:17.208874 3295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:35143 every 8 connection(s)
I20260809 09:27:17.209648 3221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:27:17.210484 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 3221
I20260809 09:27:17.210646 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:27:17.210938 11663 external_mini_cluster.cc:1428] Setting key 61bfe231d96c8f1709b971d6e42fd5a9
I20260809 09:27:17.212742 3296 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:27:17.216480 3299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:17.212178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34567 (local address 127.11.99.254:35143)
0809 09:27:17.212673 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:17.212690 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:17.212730 (+ 40us) server_negotiation.cc:407] Connection header received
0809 09:27:17.213632 (+ 902us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:17.213672 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:17.213978 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:17.214275 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:17.215327 (+ 1052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:17.215334 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:17.215351 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:27:17.215367 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:17.215435 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:27:17.215459 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:17.215655 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:17.215722 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 09:27:17.215855 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":153,"threads_started":1}
I20260809 09:27:17.219188 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 09:27:17.219231 3296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 066aa4569a2d40b48bd2fe9bee75e9bd: Bootstrap starting.
I20260809 09:27:17.221356 3296 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 066aa4569a2d40b48bd2fe9bee75e9bd: Neither blocks nor log segments found. Creating new log.
I20260809 09:27:17.222147 3296 log.cc:824] T 00000000000000000000000000000000 P 066aa4569a2d40b48bd2fe9bee75e9bd: Log is configured to *not* fsync() on all Append() calls
I20260809 09:27:17.222858 3299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:17.221164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35467 (local address 127.11.99.254:35143)
0809 09:27:17.221284 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:17.221288 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:17.221609 (+ 321us) server_negotiation.cc:407] Connection header received
0809 09:27:17.221651 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:17.221653 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:17.221682 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:17.221750 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:17.222404 (+ 654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:17.222407 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:17.222410 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 09:27:17.222421 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:17.222448 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 09:27:17.222465 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:17.222559 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:17.222708 (+ 149us) server_negotiation.cc:299] Negotiation successful
0809 09:27:17.222740 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 09:27:17.224109 3296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 066aa4569a2d40b48bd2fe9bee75e9bd: No bootstrap required, opened a new log
I20260809 09:27:17.227331 3296 raft_consensus.cc:348] T 00000000000000000000000000000000 P 066aa4569a2d40b48bd2fe9bee75e9bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "066aa4569a2d40b48bd2fe9bee75e9bd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35143 } }
I20260809 09:27:17.227550 3296 raft_consensus.cc:374] T 00000000000000000000000000000000 P 066aa4569a2d40b48bd2fe9bee75e9bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 09:27:17.227608 3296 raft_consensus.cc:729] T 00000000000000000000000000000000 P 066aa4569a2d40b48bd2fe9bee75e9bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 066aa4569a2d40b48bd2fe9bee75e9bd, State: Initialized, Role: FOLLOWER
I20260809 09:27:17.227950 3296 consensus_queue.cc:260] T 00000000000000000000000000000000 P 066aa4569a2d40b48bd2fe9bee75e9bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "066aa4569a2d40b48bd2fe9bee75e9bd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35143 } }
I20260809 09:27:17.228062 3296 raft_consensus.cc:388] T 00000000000000000000000000000000 P 066aa4569a2d40b48bd2fe9bee75e9bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 09:27:17.228120 3296 raft_consensus.cc:482] T 00000000000000000000000000000000 P 066aa4569a2d40b48bd2fe9bee75e9bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 09:27:17.228183 3296 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 066aa4569a2d40b48bd2fe9bee75e9bd [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:27:17.228849 3296 raft_consensus.cc:504] T 00000000000000000000000000000000 P 066aa4569a2d40b48bd2fe9bee75e9bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "066aa4569a2d40b48bd2fe9bee75e9bd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35143 } }
I20260809 09:27:17.229123 3296 leader_election.cc:302] T 00000000000000000000000000000000 P 066aa4569a2d40b48bd2fe9bee75e9bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 066aa4569a2d40b48bd2fe9bee75e9bd; no voters:
I20260809 09:27:17.229372 3296 leader_election.cc:288] T 00000000000000000000000000000000 P 066aa4569a2d40b48bd2fe9bee75e9bd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 09:27:17.229502 3306 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 066aa4569a2d40b48bd2fe9bee75e9bd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:27:17.229733 3306 raft_consensus.cc:686] T 00000000000000000000000000000000 P 066aa4569a2d40b48bd2fe9bee75e9bd [term 1 LEADER]: Becoming Leader. State: Replica: 066aa4569a2d40b48bd2fe9bee75e9bd, State: Running, Role: LEADER
I20260809 09:27:17.230069 3306 consensus_queue.cc:237] T 00000000000000000000000000000000 P 066aa4569a2d40b48bd2fe9bee75e9bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "066aa4569a2d40b48bd2fe9bee75e9bd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35143 } }
I20260809 09:27:17.230499 3296 sys_catalog.cc:564] T 00000000000000000000000000000000 P 066aa4569a2d40b48bd2fe9bee75e9bd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:27:17.231798 3307 sys_catalog.cc:455] T 00000000000000000000000000000000 P 066aa4569a2d40b48bd2fe9bee75e9bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "066aa4569a2d40b48bd2fe9bee75e9bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "066aa4569a2d40b48bd2fe9bee75e9bd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35143 } } }
I20260809 09:27:17.231802 3308 sys_catalog.cc:455] T 00000000000000000000000000000000 P 066aa4569a2d40b48bd2fe9bee75e9bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 066aa4569a2d40b48bd2fe9bee75e9bd. Latest consensus state: current_term: 1 leader_uuid: "066aa4569a2d40b48bd2fe9bee75e9bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "066aa4569a2d40b48bd2fe9bee75e9bd" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 35143 } } }
I20260809 09:27:17.231922 3307 sys_catalog.cc:458] T 00000000000000000000000000000000 P 066aa4569a2d40b48bd2fe9bee75e9bd [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:17.231926 3308 sys_catalog.cc:458] T 00000000000000000000000000000000 P 066aa4569a2d40b48bd2fe9bee75e9bd [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:17.232868 3316 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:27:17.235272 3316 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:27:17.240342 3316 catalog_manager.cc:1347] Generated new cluster ID: 9a98fdb6eb0e4633b815288417a4ba67
I20260809 09:27:17.240422 3316 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:27:17.250941 3316 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:27:17.251343 3316 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:27:17.257660 3316 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 066aa4569a2d40b48bd2fe9bee75e9bd: Generated new TSK 0
I20260809 09:27:17.258183 3316 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 09:27:17.270573 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 3221
2026-08-09T09:27:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1387 ms)
[----------] 18 tests from AuthTokenIssuingTest (25182 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:27:17 dist-test-slave-pgkr krb5kdc[3327](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:27:17 dist-test-slave-pgkr krb5kdc[3327](info): set up 2 sockets
Aug 09 09:27:17 dist-test-slave-pgkr krb5kdc[3327](info): commencing operation
krb5kdc: starting...
W20260809 09:27:18.312412 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.020s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:27:18 dist-test-slave-pgkr krb5kdc[3327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267638, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:27:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:27:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:27:18.429397 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:39113
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:40663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:39113,127.11.99.253:33505,127.11.99.252:40363
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:27:18.534799 3340 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 09:27:18.535095 3340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:27:18.535166 3340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:27:18.535245 3340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:27:18.539139 3340 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:27:18.539207 3340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:27:18.539244 3340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:27:18.539299 3340 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:27:18.539338 3340 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:27:18.544287 3340 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:40663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:39113,127.11.99.253:33505,127.11.99.252:40363
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:39113
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3340
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:27:18.545200 3340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:27:18.546083 3340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:27:18.554214 3348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:18.554224 3345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:18.554365 3340 server_base.cc:1034] running on GCE node
W20260809 09:27:18.554565 3346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:18.555162 3340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:27:18.556169 3340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:27:18.557332 3340 hybrid_clock.cc:648] HybridClock initialized: now 1786267638557308 us; error 36 us; skew 500 ppm
Aug 09 09:27:18 dist-test-slave-pgkr krb5kdc[3327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267638, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:27:18.559962 3340 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:27:18.560705 3340 webserver.cc:460] Webserver started at http://127.11.99.254:43699/ using document root <none> and password file <none>
I20260809 09:27:18.561214 3340 fs_manager.cc:359] Metadata directory not provided
I20260809 09:27:18.561271 3340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:27:18.561434 3340 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:27:18.563310 3340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "1223a0ede17145cb9dd0e9304665056c"
format_stamp: "Formatted at 2026-08-09 09:27:18 on dist-test-slave-pgkr"
server_key: "ac893d12e02c606a99900b147b26d154"
server_key_iv: "d200881ec605f9b53cc1b9a2c0b224eb"
server_key_version: "encryptionkey@0"
I20260809 09:27:18.563812 3340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "1223a0ede17145cb9dd0e9304665056c"
format_stamp: "Formatted at 2026-08-09 09:27:18 on dist-test-slave-pgkr"
server_key: "ac893d12e02c606a99900b147b26d154"
server_key_iv: "d200881ec605f9b53cc1b9a2c0b224eb"
server_key_version: "encryptionkey@0"
I20260809 09:27:18.567332 3340 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 09:27:18.569495 3355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:27:18.570801 3340 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:27:18.570941 3340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "1223a0ede17145cb9dd0e9304665056c"
format_stamp: "Formatted at 2026-08-09 09:27:18 on dist-test-slave-pgkr"
server_key: "ac893d12e02c606a99900b147b26d154"
server_key_iv: "d200881ec605f9b53cc1b9a2c0b224eb"
server_key_version: "encryptionkey@0"
I20260809 09:27:18.571040 3340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:27:18.581815 3340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:27:18.584967 3340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:27:18.585172 3340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:27:18.591935 3340 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:39113
I20260809 09:27:18.592198 3413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:39113 every 8 connection(s)
I20260809 09:27:18.592885 3340 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:27:18.594594 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 3340
I20260809 09:27:18.594786 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:27:18.595084 11663 external_mini_cluster.cc:1428] Setting key 86a31738ca064a40b3ba213e510cfb7e
I20260809 09:27:18.595963 3414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:27:18.600031 3414 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39113 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.99.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.253@KRBTEST.COM" created.
Aug 09 09:27:18 dist-test-slave-pgkr krb5kdc[3327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267638, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:27:18.616194 3419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:18.602786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57450 (local address 127.11.99.254:39113)
0809 09:27:18.603259 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:18.603280 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:18.603519 (+ 239us) server_negotiation.cc:407] Connection header received
0809 09:27:18.604524 (+ 1005us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:18.604528 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:18.604696 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:18.604855 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:18.605727 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:18.606947 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:18.608497 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:18.609121 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:18.609329 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:18.611558 (+ 2229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:18.611569 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:18.611578 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:18.611597 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:18.613192 (+ 1595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:18.613661 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:18.613669 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:18.613676 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:18.613771 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:18.614077 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:18.614082 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:18.614084 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:18.614432 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:18.614567 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:18.614961 (+ 394us) server_negotiation.cc:299] Negotiation successful
0809 09:27:18.615194 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":303,"thread_start_us":133,"threads_started":1}
I20260809 09:27:18.616194 3420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:18.602786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:39113 (local address 127.0.0.1:57450)
0809 09:27:18.603351 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:18.603398 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 09:27:18.604239 (+ 841us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:27:18.604880 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:27:18.604884 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:27:18.605330 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:27:18.605591 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:18.605603 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:18.607078 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:18.607082 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:18.608353 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:18.608368 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:18.609272 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:18.609275 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:18.609363 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:18.609946 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:27:18.609961 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:27:18.611413 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:27:18.613316 (+ 1903us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:18.613326 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:18.613335 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:18.613554 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:18.613870 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:18.613873 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:18.613875 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:18.613985 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:18.614551 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:27:18.614556 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:27:18.614730 (+ 174us) client_negotiation.cc:769] Sending connection context
0809 09:27:18.614891 (+ 161us) client_negotiation.cc:240] Negotiation successful
0809 09:27:18.615245 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"mutex_wait_us":104,"spinlock_wait_cycles":51584,"thread_start_us":160,"threads_started":1}
I20260809 09:27:18.618573 3414 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33505 } has no permanent_uuid. Determining permanent_uuid...
I20260809 09:27:18.619297 3420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:18.619042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:33505 (local address 127.0.0.1:36622)
0809 09:27:18.619150 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:18.619236 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.253:33505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 09:27:18.619504 3356 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.99.253:33505: connect: Connection refused (error 111)
I20260809 09:27:18.620340 3420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:18.620103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:33505 (local address 127.0.0.1:36636)
0809 09:27:18.620245 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:18.620287 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.253:33505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 09:27:18.620478 3414 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.253:33505: Network error: Client connection negotiation failed: client connection to 127.11.99.253:33505: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.253.keytab.
Entry for principal kudu/127.11.99.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.253.keytab.
I20260809 09:27:18.621891 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.253:33505
--webserver_interface=127.11.99.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.253.keytab
--principal=kudu/127.11.99.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:40663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:39113,127.11.99.253:33505,127.11.99.252:40363
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 09:27:18.669723 3414 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33505 } attempt: 1
I20260809 09:27:18.670728 3420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:18.670382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:33505 (local address 127.0.0.1:36642)
0809 09:27:18.670536 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:18.670599 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.253:33505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 09:27:18.671511 3420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:18.671327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:33505 (local address 127.0.0.1:36650)
0809 09:27:18.671421 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:18.671463 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.253:33505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 09:27:18.671725 3414 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.253:33505: Network error: Client connection negotiation failed: client connection to 127.11.99.253:33505: connect: Connection refused (error 111)
W20260809 09:27:18.730324 3424 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 09:27:18.730568 3424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:27:18.730623 3424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:27:18.730726 3424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:27:18.734457 3424 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:27:18.734506 3424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:27:18.734526 3424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:27:18.734575 3424 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:27:18.734624 3424 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:27:18.739653 3424 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:40663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:39113,127.11.99.253:33505,127.11.99.252:40363
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.253.keytab
--principal=kudu/127.11.99.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.253:33505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.99.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3424
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:27:18.739902 3414 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33505 } attempt: 2
I20260809 09:27:18.740703 3420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:18.740435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:33505 (local address 127.0.0.1:36660)
0809 09:27:18.740574 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:18.740634 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.253:33505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260809 09:27:18.740707 3424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:27:18.741403 3420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:18.741228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:33505 (local address 127.0.0.1:36666)
0809 09:27:18.741317 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:18.741358 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.253:33505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 09:27:18.741554 3414 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.253:33505: Network error: Client connection negotiation failed: client connection to 127.11.99.253:33505: connect: Connection refused (error 111)
I20260809 09:27:18.741852 3424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:27:18.749642 3433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:18.749785 3424 server_base.cc:1034] running on GCE node
W20260809 09:27:18.749682 3429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:18.749682 3430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:18.750466 3424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:27:18.751438 3424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:27:18.752599 3424 hybrid_clock.cc:648] HybridClock initialized: now 1786267638752584 us; error 26 us; skew 500 ppm
Aug 09 09:27:18 dist-test-slave-pgkr krb5kdc[3327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267638, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:27:18.755209 3424 init.cc:377] Logged in from keytab as kudu/127.11.99.253@KRBTEST.COM (short username kudu)
I20260809 09:27:18.755970 3424 webserver.cc:460] Webserver started at http://127.11.99.253:35911/ using document root <none> and password file <none>
I20260809 09:27:18.756469 3424 fs_manager.cc:359] Metadata directory not provided
I20260809 09:27:18.756527 3424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:27:18.756744 3424 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:27:18.758548 3424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-1/data/instance:
uuid: "51ada85a64ec4a70a0e350e2246b6d16"
format_stamp: "Formatted at 2026-08-09 09:27:18 on dist-test-slave-pgkr"
server_key: "30985367368ffc6e339766ec38a4e3dd"
server_key_iv: "f491aef18b7e526d2efb8679cb0bb8b0"
server_key_version: "encryptionkey@0"
I20260809 09:27:18.759109 3424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-1/wal/instance:
uuid: "51ada85a64ec4a70a0e350e2246b6d16"
format_stamp: "Formatted at 2026-08-09 09:27:18 on dist-test-slave-pgkr"
server_key: "30985367368ffc6e339766ec38a4e3dd"
server_key_iv: "f491aef18b7e526d2efb8679cb0bb8b0"
server_key_version: "encryptionkey@0"
I20260809 09:27:18.762508 3424 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 09:27:18.764739 3440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:27:18.765825 3424 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:27:18.765960 3424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-1/wal
uuid: "51ada85a64ec4a70a0e350e2246b6d16"
format_stamp: "Formatted at 2026-08-09 09:27:18 on dist-test-slave-pgkr"
server_key: "30985367368ffc6e339766ec38a4e3dd"
server_key_iv: "f491aef18b7e526d2efb8679cb0bb8b0"
server_key_version: "encryptionkey@0"
I20260809 09:27:18.766072 3424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:27:18.778254 3424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:27:18.781002 3424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:27:18.781149 3424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:27:18.787264 3424 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.253:33505
I20260809 09:27:18.787552 3494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.253:33505 every 8 connection(s)
I20260809 09:27:18.788158 3424 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-1/data/info.pb
I20260809 09:27:18.790709 3495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:27:18.794193 3495 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39113 } has no permanent_uuid. Determining permanent_uuid...
I20260809 09:27:18.798041 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 3424
I20260809 09:27:18.798213 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-1/wal/instance
I20260809 09:27:18.798480 11663 external_mini_cluster.cc:1428] Setting key 1ab2794d1ca5d64419bd4cc6128ec9f7
Aug 09 09:27:18 dist-test-slave-pgkr krb5kdc[3327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267638, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.253@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:27:18.807955 3419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:18.795932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57456 (local address 127.11.99.254:39113)
0809 09:27:18.796068 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:18.796071 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:18.796756 (+ 685us) server_negotiation.cc:407] Connection header received
0809 09:27:18.797573 (+ 817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:18.797576 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:18.797631 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:18.797740 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:18.799099 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:18.799644 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:18.801106 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:18.801341 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:18.801455 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:18.804284 (+ 2829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:18.804287 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:18.804290 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:18.804314 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:18.805774 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:18.806376 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:18.806379 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:18.806380 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:18.806450 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:18.806861 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:18.806863 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:18.806864 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:18.807024 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:18.807116 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:18.807751 (+ 635us) server_negotiation.cc:299] Negotiation successful
0809 09:27:18.807842 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
WARNING: no policy specified for kudu/127.11.99.252@KRBTEST.COM; defaulting to no policy
I20260809 09:27:18.808867 3497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:18.796223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:39113 (local address 127.0.0.1:57456)
0809 09:27:18.796615 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:18.796652 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 09:27:18.797386 (+ 734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:27:18.797894 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:27:18.797901 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:27:18.798295 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:27:18.798932 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:18.798945 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:18.799788 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:18.799793 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:18.800981 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:18.800990 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:18.801487 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:18.801491 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:18.801656 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:18.802223 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:27:18.802237 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:27:18.804116 (+ 1879us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:27:18.805895 (+ 1779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:18.805904 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:18.805918 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:18.806273 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:18.806551 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:18.806555 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:18.806560 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:18.806767 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:18.807145 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:27:18.807152 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:27:18.807475 (+ 323us) client_negotiation.cc:769] Sending connection context
0809 09:27:18.807699 (+ 224us) client_negotiation.cc:240] Negotiation successful
0809 09:27:18.808007 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":105,"threads_started":1}
I20260809 09:27:18.810222 3495 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33505 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.252@KRBTEST.COM" created.
Aug 09 09:27:18 dist-test-slave-pgkr krb5kdc[3327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267638, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.253@KRBTEST.COM for kudu/127.11.99.253@KRBTEST.COM
I20260809 09:27:18.820066 3497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:18.810795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:33505 (local address 127.0.0.1:36680)
0809 09:27:18.810971 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:18.810988 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 09:27:18.811065 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:27:18.811548 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:27:18.811551 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:27:18.811731 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:27:18.811809 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:18.811814 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:18.812812 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:18.812816 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:18.813380 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:18.813388 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:18.814034 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:18.814037 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:18.814177 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:18.814705 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:27:18.814717 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:27:18.816145 (+ 1428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:27:18.818222 (+ 2077us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:18.818227 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:18.818229 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:18.818450 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:18.818871 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:18.818876 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:18.818878 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:18.818967 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:18.819440 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:27:18.819443 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:27:18.819581 (+ 138us) client_negotiation.cc:769] Sending connection context
0809 09:27:18.819703 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 09:27:18.819838 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":23}
I20260809 09:27:18.820132 3499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:18.810889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36680 (local address 127.11.99.253:33505)
0809 09:27:18.811216 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:18.811226 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:18.811244 (+ 18us) server_negotiation.cc:407] Connection header received
0809 09:27:18.811277 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:18.811281 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:18.811416 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:18.811560 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:18.811923 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:18.812687 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:18.813498 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:18.813914 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:18.814104 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:18.816292 (+ 2188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:18.816309 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:18.816318 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:18.816338 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:18.818087 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:18.818604 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:18.818657 (+ 53us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:18.818659 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:18.818771 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:18.819065 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:18.819070 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:18.819072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:18.819330 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:18.819479 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:18.819805 (+ 326us) server_negotiation.cc:299] Negotiation successful
0809 09:27:18.819939 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":225,"thread_start_us":127,"threads_started":1}
I20260809 09:27:18.822057 3495 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } has no permanent_uuid. Determining permanent_uuid...
I20260809 09:27:18.822870 3497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:18.822551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40363 (local address 127.0.0.1:43942)
0809 09:27:18.822745 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:18.822812 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
W20260809 09:27:18.823170 3442 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40363: connect: Connection refused (error 111)
I20260809 09:27:18.823966 3497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:18.823784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40363 (local address 127.0.0.1:43952)
0809 09:27:18.823876 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:18.823918 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 09:27:18.824162 3495 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.252:40363: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40363: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.252.keytab.
Entry for principal kudu/127.11.99.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.252.keytab.
I20260809 09:27:18.825596 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.252:40363
--webserver_interface=127.11.99.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.252.keytab
--principal=kudu/127.11.99.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:40663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:39113,127.11.99.253:33505,127.11.99.252:40363
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 09:27:18.832716 3414 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33505 } attempt: 3
Aug 09 09:27:18 dist-test-slave-pgkr krb5kdc[3327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267638, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for kudu/127.11.99.253@KRBTEST.COM
I20260809 09:27:18.841307 3420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:18.833211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:33505 (local address 127.0.0.1:36686)
0809 09:27:18.833362 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:18.833378 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 09:27:18.833501 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:27:18.833745 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:27:18.833747 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:27:18.833936 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:27:18.834056 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:18.834062 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:18.834898 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:18.834902 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:18.835839 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:18.835848 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:18.836370 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:18.836374 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:18.836477 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:18.836918 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:27:18.836928 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:27:18.838318 (+ 1390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:27:18.840073 (+ 1755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:18.840075 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:18.840076 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:18.840270 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:18.840551 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:18.840553 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:18.840555 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:18.840621 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:18.840974 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:27:18.840975 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:27:18.841045 (+ 70us) client_negotiation.cc:769] Sending connection context
0809 09:27:18.841116 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 09:27:18.841203 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260809 09:27:18.841459 3499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:18.833241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36686 (local address 127.11.99.253:33505)
0809 09:27:18.833361 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:18.833365 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:18.833447 (+ 82us) server_negotiation.cc:407] Connection header received
0809 09:27:18.833600 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:18.833603 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:18.833649 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:18.833726 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:18.834167 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:18.834787 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:18.835959 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:18.836230 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:18.836359 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:18.838443 (+ 2084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:18.838446 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:18.838449 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:18.838475 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:18.839938 (+ 1463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:18.840374 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:18.840377 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:18.840379 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:18.840455 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:18.840696 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:18.840699 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:18.840701 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:18.840893 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:18.840981 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:18.841182 (+ 201us) server_negotiation.cc:299] Negotiation successful
0809 09:27:18.841291 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 09:27:18.842495 3414 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } has no permanent_uuid. Determining permanent_uuid...
I20260809 09:27:18.843192 3420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:18.842956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40363 (local address 127.0.0.1:43964)
0809 09:27:18.843070 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:18.843125 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 09:27:18.844004 3420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:18.843720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40363 (local address 127.0.0.1:43980)
0809 09:27:18.843871 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:18.843921 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
W20260809 09:27:18.844189 3414 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.252:40363: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40363: connect: Connection refused (error 111)
I20260809 09:27:18.873458 3495 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } attempt: 1
I20260809 09:27:18.874280 3497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:18.873967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40363 (local address 127.0.0.1:43982)
0809 09:27:18.874124 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:18.874195 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 09:27:18.875053 3497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:18.874789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40363 (local address 127.0.0.1:43988)
0809 09:27:18.874923 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:18.874981 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 09:27:18.875221 3495 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.252:40363: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40363: connect: Connection refused (error 111)
I20260809 09:27:18.875375 3414 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } attempt: 1
I20260809 09:27:18.876036 3420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:18.875759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40363 (local address 127.0.0.1:43992)
0809 09:27:18.875893 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:18.875951 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 09:27:18.876780 3420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:18.876543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40363 (local address 127.0.0.1:44006)
0809 09:27:18.876667 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:18.876718 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 09:27:18.876914 3414 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.252:40363: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40363: connect: Connection refused (error 111)
W20260809 09:27:18.934983 3502 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 09:27:18.935206 3502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:27:18.935228 3502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:27:18.935264 3502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:27:18.938930 3502 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:27:18.938973 3502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:27:18.938992 3502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:27:18.939008 3502 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:27:18.939023 3502 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:27:18.943416 3495 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } attempt: 2
I20260809 09:27:18.943881 3502 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:40663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:39113,127.11.99.253:33505,127.11.99.252:40363
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.252.keytab
--principal=kudu/127.11.99.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.252:40363
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.99.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3502
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:27:18.944243 3497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:18.943913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40363 (local address 127.0.0.1:44012)
0809 09:27:18.944086 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:18.944157 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 09:27:18.944950 3502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:27:18.945062 3497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:18.944818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40363 (local address 127.0.0.1:44018)
0809 09:27:18.944931 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:18.944989 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 09:27:18.945237 3495 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.252:40363: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40363: connect: Connection refused (error 111)
I20260809 09:27:18.946110 3502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 09:27:18.952064 3414 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } attempt: 2
I20260809 09:27:18.952886 3420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:18.952587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40363 (local address 127.0.0.1:44032)
0809 09:27:18.952729 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:18.952806 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 09:27:18.953847 3420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:18.953520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40363 (local address 127.0.0.1:44048)
0809 09:27:18.953649 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:18.953701 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 09:27:18.954092 3414 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.252:40363: Network error: Client connection negotiation failed: client connection to 127.11.99.252:40363: connect: Connection refused (error 111)
W20260809 09:27:18.954473 3510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:18.954433 3509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:18.954638 3502 server_base.cc:1034] running on GCE node
W20260809 09:27:18.954478 3512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:18.955299 3502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:27:18.956410 3502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:27:18.957595 3502 hybrid_clock.cc:648] HybridClock initialized: now 1786267638957575 us; error 26 us; skew 500 ppm
Aug 09 09:27:18 dist-test-slave-pgkr krb5kdc[3327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267638, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:27:18.960204 3502 init.cc:377] Logged in from keytab as kudu/127.11.99.252@KRBTEST.COM (short username kudu)
I20260809 09:27:18.961076 3502 webserver.cc:460] Webserver started at http://127.11.99.252:41433/ using document root <none> and password file <none>
I20260809 09:27:18.961601 3502 fs_manager.cc:359] Metadata directory not provided
I20260809 09:27:18.961686 3502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:27:18.961901 3502 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:27:18.963934 3502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-2/data/instance:
uuid: "3e7a713b88994bd2944b78cbbb698f11"
format_stamp: "Formatted at 2026-08-09 09:27:18 on dist-test-slave-pgkr"
server_key: "77a6dfd88de40d0b4c8ba463f13d3157"
server_key_iv: "ed5a3fcc1ce6b0c8bc69d1ca0af8b0f6"
server_key_version: "encryptionkey@0"
I20260809 09:27:18.964496 3502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-2/wal/instance:
uuid: "3e7a713b88994bd2944b78cbbb698f11"
format_stamp: "Formatted at 2026-08-09 09:27:18 on dist-test-slave-pgkr"
server_key: "77a6dfd88de40d0b4c8ba463f13d3157"
server_key_iv: "ed5a3fcc1ce6b0c8bc69d1ca0af8b0f6"
server_key_version: "encryptionkey@0"
I20260809 09:27:18.967916 3502 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 09:27:18.970217 3520 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:27:18.971351 3502 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 09:27:18.971477 3502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-2/wal
uuid: "3e7a713b88994bd2944b78cbbb698f11"
format_stamp: "Formatted at 2026-08-09 09:27:18 on dist-test-slave-pgkr"
server_key: "77a6dfd88de40d0b4c8ba463f13d3157"
server_key_iv: "ed5a3fcc1ce6b0c8bc69d1ca0af8b0f6"
server_key_version: "encryptionkey@0"
I20260809 09:27:18.971571 3502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:27:18.984742 3502 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:27:18.987700 3502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:27:18.987879 3502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:27:18.994251 3502 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.252:40363
I20260809 09:27:18.994544 3578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.252:40363 every 8 connection(s)
I20260809 09:27:18.995152 3502 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-2/data/info.pb
I20260809 09:27:18.997603 3579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:27:19.001392 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 3502
I20260809 09:27:19.001199 3579 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39113 } has no permanent_uuid. Determining permanent_uuid...
I20260809 09:27:19.001549 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786267363058776-11663-0/minicluster-data/master-2/wal/instance
I20260809 09:27:19.001863 11663 external_mini_cluster.cc:1428] Setting key 5d8cf5f2a7ce272166a18e49db171b7d
Aug 09 09:27:19 dist-test-slave-pgkr krb5kdc[3327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267638, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.252@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
Aug 09 09:27:19 dist-test-slave-pgkr krb5kdc[3327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267638, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.252@KRBTEST.COM
I20260809 09:27:19.013968 3419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:19.003800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57460 (local address 127.11.99.254:39113)
0809 09:27:19.003925 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:19.003930 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:19.004166 (+ 236us) server_negotiation.cc:407] Connection header received
0809 09:27:19.004679 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:19.004681 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:19.004725 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:19.004795 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:19.005719 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.006190 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.007322 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.007619 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.007695 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:19.010227 (+ 2532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:19.010230 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:19.010232 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:19.010254 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:19.011762 (+ 1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:19.012279 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:19.012282 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:19.012283 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:19.012355 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:19.012718 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:19.012721 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:19.012723 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:19.012988 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:19.013062 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:19.013626 (+ 564us) server_negotiation.cc:299] Negotiation successful
0809 09:27:19.013775 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 09:27:19.015033 3584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:19.003652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:39113 (local address 127.0.0.1:57460)
0809 09:27:19.004014 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:19.004066 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 09:27:19.004466 (+ 400us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:27:19.004865 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:27:19.004870 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:27:19.005298 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:27:19.005569 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:19.005587 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.006299 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.006303 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:19.007208 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:19.007216 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.007754 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.007758 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:19.007904 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:19.008500 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:27:19.008514 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:27:19.010061 (+ 1547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:27:19.011868 (+ 1807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:19.011874 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:19.011883 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:19.012174 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:19.012444 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:19.012447 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:19.012449 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:19.012625 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:19.013082 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:27:19.013088 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:27:19.013365 (+ 277us) client_negotiation.cc:769] Sending connection context
0809 09:27:19.013598 (+ 233us) client_negotiation.cc:240] Negotiation successful
0809 09:27:19.013902 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":113,"threads_started":1}
I20260809 09:27:19.015033 3583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:19.003065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44058 (local address 127.11.99.252:40363)
0809 09:27:19.003471 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:19.003485 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:19.003516 (+ 31us) server_negotiation.cc:407] Connection header received
0809 09:27:19.004466 (+ 950us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:19.004500 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:19.004724 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:19.004906 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:19.005607 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.006624 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.007522 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.007948 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.008053 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:19.010631 (+ 2578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:19.010640 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:19.010654 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:19.010681 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:19.012509 (+ 1828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:19.012961 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:19.012965 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:19.012966 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:19.013052 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:19.013321 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:19.013324 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:19.013325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:19.013587 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:19.013766 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:19.013997 (+ 231us) server_negotiation.cc:299] Negotiation successful
0809 09:27:19.014150 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":103,"threads_started":1}
I20260809 09:27:19.016683 3579 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33505 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 09:27:19 dist-test-slave-pgkr krb5kdc[3327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267638, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.252@KRBTEST.COM for kudu/127.11.99.253@KRBTEST.COM
Aug 09 09:27:19 dist-test-slave-pgkr krb5kdc[3327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267638, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:27:19.024813 3584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:19.017135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:33505 (local address 127.0.0.1:36700)
0809 09:27:19.017290 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:19.017309 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 09:27:19.017373 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:27:19.017722 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:27:19.017725 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:27:19.017884 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:27:19.017961 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:19.017966 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.018679 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.018682 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:19.019159 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:19.019167 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.019595 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.019598 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:19.019686 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:19.020101 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:27:19.020117 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:27:19.021529 (+ 1412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:27:19.023306 (+ 1777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:19.023310 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:19.023312 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:19.023528 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:19.023812 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:19.023818 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:19.023823 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:19.023912 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:19.024342 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:27:19.024347 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:27:19.024440 (+ 93us) client_negotiation.cc:769] Sending connection context
0809 09:27:19.024526 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 09:27:19.024673 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93}
I20260809 09:27:19.024822 3499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:19.017405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36700 (local address 127.11.99.253:33505)
0809 09:27:19.017539 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:19.017543 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:19.017554 (+ 11us) server_negotiation.cc:407] Connection header received
0809 09:27:19.017588 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:19.017590 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:19.017626 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:19.017710 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:19.018071 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.018540 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.019273 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.019482 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.019587 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:19.021663 (+ 2076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:19.021666 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:19.021669 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:19.021697 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:19.023203 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:19.023646 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:19.023649 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:19.023650 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:19.023718 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:19.024013 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:19.024016 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:19.024017 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:19.024251 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:19.024323 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:19.024618 (+ 295us) server_negotiation.cc:299] Negotiation successful
0809 09:27:19.024710 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 09:27:19.025411 3419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:19.017187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57466 (local address 127.11.99.254:39113)
0809 09:27:19.017481 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:19.017485 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:19.017495 (+ 10us) server_negotiation.cc:407] Connection header received
0809 09:27:19.017521 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:19.017523 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:19.017555 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:19.017638 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:19.018186 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.018679 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.019398 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.019610 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.019712 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:19.022135 (+ 2423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:19.022141 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:19.022146 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:19.022175 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:19.023784 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:19.024218 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:19.024220 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:19.024221 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:19.024310 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:19.024604 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:19.024607 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:19.024608 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:19.024795 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:19.025020 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:19.025184 (+ 164us) server_negotiation.cc:299] Negotiation successful
0809 09:27:19.025287 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 09:27:19.025663 3579 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 09:27:19 dist-test-slave-pgkr krb5kdc[3327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267638, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.252@KRBTEST.COM for kudu/127.11.99.252@KRBTEST.COM
Aug 09 09:27:19 dist-test-slave-pgkr krb5kdc[3327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267638, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.253@KRBTEST.COM
I20260809 09:27:19.033161 3584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:19.026129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40363 (local address 127.0.0.1:44064)
0809 09:27:19.026215 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:19.026228 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:27:19.026297 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:27:19.026532 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:27:19.026535 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:27:19.026775 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:27:19.026853 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:19.026858 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.027503 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.027508 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:19.027937 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:19.027943 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.028348 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.028351 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:19.028415 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:19.028809 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:27:19.028821 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:27:19.030107 (+ 1286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:27:19.031721 (+ 1614us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:19.031723 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:19.031742 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:19.031998 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:19.032344 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:19.032346 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:19.032347 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:19.032413 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:19.032739 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:27:19.032741 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:27:19.032815 (+ 74us) client_negotiation.cc:769] Sending connection context
0809 09:27:19.032909 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 09:27:19.033020 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260809 09:27:19.033190 3583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:19.026262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44064 (local address 127.11.99.252:40363)
0809 09:27:19.026363 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:19.026368 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:19.026378 (+ 10us) server_negotiation.cc:407] Connection header received
0809 09:27:19.026402 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:19.026405 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:19.026443 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:19.026522 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:19.026955 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.027410 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.028038 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.028255 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.028349 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:19.030253 (+ 1904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:19.030256 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:19.030257 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:19.030277 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:19.031621 (+ 1344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:19.032110 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:19.032115 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:19.032118 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:19.032203 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:19.032506 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:19.032509 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:19.032510 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:19.032654 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:19.032748 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:19.032948 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 09:27:19.033073 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":36}
I20260809 09:27:19.034417 3499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:19.026712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36704 (local address 127.11.99.253:33505)
0809 09:27:19.026859 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:19.026863 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:19.026876 (+ 13us) server_negotiation.cc:407] Connection header received
0809 09:27:19.026947 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:19.026950 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:19.026991 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:19.027071 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:19.027610 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.028024 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.028689 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.028884 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.028981 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:19.031416 (+ 2435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:19.031419 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:19.031421 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:19.031443 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:19.032788 (+ 1345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:19.033163 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:19.033167 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:19.033169 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:19.033270 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:19.033551 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:19.033555 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:19.033556 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:19.033747 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:19.033904 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:19.034138 (+ 234us) server_negotiation.cc:299] Negotiation successful
0809 09:27:19.034251 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 09:27:19.036424 3495 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } attempt: 3
I20260809 09:27:19.036917 3579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e7a713b88994bd2944b78cbbb698f11: Bootstrap starting.
I20260809 09:27:19.037629 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 09:27:19.039449 3579 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e7a713b88994bd2944b78cbbb698f11: Neither blocks nor log segments found. Creating new log.
I20260809 09:27:19.038982 3383 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "1223a0ede17145cb9dd0e9304665056c"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57466
I20260809 09:27:19.040335 3579 log.cc:824] T 00000000000000000000000000000000 P 3e7a713b88994bd2944b78cbbb698f11: Log is configured to *not* fsync() on all Append() calls
Aug 09 09:27:19 dist-test-slave-pgkr krb5kdc[3327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267638, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.253@KRBTEST.COM for kudu/127.11.99.252@KRBTEST.COM
I20260809 09:27:19.042651 3579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e7a713b88994bd2944b78cbbb698f11: No bootstrap required, opened a new log
I20260809 09:27:19.045066 3497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:19.036757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40363 (local address 127.0.0.1:44076)
0809 09:27:19.036905 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:19.036917 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 09:27:19.036981 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:27:19.037339 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:27:19.037341 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:27:19.037530 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:27:19.037609 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:19.037615 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.038478 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.038481 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:19.039242 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:19.039252 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.039999 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.040003 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:19.040081 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:19.040550 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:27:19.040563 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:27:19.041890 (+ 1327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:27:19.043640 (+ 1750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:19.043643 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:19.043645 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:19.043879 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:19.044120 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:19.044123 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:19.044125 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:19.044211 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:19.044594 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:27:19.044598 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:27:19.044689 (+ 91us) client_negotiation.cc:769] Sending connection context
0809 09:27:19.044792 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 09:27:19.044918 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88}
I20260809 09:27:19.045066 3583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:19.036819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44076 (local address 127.11.99.252:40363)
0809 09:27:19.037132 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:19.037136 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:19.037148 (+ 12us) server_negotiation.cc:407] Connection header received
0809 09:27:19.037177 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:19.037180 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:19.037217 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:19.037301 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:19.037726 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.038356 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.039386 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.039788 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.040302 (+ 514us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:19.042035 (+ 1733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:19.042038 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:19.042041 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:19.042064 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:19.043544 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:19.043975 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:19.043978 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:19.043979 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:19.044042 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:19.044312 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:19.044314 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:19.044315 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:19.044482 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:19.044593 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:19.044849 (+ 256us) server_negotiation.cc:299] Negotiation successful
0809 09:27:19.044945 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230}
I20260809 09:27:19.046744 3579 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3e7a713b88994bd2944b78cbbb698f11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1223a0ede17145cb9dd0e9304665056c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39113 } } peers { permanent_uuid: "51ada85a64ec4a70a0e350e2246b6d16" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33505 } } peers { permanent_uuid: "3e7a713b88994bd2944b78cbbb698f11" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } }
I20260809 09:27:19.046972 3579 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3e7a713b88994bd2944b78cbbb698f11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e7a713b88994bd2944b78cbbb698f11, State: Initialized, Role: FOLLOWER
I20260809 09:27:19.047282 3579 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e7a713b88994bd2944b78cbbb698f11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1223a0ede17145cb9dd0e9304665056c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39113 } } peers { permanent_uuid: "51ada85a64ec4a70a0e350e2246b6d16" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33505 } } peers { permanent_uuid: "3e7a713b88994bd2944b78cbbb698f11" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } }
I20260809 09:27:19.047473 3495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51ada85a64ec4a70a0e350e2246b6d16: Bootstrap starting.
I20260809 09:27:19.047744 3586 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e7a713b88994bd2944b78cbbb698f11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1223a0ede17145cb9dd0e9304665056c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39113 } } peers { permanent_uuid: "51ada85a64ec4a70a0e350e2246b6d16" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33505 } } peers { permanent_uuid: "3e7a713b88994bd2944b78cbbb698f11" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } } }
I20260809 09:27:19.047873 3586 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e7a713b88994bd2944b78cbbb698f11 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:27:19.048451 3579 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3e7a713b88994bd2944b78cbbb698f11 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:27:19.049764 3495 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 51ada85a64ec4a70a0e350e2246b6d16: Neither blocks nor log segments found. Creating new log.
I20260809 09:27:19.050661 3495 log.cc:824] T 00000000000000000000000000000000 P 51ada85a64ec4a70a0e350e2246b6d16: Log is configured to *not* fsync() on all Append() calls
W20260809 09:27:19.053309 3599 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3e7a713b88994bd2944b78cbbb698f11: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260809 09:27:19.053308 3414 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } attempt: 3
W20260809 09:27:19.053436 3599 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 09:27:19.052043 3502 master_runner.cc:186] Error getting master registration for 127.11.99.254:39113: OK, instance_id { permanent_uuid: "1223a0ede17145cb9dd0e9304665056c" instance_seqno: 1786267638589939 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 09:27:19.055655 3502 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 09:27:19.056171 3495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51ada85a64ec4a70a0e350e2246b6d16: No bootstrap required, opened a new log
Aug 09 09:27:19 dist-test-slave-pgkr krb5kdc[3327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267638, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for kudu/127.11.99.252@KRBTEST.COM
I20260809 09:27:19.060410 3495 raft_consensus.cc:348] T 00000000000000000000000000000000 P 51ada85a64ec4a70a0e350e2246b6d16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1223a0ede17145cb9dd0e9304665056c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39113 } } peers { permanent_uuid: "51ada85a64ec4a70a0e350e2246b6d16" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33505 } } peers { permanent_uuid: "3e7a713b88994bd2944b78cbbb698f11" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } }
I20260809 09:27:19.060642 3495 raft_consensus.cc:729] T 00000000000000000000000000000000 P 51ada85a64ec4a70a0e350e2246b6d16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51ada85a64ec4a70a0e350e2246b6d16, State: Initialized, Role: FOLLOWER
I20260809 09:27:19.060997 3495 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51ada85a64ec4a70a0e350e2246b6d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1223a0ede17145cb9dd0e9304665056c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39113 } } peers { permanent_uuid: "51ada85a64ec4a70a0e350e2246b6d16" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33505 } } peers { permanent_uuid: "3e7a713b88994bd2944b78cbbb698f11" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } }
I20260809 09:27:19.061626 3602 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51ada85a64ec4a70a0e350e2246b6d16 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1223a0ede17145cb9dd0e9304665056c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39113 } } peers { permanent_uuid: "51ada85a64ec4a70a0e350e2246b6d16" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33505 } } peers { permanent_uuid: "3e7a713b88994bd2944b78cbbb698f11" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } } }
I20260809 09:27:19.061931 3602 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51ada85a64ec4a70a0e350e2246b6d16 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:27:19.062426 3495 sys_catalog.cc:564] T 00000000000000000000000000000000 P 51ada85a64ec4a70a0e350e2246b6d16 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:27:19.063006 3420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:19.053673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:40363 (local address 127.0.0.1:44080)
0809 09:27:19.053906 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:19.053922 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 09:27:19.054017 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:27:19.054512 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:27:19.054515 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:27:19.054743 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:27:19.054852 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:19.054860 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.055875 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.055878 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:19.056615 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:19.056625 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.057218 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.057221 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:19.057304 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:19.057849 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:27:19.057863 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:27:19.059327 (+ 1464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:27:19.061338 (+ 2011us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:19.061341 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:19.061343 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:19.061593 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:19.061908 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:19.061910 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:19.061912 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:19.062000 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:19.062456 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:27:19.062459 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:27:19.062556 (+ 97us) client_negotiation.cc:769] Sending connection context
0809 09:27:19.062691 (+ 135us) client_negotiation.cc:240] Negotiation successful
0809 09:27:19.062834 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162}
I20260809 09:27:19.063519 3583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:19.054181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44080 (local address 127.11.99.252:40363)
0809 09:27:19.054305 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:19.054309 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:19.054324 (+ 15us) server_negotiation.cc:407] Connection header received
0809 09:27:19.054360 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:19.054363 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:19.054397 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:19.054477 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:19.054996 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.055751 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.056772 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.057094 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.057200 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:19.059454 (+ 2254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:19.059458 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:19.059461 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:19.059486 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:19.061204 (+ 1718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:19.061708 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:19.061711 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:19.061713 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:19.061795 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:19.062124 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:19.062127 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:19.062129 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:19.062318 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:19.062407 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:19.063213 (+ 806us) server_negotiation.cc:299] Negotiation successful
0809 09:27:19.063339 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 09:27:19.066648 3414 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c: Bootstrap starting.
W20260809 09:27:19.067411 3614 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 51ada85a64ec4a70a0e350e2246b6d16: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 09:27:19.067474 3614 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 09:27:19.069047 3414 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c: Neither blocks nor log segments found. Creating new log.
I20260809 09:27:19.069883 3414 log.cc:824] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c: Log is configured to *not* fsync() on all Append() calls
I20260809 09:27:19.065793 3424 master_runner.cc:186] Error getting master registration for 127.11.99.254:39113: OK, instance_id { permanent_uuid: "1223a0ede17145cb9dd0e9304665056c" instance_seqno: 1786267638589939 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 09:27:19.070374 3424 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 09:27:19.072882 3414 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c: No bootstrap required, opened a new log
I20260809 09:27:19.077366 3414 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1223a0ede17145cb9dd0e9304665056c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39113 } } peers { permanent_uuid: "51ada85a64ec4a70a0e350e2246b6d16" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33505 } } peers { permanent_uuid: "3e7a713b88994bd2944b78cbbb698f11" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } }
I20260809 09:27:19.077773 3414 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1223a0ede17145cb9dd0e9304665056c, State: Initialized, Role: FOLLOWER
I20260809 09:27:19.078326 3414 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1223a0ede17145cb9dd0e9304665056c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39113 } } peers { permanent_uuid: "51ada85a64ec4a70a0e350e2246b6d16" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33505 } } peers { permanent_uuid: "3e7a713b88994bd2944b78cbbb698f11" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } }
I20260809 09:27:19.078987 3617 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1223a0ede17145cb9dd0e9304665056c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39113 } } peers { permanent_uuid: "51ada85a64ec4a70a0e350e2246b6d16" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33505 } } peers { permanent_uuid: "3e7a713b88994bd2944b78cbbb698f11" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } } }
I20260809 09:27:19.079155 3617 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:27:19.080375 3383 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 09:27:19.080511 3383 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:27:19.081720 3383 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1223a0ede17145cb9dd0e9304665056c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39113 } } peers { permanent_uuid: "51ada85a64ec4a70a0e350e2246b6d16" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33505 } } peers { permanent_uuid: "3e7a713b88994bd2944b78cbbb698f11" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } }
I20260809 09:27:19.082571 3383 leader_election.cc:288] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c [CANDIDATE]: Term 1 election: Requested vote from peers 51ada85a64ec4a70a0e350e2246b6d16 (127.11.99.253:33505), 3e7a713b88994bd2944b78cbbb698f11 (127.11.99.252:40363)
I20260809 09:27:19.083225 3414 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:27:19.083163 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1223a0ede17145cb9dd0e9304665056c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3e7a713b88994bd2944b78cbbb698f11"
I20260809 09:27:19.083266 3467 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1223a0ede17145cb9dd0e9304665056c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "51ada85a64ec4a70a0e350e2246b6d16"
I20260809 09:27:19.083387 3550 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3e7a713b88994bd2944b78cbbb698f11 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:27:19.083447 3467 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 51ada85a64ec4a70a0e350e2246b6d16 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:27:19.084594 3550 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3e7a713b88994bd2944b78cbbb698f11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1223a0ede17145cb9dd0e9304665056c in term 1.
I20260809 09:27:19.084878 3467 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 51ada85a64ec4a70a0e350e2246b6d16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1223a0ede17145cb9dd0e9304665056c in term 1.
I20260809 09:27:19.085605 3357 leader_election.cc:302] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1223a0ede17145cb9dd0e9304665056c, 3e7a713b88994bd2944b78cbbb698f11; no voters:
I20260809 09:27:19.086055 3617 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c [term 1 FOLLOWER]: Leader election won for term 1
W20260809 09:27:19.087047 3361 tablet.cc:2369] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:27:19.087142 3617 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c [term 1 LEADER]: Becoming Leader. State: Replica: 1223a0ede17145cb9dd0e9304665056c, State: Running, Role: LEADER
I20260809 09:27:19.087427 3617 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1223a0ede17145cb9dd0e9304665056c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39113 } } peers { permanent_uuid: "51ada85a64ec4a70a0e350e2246b6d16" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33505 } } peers { permanent_uuid: "3e7a713b88994bd2944b78cbbb698f11" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } }
I20260809 09:27:19.089010 3617 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1223a0ede17145cb9dd0e9304665056c. Latest consensus state: current_term: 1 leader_uuid: "1223a0ede17145cb9dd0e9304665056c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1223a0ede17145cb9dd0e9304665056c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39113 } } peers { permanent_uuid: "51ada85a64ec4a70a0e350e2246b6d16" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33505 } } peers { permanent_uuid: "3e7a713b88994bd2944b78cbbb698f11" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } } }
I20260809 09:27:19.089102 3617 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c [sys.catalog]: This master's current role is: LEADER
W20260809 09:27:19.093091 3628 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 09:27:19.093211 3628 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 09:27:19.093640 3636 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:27:19.094466 3636 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:27:19.102469 3419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:19.090933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57470 (local address 127.11.99.254:39113)
0809 09:27:19.091029 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:19.091033 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:19.092028 (+ 995us) server_negotiation.cc:407] Connection header received
0809 09:27:19.092287 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:19.092290 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:19.092342 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:19.092396 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:19.095090 (+ 2694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.095832 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.096932 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.097228 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.097293 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:19.099031 (+ 1738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:19.099034 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:19.099037 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:19.099060 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:19.100659 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:19.101135 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:19.101139 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:19.101141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:19.101228 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:19.101536 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:19.101539 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:19.101541 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:19.101744 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:19.101840 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:19.102198 (+ 358us) server_negotiation.cc:299] Negotiation successful
0809 09:27:19.102303 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 09:27:19.108119 3550 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3e7a713b88994bd2944b78cbbb698f11 [term 1 FOLLOWER]: Refusing update from remote peer 1223a0ede17145cb9dd0e9304665056c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:27:19.108485 3467 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 51ada85a64ec4a70a0e350e2246b6d16 [term 1 FOLLOWER]: Refusing update from remote peer 1223a0ede17145cb9dd0e9304665056c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:27:19.108700 3617 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e7a713b88994bd2944b78cbbb698f11" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:27:19.109277 3617 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51ada85a64ec4a70a0e350e2246b6d16" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:27:19.113092 3602 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51ada85a64ec4a70a0e350e2246b6d16 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1223a0ede17145cb9dd0e9304665056c. Latest consensus state: current_term: 1 leader_uuid: "1223a0ede17145cb9dd0e9304665056c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1223a0ede17145cb9dd0e9304665056c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39113 } } peers { permanent_uuid: "51ada85a64ec4a70a0e350e2246b6d16" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33505 } } peers { permanent_uuid: "3e7a713b88994bd2944b78cbbb698f11" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } } }
I20260809 09:27:19.113224 3602 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51ada85a64ec4a70a0e350e2246b6d16 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:27:19.116350 3583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:19.091360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44092 (local address 127.11.99.252:40363)
0809 09:27:19.091460 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:19.091464 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:19.099032 (+ 7568us) server_negotiation.cc:407] Connection header received
0809 09:27:19.099207 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:19.099211 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:19.099263 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:19.099317 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:19.100181 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.100886 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.110794 (+ 9908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.111077 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.111158 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:19.112815 (+ 1657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:19.112820 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:19.112824 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:19.112856 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:19.114511 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:19.115019 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:19.115022 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:19.115023 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:19.115113 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:19.115405 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:19.115411 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:19.115415 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:19.115606 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:19.115708 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:19.116016 (+ 308us) server_negotiation.cc:299] Negotiation successful
0809 09:27:19.116163 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 09:27:19.116647 3586 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e7a713b88994bd2944b78cbbb698f11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1223a0ede17145cb9dd0e9304665056c. Latest consensus state: current_term: 1 leader_uuid: "1223a0ede17145cb9dd0e9304665056c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1223a0ede17145cb9dd0e9304665056c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39113 } } peers { permanent_uuid: "51ada85a64ec4a70a0e350e2246b6d16" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33505 } } peers { permanent_uuid: "3e7a713b88994bd2944b78cbbb698f11" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } } }
I20260809 09:27:19.116772 3586 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e7a713b88994bd2944b78cbbb698f11 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:27:19.120280 3499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:19.092046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36710 (local address 127.11.99.253:33505)
0809 09:27:19.092306 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:19.092310 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:19.102988 (+ 10678us) server_negotiation.cc:407] Connection header received
0809 09:27:19.103140 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:19.103143 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:19.103185 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:19.103231 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:19.104214 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.104912 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.105920 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:19.106237 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:19.106305 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:19.116736 (+ 10431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:19.116741 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:19.116748 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:19.116779 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:19.118480 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:19.118999 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:19.119002 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:19.119003 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:19.119086 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:19.119372 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:19.119375 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:19.119377 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:19.119567 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:19.119688 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:19.120016 (+ 328us) server_negotiation.cc:299] Negotiation successful
0809 09:27:19.120129 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176}
I20260809 09:27:19.122376 3634 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1223a0ede17145cb9dd0e9304665056c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1223a0ede17145cb9dd0e9304665056c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39113 } } peers { permanent_uuid: "51ada85a64ec4a70a0e350e2246b6d16" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33505 } } peers { permanent_uuid: "3e7a713b88994bd2944b78cbbb698f11" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } } }
I20260809 09:27:19.122505 3634 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:19.122678 3641 mvcc.cc:205] Tried to move back new op lower bound from 7316552249781317632 to 7316552249704960000. Current Snapshot: MvccSnapshot[applied={T|T < 7316552249781317632}]
I20260809 09:27:19.123754 3643 mvcc.cc:205] Tried to move back new op lower bound from 7316552249781317632 to 7316552249704960000. Current Snapshot: MvccSnapshot[applied={T|T < 7316552249781317632}]
I20260809 09:27:19.123872 3602 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51ada85a64ec4a70a0e350e2246b6d16 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1223a0ede17145cb9dd0e9304665056c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1223a0ede17145cb9dd0e9304665056c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39113 } } peers { permanent_uuid: "51ada85a64ec4a70a0e350e2246b6d16" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33505 } } peers { permanent_uuid: "3e7a713b88994bd2944b78cbbb698f11" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } } }
I20260809 09:27:19.123973 3602 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51ada85a64ec4a70a0e350e2246b6d16 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:27:19.124509 3634 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1223a0ede17145cb9dd0e9304665056c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1223a0ede17145cb9dd0e9304665056c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39113 } } peers { permanent_uuid: "51ada85a64ec4a70a0e350e2246b6d16" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33505 } } peers { permanent_uuid: "3e7a713b88994bd2944b78cbbb698f11" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } } }
I20260809 09:27:19.124637 3634 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:19.125509 3586 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e7a713b88994bd2944b78cbbb698f11 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1223a0ede17145cb9dd0e9304665056c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1223a0ede17145cb9dd0e9304665056c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 39113 } } peers { permanent_uuid: "51ada85a64ec4a70a0e350e2246b6d16" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 33505 } } peers { permanent_uuid: "3e7a713b88994bd2944b78cbbb698f11" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 40363 } } }
I20260809 09:27:19.125627 3586 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e7a713b88994bd2944b78cbbb698f11 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:27:19.126139 3645 mvcc.cc:205] Tried to move back new op lower bound from 7316552249781317632 to 7316552249704960000. Current Snapshot: MvccSnapshot[applied={T|T < 7316552249781317632}]
I20260809 09:27:19.127842 3636 catalog_manager.cc:1347] Generated new cluster ID: febd19ab87e44b57a96d12889b8d7698
I20260809 09:27:19.127902 3636 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:27:19.146708 3636 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:27:19.147778 3636 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:27:19.167620 3636 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1223a0ede17145cb9dd0e9304665056c: Generated new TSK 0
I20260809 09:27:19.168346 3636 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 09:27:19.199563 3583 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:27:19.196804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44102 (local address 127.11.99.252:40363)
0809 09:27:19.196918 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:19.196924 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:19.198490 (+ 1566us) server_negotiation.cc:407] Connection header received
0809 09:27:19.198711 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:19.198715 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:19.198763 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:19.198810 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:19.199439 (+ 629us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44102: BlockingRecv error: recv got EOF from 127.0.0.1:44102 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260809 09:27:19.200907 3419 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:27:19.197431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57478 (local address 127.11.99.254:39113)
0809 09:27:19.197530 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:19.197534 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:19.200021 (+ 2487us) server_negotiation.cc:407] Connection header received
0809 09:27:19.200185 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:19.200189 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:19.200235 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:19.200284 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:19.200799 (+ 515us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57478: BlockingRecv error: recv got EOF from 127.0.0.1:57478 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260809 09:27:19.202164 3499 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:27:19.197988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36712 (local address 127.11.99.253:33505)
0809 09:27:19.198090 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:19.198095 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:19.201327 (+ 3232us) server_negotiation.cc:407] Connection header received
0809 09:27:19.201481 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:19.201484 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:19.201530 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:19.201576 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:19.202059 (+ 483us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36712: BlockingRecv error: recv got EOF from 127.0.0.1:36712 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260809 09:27:19.206167 3499 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:27:19.204833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36724 (local address 127.11.99.253:33505)
0809 09:27:19.204920 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:19.204924 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:19.205322 (+ 398us) server_negotiation.cc:407] Connection header received
0809 09:27:19.205500 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:19.205503 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:19.205565 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:19.205621 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:19.206084 (+ 463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36724: BlockingRecv error: recv got EOF from 127.0.0.1:36724 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260809 09:27:19.210582 3499 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:27:19.209291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36736 (local address 127.11.99.253:33505)
0809 09:27:19.209373 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:19.209377 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:19.209816 (+ 439us) server_negotiation.cc:407] Connection header received
0809 09:27:19.209981 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:19.209984 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:19.210042 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:19.210087 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:19.210506 (+ 419us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36736: BlockingRecv error: recv got EOF from 127.0.0.1:36736 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
W20260809 09:27:19.215824 3499 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:27:19.214472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36752 (local address 127.11.99.253:33505)
0809 09:27:19.214558 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:19.214561 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:19.215066 (+ 505us) server_negotiation.cc:407] Connection header received
0809 09:27:19.215225 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:19.215228 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:19.215267 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:19.215312 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:19.215750 (+ 438us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36752: BlockingRecv error: recv got EOF from 127.0.0.1:36752 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260809 09:27:19.225862 3499 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:27:19.224413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36758 (local address 127.11.99.253:33505)
0809 09:27:19.224535 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:19.224540 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:19.225012 (+ 472us) server_negotiation.cc:407] Connection header received
0809 09:27:19.225191 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:19.225194 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:19.225239 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:19.225288 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:19.225775 (+ 487us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36758: BlockingRecv error: recv got EOF from 127.0.0.1:36758 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260809 09:27:19.237797 3499 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:27:19.236189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36772 (local address 127.11.99.253:33505)
0809 09:27:19.236317 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:19.236324 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:19.236834 (+ 510us) server_negotiation.cc:407] Connection header received
0809 09:27:19.237053 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:19.237057 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:19.237106 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:19.237156 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:19.237696 (+ 540us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36772: BlockingRecv error: recv got EOF from 127.0.0.1:36772 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260809 09:27:19.259459 3499 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:27:19.257848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36784 (local address 127.11.99.253:33505)
0809 09:27:19.257971 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:19.257975 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:19.258353 (+ 378us) server_negotiation.cc:407] Connection header received
0809 09:27:19.258591 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:19.258595 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:19.258677 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:19.258738 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:19.259348 (+ 610us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36784: BlockingRecv error: recv got EOF from 127.0.0.1:36784 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260809 09:27:19.295358 3499 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:27:19.293941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36796 (local address 127.11.99.253:33505)
0809 09:27:19.294072 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:19.294076 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:19.294355 (+ 279us) server_negotiation.cc:407] Connection header received
0809 09:27:19.294489 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:19.294493 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:19.294552 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:19.294662 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:19.295249 (+ 587us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36796: BlockingRecv error: recv got EOF from 127.0.0.1:36796 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260809 09:27:19.362730 3499 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:27:19.361381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36812 (local address 127.11.99.253:33505)
0809 09:27:19.361572 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:19.361576 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:19.361704 (+ 128us) server_negotiation.cc:407] Connection header received
0809 09:27:19.361955 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:19.361961 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:19.362023 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:19.362128 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:19.362588 (+ 460us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36812: BlockingRecv error: recv got EOF from 127.0.0.1:36812 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260809 09:27:19.494241 3499 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:27:19.492974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36816 (local address 127.11.99.253:33505)
0809 09:27:19.493131 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:19.493136 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:19.493290 (+ 154us) server_negotiation.cc:407] Connection header received
0809 09:27:19.493480 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:19.493482 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:19.493531 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:19.493625 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:19.494113 (+ 488us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36816: BlockingRecv error: recv got EOF from 127.0.0.1:36816 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260809 09:27:19.753516 3499 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:27:19.752419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36818 (local address 127.11.99.253:33505)
0809 09:27:19.752575 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:19.752582 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:19.752691 (+ 109us) server_negotiation.cc:407] Connection header received
0809 09:27:19.752843 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:19.752845 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:19.752894 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:19.752966 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:19.753393 (+ 427us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36818: BlockingRecv error: recv got EOF from 127.0.0.1:36818 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 09:27:20.054855 3599 catalog_manager.cc:1259] Loaded cluster ID: febd19ab87e44b57a96d12889b8d7698
I20260809 09:27:20.054950 3599 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3e7a713b88994bd2944b78cbbb698f11: loading cluster ID for follower catalog manager: success
I20260809 09:27:20.056633 3599 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3e7a713b88994bd2944b78cbbb698f11: acquiring CA information for follower catalog manager: success
I20260809 09:27:20.057827 3599 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3e7a713b88994bd2944b78cbbb698f11: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 09:27:20.068681 3614 catalog_manager.cc:1259] Loaded cluster ID: febd19ab87e44b57a96d12889b8d7698
I20260809 09:27:20.068745 3614 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 51ada85a64ec4a70a0e350e2246b6d16: loading cluster ID for follower catalog manager: success
I20260809 09:27:20.070395 3614 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 51ada85a64ec4a70a0e350e2246b6d16: acquiring CA information for follower catalog manager: success
I20260809 09:27:20.071571 3614 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 51ada85a64ec4a70a0e350e2246b6d16: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 09:27:20.271472 3719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:20.267639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36822 (local address 127.11.99.253:33505)
0809 09:27:20.267891 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:20.267895 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:20.267948 (+ 53us) server_negotiation.cc:407] Connection header received
0809 09:27:20.268076 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:20.268078 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:20.268201 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:20.268307 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:27:20.268543 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:20.269147 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:20.270047 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:20.270263 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:20.270378 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:20.270725 (+ 347us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:27:20.271170 (+ 445us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:27:20.271261 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:20.271312 (+ 51us) server_negotiation.cc:299] Negotiation successful
0809 09:27:20.271356 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":106,"threads_started":1}
I20260809 09:27:20.277946 3726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:20.274528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44108 (local address 127.11.99.252:40363)
0809 09:27:20.274777 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:20.274781 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:20.274810 (+ 29us) server_negotiation.cc:407] Connection header received
0809 09:27:20.275034 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:20.275036 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:20.275141 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:20.275268 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:27:20.275477 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:20.275965 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:20.276719 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:20.276928 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:20.277004 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:20.277231 (+ 227us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:27:20.277569 (+ 338us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:27:20.277653 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:20.277709 (+ 56us) server_negotiation.cc:299] Negotiation successful
0809 09:27:20.277757 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":107,"threads_started":1}
I20260809 09:27:20.285387 3719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:20.281189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36830 (local address 127.11.99.253:33505)
0809 09:27:20.281301 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:20.281307 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:20.281320 (+ 13us) server_negotiation.cc:407] Connection header received
0809 09:27:20.281455 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:20.281458 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:20.281508 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:20.281572 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:27:20.281922 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:20.282378 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:20.283865 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:20.284239 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:20.284350 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:20.284845 (+ 495us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:27:20.284924 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:27:20.285025 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:20.285171 (+ 146us) server_negotiation.cc:299] Negotiation successful
0809 09:27:20.285230 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 09:27:20.285456 3732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:20.280708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57484 (local address 127.11.99.254:39113)
0809 09:27:20.280988 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:20.280994 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:20.281011 (+ 17us) server_negotiation.cc:407] Connection header received
0809 09:27:20.281208 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:20.281215 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:20.281368 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:20.281511 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:27:20.281735 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:20.282522 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:20.283888 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:20.284173 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:20.284577 (+ 404us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:20.284685 (+ 108us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:27:20.285017 (+ 332us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:27:20.285092 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:20.285223 (+ 131us) server_negotiation.cc:299] Negotiation successful
0809 09:27:20.285279 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":69,"threads_started":1}
I20260809 09:27:20.285806 3726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:20.280816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44112 (local address 127.11.99.252:40363)
0809 09:27:20.280975 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:20.280979 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:20.281366 (+ 387us) server_negotiation.cc:407] Connection header received
0809 09:27:20.281410 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:20.281416 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:20.281485 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:20.281545 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:27:20.281966 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:20.282722 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:20.283920 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:20.284261 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:20.284345 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:20.284841 (+ 496us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:27:20.284909 (+ 68us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:27:20.284986 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:20.285363 (+ 377us) server_negotiation.cc:299] Negotiation successful
0809 09:27:20.285417 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260809 09:27:20.293795 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 3340
I20260809 09:27:20.302352 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 3424
I20260809 09:27:20.309000 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 3502
2026-08-09T09:27:20Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3039 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 09:27:20 dist-test-slave-pgkr krb5kdc[3738](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 09:27:20 dist-test-slave-pgkr krb5kdc[3738](info): set up 2 sockets
Aug 09 09:27:20 dist-test-slave-pgkr krb5kdc[3738](info): commencing operation
krb5kdc: starting...
W20260809 09:27:21.354498 11663 mini_kdc.cc:121] Time spent starting KDC: real 1.023s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/krb5kdc/test-user.keytab.
Aug 09 09:27:21 dist-test-slave-pgkr krb5kdc[3738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T09:27:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T09:27:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.99.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
Entry for principal kudu/127.11.99.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab.
I20260809 09:27:21.467789 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:34573
--webserver_interface=127.11.99.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:42083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:34573,127.11.99.253:37491,127.11.99.252:45125
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 09:27:21.576573 3751 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 09:27:21.576843 3751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:27:21.576865 3751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:27:21.576941 3751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:27:21.580878 3751 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:27:21.580927 3751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:27:21.580946 3751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:27:21.580962 3751 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:27:21.580977 3751 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:27:21.586134 3751 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:42083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:34573,127.11.99.253:37491,127.11.99.252:45125
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.254.keytab
--principal=kudu/127.11.99.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.254:34573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.99.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:27:21.587291 3751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:27:21.588304 3751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:27:21.596699 3760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:21.596715 3757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:21.596719 3758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:21.596901 3751 server_base.cc:1034] running on GCE node
I20260809 09:27:21.597525 3751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:27:21.598584 3751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:27:21.599815 3751 hybrid_clock.cc:648] HybridClock initialized: now 1786267641599803 us; error 37 us; skew 500 ppm
Aug 09 09:27:21 dist-test-slave-pgkr krb5kdc[3738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267641, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:27:21.602542 3751 init.cc:377] Logged in from keytab as kudu/127.11.99.254@KRBTEST.COM (short username kudu)
I20260809 09:27:21.603438 3751 webserver.cc:460] Webserver started at http://127.11.99.254:34719/ using document root <none> and password file <none>
I20260809 09:27:21.603961 3751 fs_manager.cc:359] Metadata directory not provided
I20260809 09:27:21.604027 3751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:27:21.604192 3751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:27:21.606127 3751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-0/data/instance:
uuid: "c5716666a1554a7e868db3a7c14b2c9c"
format_stamp: "Formatted at 2026-08-09 09:27:21 on dist-test-slave-pgkr"
server_key: "4203838a62b005e3e6001f666128f801"
server_key_iv: "8b5f10c44517b4544aead88862392231"
server_key_version: "encryptionkey@0"
I20260809 09:27:21.606707 3751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-0/wal/instance:
uuid: "c5716666a1554a7e868db3a7c14b2c9c"
format_stamp: "Formatted at 2026-08-09 09:27:21 on dist-test-slave-pgkr"
server_key: "4203838a62b005e3e6001f666128f801"
server_key_iv: "8b5f10c44517b4544aead88862392231"
server_key_version: "encryptionkey@0"
I20260809 09:27:21.610142 3751 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 09:27:21.612442 3767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:27:21.613736 3751 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 09:27:21.613842 3751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-0/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-0/wal
uuid: "c5716666a1554a7e868db3a7c14b2c9c"
format_stamp: "Formatted at 2026-08-09 09:27:21 on dist-test-slave-pgkr"
server_key: "4203838a62b005e3e6001f666128f801"
server_key_iv: "8b5f10c44517b4544aead88862392231"
server_key_version: "encryptionkey@0"
I20260809 09:27:21.613924 3751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:27:21.638170 3751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:27:21.641371 3751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:27:21.641587 3751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:27:21.648440 3751 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.254:34573
I20260809 09:27:21.648744 3823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.254:34573 every 8 connection(s)
I20260809 09:27:21.649401 3751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-0/data/info.pb
I20260809 09:27:21.652154 3824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:27:21.653618 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 3751
I20260809 09:27:21.653725 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-0/wal/instance
I20260809 09:27:21.654052 11663 external_mini_cluster.cc:1428] Setting key 6829a9a0489a2fc9cc2a354c4b02d22b
I20260809 09:27:21.656013 3824 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34573 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.99.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.253@KRBTEST.COM" created.
Aug 09 09:27:21 dist-test-slave-pgkr krb5kdc[3738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267641, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:27:21.671237 3827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:21.658533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34573 (local address 127.0.0.1:40718)
0809 09:27:21.659122 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:21.659177 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 09:27:21.659955 (+ 778us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:27:21.660614 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:27:21.660619 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:27:21.661050 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:27:21.661269 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:21.661282 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:21.662396 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:21.662399 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:21.663204 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:21.663213 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:21.663846 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:21.663850 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:21.663967 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:21.664480 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:27:21.664496 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:27:21.666291 (+ 1795us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:27:21.668306 (+ 2015us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:21.668316 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:21.668325 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:21.668570 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:21.668905 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:21.668907 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:21.668909 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:21.669018 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:21.669588 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:27:21.669594 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:27:21.669726 (+ 132us) client_negotiation.cc:769] Sending connection context
0809 09:27:21.669882 (+ 156us) client_negotiation.cc:240] Negotiation successful
0809 09:27:21.670270 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"mutex_wait_us":109,"thread_start_us":152,"threads_started":1}
I20260809 09:27:21.671237 3828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:21.658532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40718 (local address 127.11.99.254:34573)
0809 09:27:21.659104 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:21.659121 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:21.659281 (+ 160us) server_negotiation.cc:407] Connection header received
0809 09:27:21.660251 (+ 970us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:21.660255 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:21.660433 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:21.660618 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:21.661422 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:21.662270 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:21.663335 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:21.663690 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:21.663868 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:21.666449 (+ 2581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:21.666454 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:21.666463 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:21.666485 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:21.668183 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:21.668689 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:21.668694 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:21.668696 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:21.668806 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:21.669126 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:21.669129 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:21.669130 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:21.669476 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:21.669615 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:21.669955 (+ 340us) server_negotiation.cc:299] Negotiation successful
0809 09:27:21.670193 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":475,"spinlock_wait_cycles":33152,"thread_start_us":191,"threads_started":1}
I20260809 09:27:21.673646 3824 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.253" port: 37491 } has no permanent_uuid. Determining permanent_uuid...
I20260809 09:27:21.674471 3827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:21.674137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:37491 (local address 127.0.0.1:50456)
0809 09:27:21.674280 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:21.674380 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.253:37491: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260809 09:27:21.674710 3771 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.99.253:37491: connect: Connection refused (error 111)
I20260809 09:27:21.675642 3827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:21.675406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:37491 (local address 127.0.0.1:50462)
0809 09:27:21.675525 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:21.675579 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.253:37491: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 09:27:21.675803 3824 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.253:37491: Network error: Client connection negotiation failed: client connection to 127.11.99.253:37491: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.253.keytab.
Entry for principal kudu/127.11.99.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.253.keytab.
I20260809 09:27:21.680966 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.253:37491
--webserver_interface=127.11.99.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.253.keytab
--principal=kudu/127.11.99.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:42083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:34573,127.11.99.253:37491,127.11.99.252:45125
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 09:27:21.725121 3824 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.253" port: 37491 } attempt: 1
I20260809 09:27:21.726029 3827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:21.725672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:37491 (local address 127.0.0.1:50476)
0809 09:27:21.725857 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:21.725935 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.253:37491: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260809 09:27:21.726895 3827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:21.726665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:37491 (local address 127.0.0.1:50488)
0809 09:27:21.726773 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:21.726828 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.253:37491: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260809 09:27:21.727047 3824 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.253:37491: Network error: Client connection negotiation failed: client connection to 127.11.99.253:37491: connect: Connection refused (error 111)
W20260809 09:27:21.788594 3831 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 09:27:21.788901 3831 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:27:21.788971 3831 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:27:21.789048 3831 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:27:21.792906 3831 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:27:21.792984 3831 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:27:21.793020 3831 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:27:21.793057 3831 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:27:21.793095 3831 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:27:21.795217 3824 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.253" port: 37491 } attempt: 2
I20260809 09:27:21.796030 3827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:21.795682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:37491 (local address 127.0.0.1:50490)
0809 09:27:21.795851 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:21.795919 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.253:37491: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 09:27:21.796700 3827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:21.796493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:37491 (local address 127.0.0.1:50498)
0809 09:27:21.796599 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:21.796646 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.253:37491: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 09:27:21.796900 3824 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.253:37491: Network error: Client connection negotiation failed: client connection to 127.11.99.253:37491: connect: Connection refused (error 111)
I20260809 09:27:21.798481 3831 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:42083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:34573,127.11.99.253:37491,127.11.99.252:45125
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.253.keytab
--principal=kudu/127.11.99.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.253:37491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.99.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3831
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:27:21.799437 3831 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:27:21.800350 3831 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 09:27:21.808506 3839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:21.808548 3837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:21.808548 3836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:21.808817 3831 server_base.cc:1034] running on GCE node
I20260809 09:27:21.809414 3831 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:27:21.810389 3831 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:27:21.811586 3831 hybrid_clock.cc:648] HybridClock initialized: now 1786267641811569 us; error 31 us; skew 500 ppm
Aug 09 09:27:21 dist-test-slave-pgkr krb5kdc[3738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267641, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:27:21.814141 3831 init.cc:377] Logged in from keytab as kudu/127.11.99.253@KRBTEST.COM (short username kudu)
I20260809 09:27:21.815013 3831 webserver.cc:460] Webserver started at http://127.11.99.253:33497/ using document root <none> and password file <none>
I20260809 09:27:21.815521 3831 fs_manager.cc:359] Metadata directory not provided
I20260809 09:27:21.815611 3831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:27:21.815821 3831 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:27:21.817683 3831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-1/data/instance:
uuid: "1366167f92154bc48043c549688bf9a6"
format_stamp: "Formatted at 2026-08-09 09:27:21 on dist-test-slave-pgkr"
server_key: "bd62b0606ccff4413eea08bd7c4ed21f"
server_key_iv: "823ebefd2e88423ba85611565f821f76"
server_key_version: "encryptionkey@0"
I20260809 09:27:21.818223 3831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-1/wal/instance:
uuid: "1366167f92154bc48043c549688bf9a6"
format_stamp: "Formatted at 2026-08-09 09:27:21 on dist-test-slave-pgkr"
server_key: "bd62b0606ccff4413eea08bd7c4ed21f"
server_key_iv: "823ebefd2e88423ba85611565f821f76"
server_key_version: "encryptionkey@0"
I20260809 09:27:21.821656 3831 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 09:27:21.823925 3846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:27:21.824998 3831 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 09:27:21.825134 3831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-1/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-1/wal
uuid: "1366167f92154bc48043c549688bf9a6"
format_stamp: "Formatted at 2026-08-09 09:27:21 on dist-test-slave-pgkr"
server_key: "bd62b0606ccff4413eea08bd7c4ed21f"
server_key_iv: "823ebefd2e88423ba85611565f821f76"
server_key_version: "encryptionkey@0"
I20260809 09:27:21.825237 3831 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:27:21.837126 3831 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:27:21.839706 3831 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:27:21.839905 3831 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:27:21.846521 3831 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.253:37491
I20260809 09:27:21.846864 3904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.253:37491 every 8 connection(s)
I20260809 09:27:21.847498 3831 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-1/data/info.pb
I20260809 09:27:21.850140 3905 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:27:21.853708 3905 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34573 } has no permanent_uuid. Determining permanent_uuid...
I20260809 09:27:21.857002 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 3831
I20260809 09:27:21.857151 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-1/wal/instance
I20260809 09:27:21.857411 11663 external_mini_cluster.cc:1428] Setting key 97489a4a46e5de6b14c022975664f835
Aug 09 09:27:21 dist-test-slave-pgkr krb5kdc[3738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267641, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.253@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.99.252@KRBTEST.COM; defaulting to no policy
I20260809 09:27:21.866725 3828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:21.855479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40732 (local address 127.11.99.254:34573)
0809 09:27:21.855639 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:21.855643 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:21.856281 (+ 638us) server_negotiation.cc:407] Connection header received
0809 09:27:21.857164 (+ 883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:21.857168 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:21.857239 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:21.857342 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:21.858481 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:21.859085 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:21.860234 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:21.860483 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:21.860617 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:21.863077 (+ 2460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:21.863086 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:21.863088 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:21.863112 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:21.864686 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:21.865215 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:21.865220 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:21.865221 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:21.865304 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:21.865641 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:21.865645 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:21.865646 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:21.865820 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:21.865925 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:21.866400 (+ 475us) server_negotiation.cc:299] Negotiation successful
0809 09:27:21.866528 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 09:27:21.867412 3907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:21.855720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34573 (local address 127.0.0.1:40732)
0809 09:27:21.856130 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:21.856171 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 09:27:21.856935 (+ 764us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:27:21.857514 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:27:21.857524 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:27:21.857856 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:27:21.858300 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:21.858312 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:21.859235 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:21.859237 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:21.860070 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:21.860080 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:21.860646 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:21.860652 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:21.860832 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:21.861420 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:27:21.861436 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:27:21.862899 (+ 1463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:27:21.864830 (+ 1931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:21.864835 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:21.864847 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:21.865106 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:21.865404 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:21.865407 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:21.865409 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:21.865544 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:21.865924 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:27:21.865930 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:27:21.866167 (+ 237us) client_negotiation.cc:769] Sending connection context
0809 09:27:21.866345 (+ 178us) client_negotiation.cc:240] Negotiation successful
0809 09:27:21.866650 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":102,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.99.252@KRBTEST.COM" created.
I20260809 09:27:21.868664 3905 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.253" port: 37491 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 09:27:21 dist-test-slave-pgkr krb5kdc[3738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267641, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.253@KRBTEST.COM for kudu/127.11.99.253@KRBTEST.COM
I20260809 09:27:21.878156 3907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:21.869153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:37491 (local address 127.0.0.1:50504)
0809 09:27:21.869293 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:21.869322 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 09:27:21.869402 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:27:21.869983 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:27:21.869987 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:27:21.870170 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:27:21.870303 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:21.870313 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:21.871709 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:21.871712 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:21.872228 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:21.872248 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:21.872857 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:21.872860 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:21.872985 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:21.873499 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:27:21.873525 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:27:21.874683 (+ 1158us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:27:21.876473 (+ 1790us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:21.876476 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:21.876478 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:21.876670 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:21.876937 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:21.876959 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:21.876961 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:21.877042 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:21.877454 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:27:21.877456 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:27:21.877603 (+ 147us) client_negotiation.cc:769] Sending connection context
0809 09:27:21.877810 (+ 207us) client_negotiation.cc:240] Negotiation successful
0809 09:27:21.877950 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"mutex_wait_us":20}
I20260809 09:27:21.878206 3911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:21.869259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50504 (local address 127.11.99.253:37491)
0809 09:27:21.869644 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:21.869652 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:21.869669 (+ 17us) server_negotiation.cc:407] Connection header received
0809 09:27:21.869701 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:21.869705 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:21.869854 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:21.869965 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:21.870431 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:21.871598 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:21.872360 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:21.872730 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:21.872860 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:21.874814 (+ 1954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:21.874844 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:21.874853 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:21.874877 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:21.876348 (+ 1471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:21.876770 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:21.876774 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:21.876776 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:21.876848 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:21.877135 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:21.877138 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:21.877140 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:21.877346 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:21.877475 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:21.877910 (+ 435us) server_negotiation.cc:299] Negotiation successful
0809 09:27:21.878034 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":309,"thread_start_us":126,"threads_started":1}
I20260809 09:27:21.879972 3905 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } has no permanent_uuid. Determining permanent_uuid...
I20260809 09:27:21.880645 3907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:21.880412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:45125 (local address 127.0.0.1:39882)
0809 09:27:21.880526 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:21.880591 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:45125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260809 09:27:21.880882 3847 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.99.252:45125: connect: Connection refused (error 111)
I20260809 09:27:21.881719 3907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:21.881512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:45125 (local address 127.0.0.1:39886)
0809 09:27:21.881601 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:21.881642 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:45125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 09:27:21.881946 3905 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.252:45125: Network error: Client connection negotiation failed: client connection to 127.11.99.252:45125: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.99.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.252.keytab.
Entry for principal kudu/127.11.99.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.252.keytab.
I20260809 09:27:21.883496 11663 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
/tmp/dist-test-taskv_EQJC/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.252:45125
--webserver_interface=127.11.99.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.252.keytab
--principal=kudu/127.11.99.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.99.212:42083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.99.254:34573,127.11.99.253:37491,127.11.99.252:45125
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 09:27:21.888053 3824 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.253" port: 37491 } attempt: 3
Aug 09 09:27:21 dist-test-slave-pgkr krb5kdc[3738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267641, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for kudu/127.11.99.253@KRBTEST.COM
I20260809 09:27:21.896677 3827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:21.888506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:37491 (local address 127.0.0.1:50516)
0809 09:27:21.888639 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:21.888654 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 09:27:21.888788 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:27:21.889037 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:27:21.889040 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:27:21.889236 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:27:21.889339 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:21.889344 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:21.890047 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:21.890051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:21.891257 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:21.891267 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:21.891703 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:21.891706 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:21.891807 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:21.892252 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:27:21.892263 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:27:21.893439 (+ 1176us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:27:21.895094 (+ 1655us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:21.895099 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:21.895101 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:21.895292 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:21.895702 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:21.895706 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:21.895708 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:21.895799 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:21.896164 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:27:21.896167 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:27:21.896278 (+ 111us) client_negotiation.cc:769] Sending connection context
0809 09:27:21.896385 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 09:27:21.896524 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260809 09:27:21.896677 3911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:21.888536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50516 (local address 127.11.99.253:37491)
0809 09:27:21.888639 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:21.888644 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:21.888753 (+ 109us) server_negotiation.cc:407] Connection header received
0809 09:27:21.888895 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:21.888897 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:21.888942 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:21.889018 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:21.889448 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:21.889931 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:21.891375 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:21.891597 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:21.891701 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:21.893591 (+ 1890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:21.893594 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:21.893596 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:21.893624 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:21.894987 (+ 1363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:21.895490 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:21.895497 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:21.895500 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:21.895592 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:21.895892 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:21.895897 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:21.895899 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:21.896064 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:21.896172 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:21.896436 (+ 264us) server_negotiation.cc:299] Negotiation successful
0809 09:27:21.896537 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 09:27:21.897948 3824 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } has no permanent_uuid. Determining permanent_uuid...
I20260809 09:27:21.898568 3827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:21.898372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:45125 (local address 127.0.0.1:39896)
0809 09:27:21.898477 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:21.898519 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:45125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 09:27:21.899328 3827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:21.899111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:45125 (local address 127.0.0.1:39904)
0809 09:27:21.899249 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:21.899286 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:45125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260809 09:27:21.899477 3824 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.252:45125: Network error: Client connection negotiation failed: client connection to 127.11.99.252:45125: connect: Connection refused (error 111)
I20260809 09:27:21.930627 3824 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } attempt: 1
I20260809 09:27:21.931195 3905 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } attempt: 1
I20260809 09:27:21.931519 3827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:21.931182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:45125 (local address 127.0.0.1:39906)
0809 09:27:21.931377 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:21.931446 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:45125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260809 09:27:21.931907 3907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:21.931603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:45125 (local address 127.0.0.1:39910)
0809 09:27:21.931754 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:21.931816 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:45125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 09:27:21.932674 3907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:21.932447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:45125 (local address 127.0.0.1:39920)
0809 09:27:21.932549 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:21.932599 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:45125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 09:27:21.932701 3827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:21.932187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:45125 (local address 127.0.0.1:39914)
0809 09:27:21.932588 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:21.932632 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:45125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260809 09:27:21.932804 3905 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.252:45125: Network error: Client connection negotiation failed: client connection to 127.11.99.252:45125: connect: Connection refused (error 111)
W20260809 09:27:21.932901 3824 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.252:45125: Network error: Client connection negotiation failed: client connection to 127.11.99.252:45125: connect: Connection refused (error 111)
W20260809 09:27:21.991176 3913 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 09:27:21.991465 3913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 09:27:21.991561 3913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 09:27:21.991644 3913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 09:27:21.995548 3913 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 09:27:21.995621 3913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 09:27:21.995661 3913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 09:27:21.995718 3913 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 09:27:21.995759 3913 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 09:27:22.000523 3913 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.99.212:42083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.99.254:34573,127.11.99.253:37491,127.11.99.252:45125
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/krb5kdc/kudu_127.11.99.252.keytab
--principal=kudu/127.11.99.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.99.252:45125
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.99.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3913
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 08:38:55 UTC on ccycloud.quasar-njjleu.root.comops.site
build id 4575935
I20260809 09:27:22.000958 3905 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } attempt: 2
I20260809 09:27:22.001525 3913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 09:27:22.001760 3907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:22.001474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:45125 (local address 127.0.0.1:39924)
0809 09:27:22.001611 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:22.001679 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:45125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260809 09:27:22.002489 3907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:22.002296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:45125 (local address 127.0.0.1:39928)
0809 09:27:22.002396 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:22.002437 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:45125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 09:27:22.002606 3905 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.252:45125: Network error: Client connection negotiation failed: client connection to 127.11.99.252:45125: connect: Connection refused (error 111)
I20260809 09:27:22.002664 3913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 09:27:22.008065 3824 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } attempt: 2
I20260809 09:27:22.008865 3827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:22.008609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:45125 (local address 127.0.0.1:39934)
0809 09:27:22.008738 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:22.008797 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:45125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 09:27:22.009624 3827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:22.009373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:45125 (local address 127.0.0.1:39942)
0809 09:27:22.009494 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:22.009572 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.99.252:45125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260809 09:27:22.009791 3824 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.99.252:45125: Network error: Client connection negotiation failed: client connection to 127.11.99.252:45125: connect: Connection refused (error 111)
W20260809 09:27:22.011413 3919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:22.011413 3921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 09:27:22.011438 3918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 09:27:22.011684 3913 server_base.cc:1034] running on GCE node
I20260809 09:27:22.012317 3913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 09:27:22.013334 3913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 09:27:22.014533 3913 hybrid_clock.cc:648] HybridClock initialized: now 1786267642014496 us; error 36 us; skew 500 ppm
Aug 09 09:27:22 dist-test-slave-pgkr krb5kdc[3738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267642, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 09:27:22.017112 3913 init.cc:377] Logged in from keytab as kudu/127.11.99.252@KRBTEST.COM (short username kudu)
I20260809 09:27:22.018005 3913 webserver.cc:460] Webserver started at http://127.11.99.252:39549/ using document root <none> and password file <none>
I20260809 09:27:22.018539 3913 fs_manager.cc:359] Metadata directory not provided
I20260809 09:27:22.018649 3913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 09:27:22.018869 3913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 09:27:22.020726 3913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-2/data/instance:
uuid: "eb462531b67d49dbaed7889e11a19e4d"
format_stamp: "Formatted at 2026-08-09 09:27:22 on dist-test-slave-pgkr"
server_key: "5ea197868da89e6dedfecd2b83a6c604"
server_key_iv: "6d944c7efef591cab204496f90e88e07"
server_key_version: "encryptionkey@0"
I20260809 09:27:22.021240 3913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-2/wal/instance:
uuid: "eb462531b67d49dbaed7889e11a19e4d"
format_stamp: "Formatted at 2026-08-09 09:27:22 on dist-test-slave-pgkr"
server_key: "5ea197868da89e6dedfecd2b83a6c604"
server_key_iv: "6d944c7efef591cab204496f90e88e07"
server_key_version: "encryptionkey@0"
I20260809 09:27:22.024580 3913 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 09:27:22.026669 3929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 09:27:22.027690 3913 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 09:27:22.027799 3913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-2/data,/tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-2/wal
uuid: "eb462531b67d49dbaed7889e11a19e4d"
format_stamp: "Formatted at 2026-08-09 09:27:22 on dist-test-slave-pgkr"
server_key: "5ea197868da89e6dedfecd2b83a6c604"
server_key_iv: "6d944c7efef591cab204496f90e88e07"
server_key_version: "encryptionkey@0"
I20260809 09:27:22.027894 3913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 09:27:22.044792 3913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 09:27:22.047238 3913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 09:27:22.047417 3913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 09:27:22.053738 3913 rpc_server.cc:307] RPC server started. Bound to: 127.11.99.252:45125
I20260809 09:27:22.054041 3985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.99.252:45125 every 8 connection(s)
I20260809 09:27:22.054718 3913 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-2/data/info.pb
I20260809 09:27:22.057271 3986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 09:27:22.059388 11663 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu as pid 3913
I20260809 09:27:22.059508 11663 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskv_EQJC/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786267363058776-11663-0/minicluster-data/master-2/wal/instance
I20260809 09:27:22.059811 11663 external_mini_cluster.cc:1428] Setting key 748bbdaca782b447c7d4e701a98cec2e
I20260809 09:27:22.061291 3986 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34573 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 09:27:22 dist-test-slave-pgkr krb5kdc[3738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267642, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.252@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
Aug 09 09:27:22 dist-test-slave-pgkr krb5kdc[3738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.252@KRBTEST.COM
I20260809 09:27:22.072211 3828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:22.062901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40742 (local address 127.11.99.254:34573)
0809 09:27:22.063022 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:22.063026 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:22.063294 (+ 268us) server_negotiation.cc:407] Connection header received
0809 09:27:22.063517 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:22.063522 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:22.063584 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:22.063675 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:22.064329 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.064847 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.065773 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.065987 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.066101 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:22.068612 (+ 2511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:22.068615 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:22.068617 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:22.068639 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:22.070161 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:22.070753 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:22.070761 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:22.070762 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:22.070840 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:22.071170 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:22.071174 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:22.071176 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:22.071379 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:22.071483 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:22.071929 (+ 446us) server_negotiation.cc:299] Negotiation successful
0809 09:27:22.072047 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 09:27:22.073004 3990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:22.062827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.254:34573 (local address 127.0.0.1:40742)
0809 09:27:22.063173 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:22.063216 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 09:27:22.063393 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:27:22.063722 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:27:22.063727 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:27:22.064026 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:27:22.064180 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:22.064189 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.064969 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.064975 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:22.065644 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:22.065653 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.066128 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.066132 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:22.066253 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:22.066957 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:27:22.066970 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:27:22.068447 (+ 1477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:27:22.070272 (+ 1825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:22.070281 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:22.070289 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:22.070601 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:22.070934 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:22.070938 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:22.070940 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:22.071074 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:22.071480 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:27:22.071485 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:27:22.071701 (+ 216us) client_negotiation.cc:769] Sending connection context
0809 09:27:22.071882 (+ 181us) client_negotiation.cc:240] Negotiation successful
0809 09:27:22.072148 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":132,"threads_started":1}
I20260809 09:27:22.073004 3989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:22.061057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39952 (local address 127.11.99.252:45125)
0809 09:27:22.061441 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:22.061457 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:22.061529 (+ 72us) server_negotiation.cc:407] Connection header received
0809 09:27:22.062257 (+ 728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:22.062273 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:22.062575 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:22.062987 (+ 412us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:22.063949 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.064883 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.065704 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.066055 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.066214 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:22.069043 (+ 2829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:22.069053 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:22.069067 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:22.069106 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:22.070753 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:22.071174 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:22.071179 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:22.071181 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:22.071269 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:22.071523 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:22.071528 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:22.071529 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:22.071765 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:22.071958 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:22.072184 (+ 226us) server_negotiation.cc:299] Negotiation successful
0809 09:27:22.072335 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":124,"threads_started":1}
I20260809 09:27:22.074059 3986 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.253" port: 37491 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 09:27:22 dist-test-slave-pgkr krb5kdc[3738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267642, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.252@KRBTEST.COM for kudu/127.11.99.253@KRBTEST.COM
Aug 09 09:27:22 dist-test-slave-pgkr krb5kdc[3738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.254@KRBTEST.COM
I20260809 09:27:22.082139 3990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:22.074508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.253:37491 (local address 127.0.0.1:50518)
0809 09:27:22.074745 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:22.074759 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 09:27:22.074826 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:27:22.075290 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:27:22.075292 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:27:22.075411 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:27:22.075489 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:22.075493 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.076181 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.076187 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:22.076668 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:22.076675 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.077138 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.077141 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:22.077228 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:22.077639 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:27:22.077651 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:27:22.079035 (+ 1384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:27:22.080706 (+ 1671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:22.080710 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:22.080713 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:22.080919 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:22.081194 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:22.081198 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:22.081200 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:22.081315 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:22.081697 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:27:22.081699 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:27:22.081804 (+ 105us) client_negotiation.cc:769] Sending connection context
0809 09:27:22.081907 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 09:27:22.082036 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170}
I20260809 09:27:22.082239 3911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:22.074715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50518 (local address 127.11.99.253:37491)
0809 09:27:22.074839 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:22.074847 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:22.074861 (+ 14us) server_negotiation.cc:407] Connection header received
0809 09:27:22.074918 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:22.074920 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:22.074976 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:22.075062 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:22.075609 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.076072 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.076816 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.077039 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.077138 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:22.079165 (+ 2027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:22.079171 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:22.079175 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:22.079201 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:22.080592 (+ 1391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:22.081022 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:22.081026 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:22.081028 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:22.081109 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:22.081407 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:22.081409 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:22.081410 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:22.081602 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:22.081697 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:22.081978 (+ 281us) server_negotiation.cc:299] Negotiation successful
0809 09:27:22.082090 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 09:27:22.083012 3828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:22.075124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40758 (local address 127.11.99.254:34573)
0809 09:27:22.075229 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:22.075231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:22.075242 (+ 11us) server_negotiation.cc:407] Connection header received
0809 09:27:22.075351 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:22.075354 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:22.075392 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:22.075484 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:22.076031 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.076468 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.077200 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.077404 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.077505 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:22.079910 (+ 2405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:22.079914 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:22.079916 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:22.079938 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:22.081215 (+ 1277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:22.081636 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:22.081641 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:22.081645 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:22.081724 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:22.081996 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:22.081998 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:22.082000 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:22.082197 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:22.082399 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:22.082752 (+ 353us) server_negotiation.cc:299] Negotiation successful
0809 09:27:22.082859 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 09:27:22.083149 3986 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 09:27:22 dist-test-slave-pgkr krb5kdc[3738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267642, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.252@KRBTEST.COM for kudu/127.11.99.252@KRBTEST.COM
Aug 09 09:27:22 dist-test-slave-pgkr krb5kdc[3738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.99.253@KRBTEST.COM
I20260809 09:27:22.090884 3990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:22.083627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:45125 (local address 127.0.0.1:39964)
0809 09:27:22.083745 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:22.083758 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:27:22.083825 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:27:22.084016 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:27:22.084018 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:27:22.084174 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:27:22.084267 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:22.084275 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.085081 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.085085 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:22.085604 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:22.085613 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.086069 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.086072 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:22.086144 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:22.086508 (+ 364us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:27:22.086520 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:27:22.087855 (+ 1335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:27:22.089540 (+ 1685us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:22.089543 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:22.089545 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:22.089721 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:22.089978 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:22.089982 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:22.089984 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:22.090059 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:22.090419 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:27:22.090421 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:27:22.090490 (+ 69us) client_negotiation.cc:769] Sending connection context
0809 09:27:22.090597 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 09:27:22.090747 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 09:27:22.090906 3989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:22.083677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39964 (local address 127.11.99.252:45125)
0809 09:27:22.083798 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:22.083801 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:22.083814 (+ 13us) server_negotiation.cc:407] Connection header received
0809 09:27:22.083888 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:22.083891 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:22.083927 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:22.083996 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:22.084391 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.084976 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.085722 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.085956 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.086046 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:22.087968 (+ 1922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:22.087976 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:22.087977 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:22.087994 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:22.089428 (+ 1434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:22.089816 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:22.089821 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:22.089823 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:22.089893 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:22.090153 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:22.090156 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:22.090158 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:22.090334 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:22.090428 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:22.090680 (+ 252us) server_negotiation.cc:299] Negotiation successful
0809 09:27:22.090797 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":61}
I20260809 09:27:22.091988 3911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:22.084326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50532 (local address 127.11.99.253:37491)
0809 09:27:22.084460 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:22.084463 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:22.084475 (+ 12us) server_negotiation.cc:407] Connection header received
0809 09:27:22.084505 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:22.084508 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:22.084566 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:22.084643 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:22.085205 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.085621 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.086490 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.086743 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.086816 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:22.088943 (+ 2127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:22.088947 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:22.088949 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:22.088970 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:22.090316 (+ 1346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:22.090737 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:22.090740 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:22.090741 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:22.090815 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:22.091088 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:22.091091 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:22.091092 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:22.091303 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:22.091464 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:22.091661 (+ 197us) server_negotiation.cc:299] Negotiation successful
0809 09:27:22.091865 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 09:27:22.093784 3905 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } attempt: 3
I20260809 09:27:22.094528 3986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb462531b67d49dbaed7889e11a19e4d: Bootstrap starting.
I20260809 09:27:22.097170 3986 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb462531b67d49dbaed7889e11a19e4d: Neither blocks nor log segments found. Creating new log.
I20260809 09:27:22.098044 3986 log.cc:824] T 00000000000000000000000000000000 P eb462531b67d49dbaed7889e11a19e4d: Log is configured to *not* fsync() on all Append() calls
Aug 09 09:27:22 dist-test-slave-pgkr krb5kdc[3738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267641, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.253@KRBTEST.COM for kudu/127.11.99.252@KRBTEST.COM
I20260809 09:27:22.099814 11663 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 09:27:22.100428 3986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb462531b67d49dbaed7889e11a19e4d: No bootstrap required, opened a new log
I20260809 09:27:22.102011 3907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:22.094177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:45125 (local address 127.0.0.1:39972)
0809 09:27:22.094336 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:22.094349 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:27:22.094430 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:27:22.094677 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:27:22.094680 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:27:22.094843 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:27:22.094926 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:22.094933 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.095638 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.095643 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:22.096409 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:22.096420 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.096840 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.096843 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:22.096918 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:22.097316 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:27:22.097332 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:27:22.098583 (+ 1251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:27:22.100471 (+ 1888us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:22.100475 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:22.100477 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:22.100732 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:22.101018 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:22.101021 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:22.101023 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:22.101115 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:22.101554 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:27:22.101557 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:27:22.101645 (+ 88us) client_negotiation.cc:769] Sending connection context
0809 09:27:22.101749 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 09:27:22.101869 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102}
I20260809 09:27:22.100930 3796 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "c5716666a1554a7e868db3a7c14b2c9c"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40758
I20260809 09:27:22.102293 3989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:22.094238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39972 (local address 127.11.99.252:45125)
0809 09:27:22.094340 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:22.094344 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:22.094391 (+ 47us) server_negotiation.cc:407] Connection header received
0809 09:27:22.094505 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:22.094507 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:22.094539 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:22.094598 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:22.095056 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.095521 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.096529 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.096733 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.096810 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:22.098739 (+ 1929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:22.098742 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:22.098744 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:22.098769 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:22.100362 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:22.100832 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:22.100835 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:22.100836 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:22.100917 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:22.101217 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:22.101220 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:22.101221 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:22.101440 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:22.101542 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:22.101817 (+ 275us) server_negotiation.cc:299] Negotiation successful
0809 09:27:22.101920 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 09:27:22.103991 3986 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb462531b67d49dbaed7889e11a19e4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5716666a1554a7e868db3a7c14b2c9c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34573 } } peers { permanent_uuid: "1366167f92154bc48043c549688bf9a6" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 37491 } } peers { permanent_uuid: "eb462531b67d49dbaed7889e11a19e4d" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } }
I20260809 09:27:22.104169 3986 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb462531b67d49dbaed7889e11a19e4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb462531b67d49dbaed7889e11a19e4d, State: Initialized, Role: FOLLOWER
I20260809 09:27:22.104400 3986 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb462531b67d49dbaed7889e11a19e4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5716666a1554a7e868db3a7c14b2c9c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34573 } } peers { permanent_uuid: "1366167f92154bc48043c549688bf9a6" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 37491 } } peers { permanent_uuid: "eb462531b67d49dbaed7889e11a19e4d" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } }
I20260809 09:27:22.104789 3992 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb462531b67d49dbaed7889e11a19e4d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5716666a1554a7e868db3a7c14b2c9c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34573 } } peers { permanent_uuid: "1366167f92154bc48043c549688bf9a6" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 37491 } } peers { permanent_uuid: "eb462531b67d49dbaed7889e11a19e4d" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } } }
I20260809 09:27:22.104904 3992 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb462531b67d49dbaed7889e11a19e4d [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:27:22.105170 3905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1366167f92154bc48043c549688bf9a6: Bootstrap starting.
I20260809 09:27:22.105517 3986 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb462531b67d49dbaed7889e11a19e4d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:27:22.107685 3905 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1366167f92154bc48043c549688bf9a6: Neither blocks nor log segments found. Creating new log.
I20260809 09:27:22.108487 3905 log.cc:824] T 00000000000000000000000000000000 P 1366167f92154bc48043c549688bf9a6: Log is configured to *not* fsync() on all Append() calls
I20260809 09:27:22.108975 3824 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } attempt: 3
I20260809 09:27:22.110491 3905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1366167f92154bc48043c549688bf9a6: No bootstrap required, opened a new log
I20260809 09:27:22.109095 3913 master_runner.cc:186] Error getting master registration for 127.11.99.254:34573: OK, instance_id { permanent_uuid: "c5716666a1554a7e868db3a7c14b2c9c" instance_seqno: 1786267641646566 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 09:27:22.113204 3913 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 09:27:22.114482 4003 catalog_manager.cc:1558] T 00000000000000000000000000000000 P eb462531b67d49dbaed7889e11a19e4d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 09:27:22.114571 4003 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 09 09:27:22 dist-test-slave-pgkr krb5kdc[3738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786267641, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.99.254@KRBTEST.COM for kudu/127.11.99.252@KRBTEST.COM
I20260809 09:27:22.114740 3905 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1366167f92154bc48043c549688bf9a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5716666a1554a7e868db3a7c14b2c9c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34573 } } peers { permanent_uuid: "1366167f92154bc48043c549688bf9a6" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 37491 } } peers { permanent_uuid: "eb462531b67d49dbaed7889e11a19e4d" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } }
I20260809 09:27:22.114939 3905 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1366167f92154bc48043c549688bf9a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1366167f92154bc48043c549688bf9a6, State: Initialized, Role: FOLLOWER
I20260809 09:27:22.115247 3905 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1366167f92154bc48043c549688bf9a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5716666a1554a7e868db3a7c14b2c9c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34573 } } peers { permanent_uuid: "1366167f92154bc48043c549688bf9a6" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 37491 } } peers { permanent_uuid: "eb462531b67d49dbaed7889e11a19e4d" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } }
I20260809 09:27:22.115762 4006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1366167f92154bc48043c549688bf9a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5716666a1554a7e868db3a7c14b2c9c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34573 } } peers { permanent_uuid: "1366167f92154bc48043c549688bf9a6" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 37491 } } peers { permanent_uuid: "eb462531b67d49dbaed7889e11a19e4d" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } } }
I20260809 09:27:22.115903 4006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1366167f92154bc48043c549688bf9a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:27:22.116504 3905 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1366167f92154bc48043c549688bf9a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:27:22.118496 3989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:22.109761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39974 (local address 127.11.99.252:45125)
0809 09:27:22.109856 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:22.109859 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:22.109870 (+ 11us) server_negotiation.cc:407] Connection header received
0809 09:27:22.109900 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:22.109902 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:22.109940 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:22.110005 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:22.110545 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.111293 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.112435 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.112738 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.112836 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:22.115179 (+ 2343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:22.115182 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:22.115185 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:22.115207 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:22.116824 (+ 1617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:22.117288 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:22.117292 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:22.117295 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:22.117382 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:22.117697 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:22.117701 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:22.117705 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:22.117915 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:22.117999 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:22.118276 (+ 277us) server_negotiation.cc:299] Negotiation successful
0809 09:27:22.118370 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 09:27:22.118496 3827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:22.109328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.99.252:45125 (local address 127.0.0.1:39974)
0809 09:27:22.109538 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0809 09:27:22.109551 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 09:27:22.109622 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 09:27:22.110102 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 09:27:22.110105 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 09:27:22.110306 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0809 09:27:22.110404 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:22.110410 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.111434 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.111437 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:22.112297 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 09:27:22.112309 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.112951 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.112954 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 09:27:22.113036 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:22.113528 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 09:27:22.113542 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 09:27:22.115025 (+ 1483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 09:27:22.116921 (+ 1896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:22.116924 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:22.116926 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:22.117180 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:22.117485 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 09:27:22.117488 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 09:27:22.117490 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 09:27:22.117599 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 09:27:22.117999 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 09:27:22.118003 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 09:27:22.118117 (+ 114us) client_negotiation.cc:769] Sending connection context
0809 09:27:22.118218 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 09:27:22.118358 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142}
I20260809 09:27:22.121377 3824 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c: Bootstrap starting.
W20260809 09:27:22.121505 4020 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1366167f92154bc48043c549688bf9a6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 09:27:22.121594 4020 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 09:27:22.119796 3831 master_runner.cc:186] Error getting master registration for 127.11.99.254:34573: OK, instance_id { permanent_uuid: "c5716666a1554a7e868db3a7c14b2c9c" instance_seqno: 1786267641646566 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 09:27:22.123209 3831 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 09:27:22.124423 3824 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c: Neither blocks nor log segments found. Creating new log.
I20260809 09:27:22.125643 3824 log.cc:824] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c: Log is configured to *not* fsync() on all Append() calls
I20260809 09:27:22.128479 3824 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c: No bootstrap required, opened a new log
I20260809 09:27:22.132798 3824 raft_consensus.cc:348] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5716666a1554a7e868db3a7c14b2c9c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34573 } } peers { permanent_uuid: "1366167f92154bc48043c549688bf9a6" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 37491 } } peers { permanent_uuid: "eb462531b67d49dbaed7889e11a19e4d" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } }
I20260809 09:27:22.133126 3824 raft_consensus.cc:729] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5716666a1554a7e868db3a7c14b2c9c, State: Initialized, Role: FOLLOWER
I20260809 09:27:22.133669 3824 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5716666a1554a7e868db3a7c14b2c9c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34573 } } peers { permanent_uuid: "1366167f92154bc48043c549688bf9a6" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 37491 } } peers { permanent_uuid: "eb462531b67d49dbaed7889e11a19e4d" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } }
I20260809 09:27:22.134292 4024 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5716666a1554a7e868db3a7c14b2c9c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34573 } } peers { permanent_uuid: "1366167f92154bc48043c549688bf9a6" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 37491 } } peers { permanent_uuid: "eb462531b67d49dbaed7889e11a19e4d" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } } }
I20260809 09:27:22.134457 4024 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:27:22.135561 3796 raft_consensus.cc:482] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 09:27:22.135674 3796 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:27:22.136852 3796 raft_consensus.cc:504] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5716666a1554a7e868db3a7c14b2c9c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34573 } } peers { permanent_uuid: "1366167f92154bc48043c549688bf9a6" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 37491 } } peers { permanent_uuid: "eb462531b67d49dbaed7889e11a19e4d" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } }
I20260809 09:27:22.137753 3796 leader_election.cc:288] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c [CANDIDATE]: Term 1 election: Requested vote from peers 1366167f92154bc48043c549688bf9a6 (127.11.99.253:37491), eb462531b67d49dbaed7889e11a19e4d (127.11.99.252:45125)
I20260809 09:27:22.138731 3879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c5716666a1554a7e868db3a7c14b2c9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "1366167f92154bc48043c549688bf9a6"
I20260809 09:27:22.138957 3879 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1366167f92154bc48043c549688bf9a6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:27:22.138924 3957 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c5716666a1554a7e868db3a7c14b2c9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "eb462531b67d49dbaed7889e11a19e4d"
I20260809 09:27:22.139149 3957 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb462531b67d49dbaed7889e11a19e4d [term 0 FOLLOWER]: Advancing to term 1
I20260809 09:27:22.140180 3879 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1366167f92154bc48043c549688bf9a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5716666a1554a7e868db3a7c14b2c9c in term 1.
I20260809 09:27:22.140476 3957 raft_consensus.cc:2454] T 00000000000000000000000000000000 P eb462531b67d49dbaed7889e11a19e4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5716666a1554a7e868db3a7c14b2c9c in term 1.
I20260809 09:27:22.140592 3771 leader_election.cc:302] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1366167f92154bc48043c549688bf9a6, c5716666a1554a7e868db3a7c14b2c9c; no voters:
I20260809 09:27:22.140738 3824 sys_catalog.cc:564] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 09:27:22.141155 4024 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 09:27:22.141377 4024 raft_consensus.cc:686] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c [term 1 LEADER]: Becoming Leader. State: Replica: c5716666a1554a7e868db3a7c14b2c9c, State: Running, Role: LEADER
I20260809 09:27:22.141665 4024 consensus_queue.cc:237] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5716666a1554a7e868db3a7c14b2c9c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34573 } } peers { permanent_uuid: "1366167f92154bc48043c549688bf9a6" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 37491 } } peers { permanent_uuid: "eb462531b67d49dbaed7889e11a19e4d" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } }
W20260809 09:27:22.143184 3773 tablet.cc:2369] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 09:27:22.143349 4024 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5716666a1554a7e868db3a7c14b2c9c. Latest consensus state: current_term: 1 leader_uuid: "c5716666a1554a7e868db3a7c14b2c9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5716666a1554a7e868db3a7c14b2c9c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34573 } } peers { permanent_uuid: "1366167f92154bc48043c549688bf9a6" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 37491 } } peers { permanent_uuid: "eb462531b67d49dbaed7889e11a19e4d" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } } }
I20260809 09:27:22.143441 4024 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:22.144280 4044 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 09:27:22.148972 4044 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 09:27:22.154891 3957 raft_consensus.cc:1261] T 00000000000000000000000000000000 P eb462531b67d49dbaed7889e11a19e4d [term 1 FOLLOWER]: Refusing update from remote peer c5716666a1554a7e868db3a7c14b2c9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:27:22.155661 3879 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1366167f92154bc48043c549688bf9a6 [term 1 FOLLOWER]: Refusing update from remote peer c5716666a1554a7e868db3a7c14b2c9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 09:27:22.156283 4030 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb462531b67d49dbaed7889e11a19e4d" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:27:22.156466 4024 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1366167f92154bc48043c549688bf9a6" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 37491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 09:27:22.160274 4006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1366167f92154bc48043c549688bf9a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5716666a1554a7e868db3a7c14b2c9c. Latest consensus state: current_term: 1 leader_uuid: "c5716666a1554a7e868db3a7c14b2c9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5716666a1554a7e868db3a7c14b2c9c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34573 } } peers { permanent_uuid: "1366167f92154bc48043c549688bf9a6" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 37491 } } peers { permanent_uuid: "eb462531b67d49dbaed7889e11a19e4d" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } } }
I20260809 09:27:22.160391 4006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1366167f92154bc48043c549688bf9a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:27:22.160897 3992 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb462531b67d49dbaed7889e11a19e4d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5716666a1554a7e868db3a7c14b2c9c. Latest consensus state: current_term: 1 leader_uuid: "c5716666a1554a7e868db3a7c14b2c9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5716666a1554a7e868db3a7c14b2c9c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34573 } } peers { permanent_uuid: "1366167f92154bc48043c549688bf9a6" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 37491 } } peers { permanent_uuid: "eb462531b67d49dbaed7889e11a19e4d" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } } }
I20260809 09:27:22.161034 3992 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb462531b67d49dbaed7889e11a19e4d [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:27:22.161724 3911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:22.151423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50538 (local address 127.11.99.253:37491)
0809 09:27:22.151542 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:22.151546 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:22.152108 (+ 562us) server_negotiation.cc:407] Connection header received
0809 09:27:22.152283 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:22.152286 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:22.152328 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:22.152374 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:22.153227 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.153891 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.156164 (+ 2273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.156451 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.156520 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:22.158124 (+ 1604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:22.158128 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:22.158130 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:22.158152 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:22.159694 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:22.160175 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:22.160180 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:22.160182 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:22.160272 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:22.160662 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:22.160666 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:22.160667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:22.160886 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:22.161006 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:22.161454 (+ 448us) server_negotiation.cc:299] Negotiation successful
0809 09:27:22.161581 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 09:27:22.167440 3828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:22.151001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40766 (local address 127.11.99.254:34573)
0809 09:27:22.151103 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:22.151107 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:22.151824 (+ 717us) server_negotiation.cc:407] Connection header received
0809 09:27:22.151936 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:22.151938 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:22.151983 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:22.152056 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:22.152970 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.153729 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.154932 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.155281 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.155349 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:22.162106 (+ 6757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:22.162110 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:22.162113 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:22.162138 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:22.164384 (+ 2246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:22.166053 (+ 1669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:22.166057 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:22.166059 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:22.166147 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:22.166450 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:22.166453 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:22.166455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:22.166689 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:22.166801 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:22.167149 (+ 348us) server_negotiation.cc:299] Negotiation successful
0809 09:27:22.167290 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 09:27:22.168828 3989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:22.155027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39982 (local address 127.11.99.252:45125)
0809 09:27:22.155131 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:22.155135 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:22.160373 (+ 5238us) server_negotiation.cc:407] Connection header received
0809 09:27:22.160545 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:22.160548 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:22.160601 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:22.160655 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:22.161491 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.162172 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.163357 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:22.163691 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:22.163775 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:22.165354 (+ 1579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 09:27:22.165358 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 09:27:22.165361 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 09:27:22.165385 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 09:27:22.167066 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:22.167561 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:22.167566 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:22.167569 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:22.167660 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 09:27:22.167956 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 09:27:22.167959 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 09:27:22.167961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 09:27:22.168162 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 09:27:22.168254 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:22.168595 (+ 341us) server_negotiation.cc:299] Negotiation successful
0809 09:27:22.168701 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 09:27:22.169736 4048 mvcc.cc:205] Tried to move back new op lower bound from 7316552262258458624 to 7316552262215634944. Current Snapshot: MvccSnapshot[applied={T|T < 7316552262258458624}]
I20260809 09:27:22.170179 4024 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c5716666a1554a7e868db3a7c14b2c9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5716666a1554a7e868db3a7c14b2c9c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34573 } } peers { permanent_uuid: "1366167f92154bc48043c549688bf9a6" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 37491 } } peers { permanent_uuid: "eb462531b67d49dbaed7889e11a19e4d" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } } }
I20260809 09:27:22.170301 4024 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:22.171265 4006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1366167f92154bc48043c549688bf9a6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c5716666a1554a7e868db3a7c14b2c9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5716666a1554a7e868db3a7c14b2c9c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34573 } } peers { permanent_uuid: "1366167f92154bc48043c549688bf9a6" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 37491 } } peers { permanent_uuid: "eb462531b67d49dbaed7889e11a19e4d" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } } }
I20260809 09:27:22.171361 4006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1366167f92154bc48043c549688bf9a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:27:22.172223 4053 mvcc.cc:205] Tried to move back new op lower bound from 7316552262258458624 to 7316552262215634944. Current Snapshot: MvccSnapshot[applied={T|T < 7316552262258458624}]
I20260809 09:27:22.175575 4024 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c5716666a1554a7e868db3a7c14b2c9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5716666a1554a7e868db3a7c14b2c9c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34573 } } peers { permanent_uuid: "1366167f92154bc48043c549688bf9a6" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 37491 } } peers { permanent_uuid: "eb462531b67d49dbaed7889e11a19e4d" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } } }
I20260809 09:27:22.175688 4024 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c [sys.catalog]: This master's current role is: LEADER
I20260809 09:27:22.176198 4044 catalog_manager.cc:1347] Generated new cluster ID: 1601d4e653f840719a77db11c3e18263
I20260809 09:27:22.176259 4044 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 09:27:22.176754 3992 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb462531b67d49dbaed7889e11a19e4d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c5716666a1554a7e868db3a7c14b2c9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5716666a1554a7e868db3a7c14b2c9c" member_type: VOTER last_known_addr { host: "127.11.99.254" port: 34573 } } peers { permanent_uuid: "1366167f92154bc48043c549688bf9a6" member_type: VOTER last_known_addr { host: "127.11.99.253" port: 37491 } } peers { permanent_uuid: "eb462531b67d49dbaed7889e11a19e4d" member_type: VOTER last_known_addr { host: "127.11.99.252" port: 45125 } } }
I20260809 09:27:22.176863 3992 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb462531b67d49dbaed7889e11a19e4d [sys.catalog]: This master's current role is: FOLLOWER
I20260809 09:27:22.177500 4051 mvcc.cc:205] Tried to move back new op lower bound from 7316552262258458624 to 7316552262215634944. Current Snapshot: MvccSnapshot[applied={T|T < 7316552262258458624}]
I20260809 09:27:22.191672 4044 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 09:27:22.192791 4044 catalog_manager.cc:1504] Loading token signing keys...
I20260809 09:27:22.211660 4044 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c5716666a1554a7e868db3a7c14b2c9c: Generated new TSK 0
I20260809 09:27:22.212476 4044 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 09:27:22.252436 3989 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:27:22.249129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39998 (local address 127.11.99.252:45125)
0809 09:27:22.249265 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:22.249270 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:22.251158 (+ 1888us) server_negotiation.cc:407] Connection header received
0809 09:27:22.251575 (+ 417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:22.251579 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:22.251628 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:22.251677 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:22.252307 (+ 630us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39998: BlockingRecv error: recv got EOF from 127.0.0.1:39998 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260809 09:27:22.253655 3828 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:27:22.249652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40772 (local address 127.11.99.254:34573)
0809 09:27:22.249769 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:22.249773 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:22.251379 (+ 1606us) server_negotiation.cc:407] Connection header received
0809 09:27:22.252889 (+ 1510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:22.252892 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:22.252940 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:22.252987 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:22.253529 (+ 542us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40772: BlockingRecv error: recv got EOF from 127.0.0.1:40772 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260809 09:27:22.255333 3911 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:27:22.250574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50542 (local address 127.11.99.253:37491)
0809 09:27:22.250708 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:22.250712 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:22.254244 (+ 3532us) server_negotiation.cc:407] Connection header received
0809 09:27:22.254618 (+ 374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:22.254621 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:22.254701 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:22.254761 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:22.255225 (+ 464us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50542: BlockingRecv error: recv got EOF from 127.0.0.1:50542 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260809 09:27:22.259685 3911 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:27:22.258222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50546 (local address 127.11.99.253:37491)
0809 09:27:22.258322 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:22.258326 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:22.258810 (+ 484us) server_negotiation.cc:407] Connection header received
0809 09:27:22.259016 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:22.259019 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:22.259085 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:22.259137 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:22.259610 (+ 473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50546: BlockingRecv error: recv got EOF from 127.0.0.1:50546 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260809 09:27:22.264494 3911 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:27:22.263038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50562 (local address 127.11.99.253:37491)
0809 09:27:22.263130 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:22.263133 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:22.263624 (+ 491us) server_negotiation.cc:407] Connection header received
0809 09:27:22.263828 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:22.263832 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:22.263875 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:22.263952 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:22.264411 (+ 459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50562: BlockingRecv error: recv got EOF from 127.0.0.1:50562 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260809 09:27:22.269847 3911 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:27:22.268387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50572 (local address 127.11.99.253:37491)
0809 09:27:22.268474 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:22.268478 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:22.268981 (+ 503us) server_negotiation.cc:407] Connection header received
0809 09:27:22.269164 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:22.269168 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:22.269227 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:22.269284 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:22.269767 (+ 483us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50572: BlockingRecv error: recv got EOF from 127.0.0.1:50572 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
W20260809 09:27:22.277227 3911 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:27:22.275825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50578 (local address 127.11.99.253:37491)
0809 09:27:22.275942 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:22.275945 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:22.276427 (+ 482us) server_negotiation.cc:407] Connection header received
0809 09:27:22.276584 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:22.276587 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:22.276626 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:22.276670 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:22.277146 (+ 476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50578: BlockingRecv error: recv got EOF from 127.0.0.1:50578 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260809 09:27:22.288918 3911 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:27:22.287223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50592 (local address 127.11.99.253:37491)
0809 09:27:22.287332 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:22.287336 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:22.288009 (+ 673us) server_negotiation.cc:407] Connection header received
0809 09:27:22.288210 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:22.288216 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:22.288263 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:22.288314 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:22.288824 (+ 510us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50592: BlockingRecv error: recv got EOF from 127.0.0.1:50592 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260809 09:27:22.308933 3911 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:27:22.307370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50594 (local address 127.11.99.253:37491)
0809 09:27:22.307479 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:22.307483 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:22.308043 (+ 560us) server_negotiation.cc:407] Connection header received
0809 09:27:22.308221 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:22.308224 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:22.308273 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:22.308321 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:22.308811 (+ 490us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50594: BlockingRecv error: recv got EOF from 127.0.0.1:50594 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260809 09:27:22.344904 3911 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:27:22.343407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50608 (local address 127.11.99.253:37491)
0809 09:27:22.343567 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:22.343574 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:22.343800 (+ 226us) server_negotiation.cc:407] Connection header received
0809 09:27:22.343971 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:22.343975 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:22.344040 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:22.344133 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:22.344722 (+ 589us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50608: BlockingRecv error: recv got EOF from 127.0.0.1:50608 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260809 09:27:22.412205 3911 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:27:22.410956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50612 (local address 127.11.99.253:37491)
0809 09:27:22.411130 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:22.411135 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:22.411300 (+ 165us) server_negotiation.cc:407] Connection header received
0809 09:27:22.411473 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:22.411477 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:22.411534 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:22.411627 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:22.412086 (+ 459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50612: BlockingRecv error: recv got EOF from 127.0.0.1:50612 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260809 09:27:22.543637 3911 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:27:22.542410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50620 (local address 127.11.99.253:37491)
0809 09:27:22.542567 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:22.542572 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:22.542834 (+ 262us) server_negotiation.cc:407] Connection header received
0809 09:27:22.542940 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:22.542942 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:22.542992 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:22.543064 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:22.543507 (+ 443us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50620: BlockingRecv error: recv got EOF from 127.0.0.1:50620 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260809 09:27:22.803186 3911 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 09:27:22.802021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50632 (local address 127.11.99.253:37491)
0809 09:27:22.802160 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:22.802164 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:22.802251 (+ 87us) server_negotiation.cc:407] Connection header received
0809 09:27:22.802431 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:22.802433 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:22.802482 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:22.802545 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 09:27:22.803050 (+ 505us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50632: BlockingRecv error: recv got EOF from 127.0.0.1:50632 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 09:27:23.115968 4003 catalog_manager.cc:1259] Loaded cluster ID: 1601d4e653f840719a77db11c3e18263
I20260809 09:27:23.116055 4003 catalog_manager.cc:1552] T 00000000000000000000000000000000 P eb462531b67d49dbaed7889e11a19e4d: loading cluster ID for follower catalog manager: success
I20260809 09:27:23.118235 4003 catalog_manager.cc:1574] T 00000000000000000000000000000000 P eb462531b67d49dbaed7889e11a19e4d: acquiring CA information for follower catalog manager: success
I20260809 09:27:23.119445 4003 catalog_manager.cc:1602] T 00000000000000000000000000000000 P eb462531b67d49dbaed7889e11a19e4d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 09:27:23.122700 4020 catalog_manager.cc:1259] Loaded cluster ID: 1601d4e653f840719a77db11c3e18263
I20260809 09:27:23.122772 4020 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1366167f92154bc48043c549688bf9a6: loading cluster ID for follower catalog manager: success
I20260809 09:27:23.124264 4020 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1366167f92154bc48043c549688bf9a6: acquiring CA information for follower catalog manager: success
I20260809 09:27:23.125262 4020 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1366167f92154bc48043c549688bf9a6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 09:27:23.321424 4130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:23.317484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50644 (local address 127.11.99.253:37491)
0809 09:27:23.317793 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:23.317797 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:23.317901 (+ 104us) server_negotiation.cc:407] Connection header received
0809 09:27:23.318061 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:23.318064 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:23.318234 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:23.318356 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:27:23.318679 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:23.319192 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:23.320044 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:23.320256 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:23.320331 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:23.320600 (+ 269us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:27:23.321026 (+ 426us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:27:23.321116 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:23.321182 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 09:27:23.321229 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":85,"threads_started":1}
I20260809 09:27:23.327548 4136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:23.324338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40012 (local address 127.11.99.252:45125)
0809 09:27:23.324547 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:23.324550 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:23.324564 (+ 14us) server_negotiation.cc:407] Connection header received
0809 09:27:23.324706 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:23.324709 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:23.324809 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:23.324902 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:27:23.325087 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:23.325590 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:23.326320 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:23.326525 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:23.326594 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:23.326876 (+ 282us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:27:23.327242 (+ 366us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:27:23.327322 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:23.327380 (+ 58us) server_negotiation.cc:299] Negotiation successful
0809 09:27:23.327419 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":78,"threads_started":1}
I20260809 09:27:23.334053 4136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:23.330533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40020 (local address 127.11.99.252:45125)
0809 09:27:23.330681 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:23.330685 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:23.330700 (+ 15us) server_negotiation.cc:407] Connection header received
0809 09:27:23.330811 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:23.330814 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:23.330855 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:23.330962 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:27:23.331173 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:23.331840 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:23.333013 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:23.333285 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:23.333373 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:23.333620 (+ 247us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:27:23.333685 (+ 65us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:27:23.333745 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:23.333885 (+ 140us) server_negotiation.cc:299] Negotiation successful
0809 09:27:23.333930 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 09:27:23.334784 4143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:23.330368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40774 (local address 127.11.99.254:34573)
0809 09:27:23.330858 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:23.330862 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:23.330886 (+ 24us) server_negotiation.cc:407] Connection header received
0809 09:27:23.330971 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:23.330975 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:23.331123 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:23.331255 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:27:23.331475 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:23.332305 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:23.333209 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:23.333530 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:23.333634 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:23.334033 (+ 399us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:27:23.334385 (+ 352us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:27:23.334485 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:23.334571 (+ 86us) server_negotiation.cc:299] Negotiation successful
0809 09:27:23.334642 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":71,"threads_started":1}
I20260809 09:27:23.335134 4130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 09:27:23.330718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50660 (local address 127.11.99.253:37491)
0809 09:27:23.330821 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0809 09:27:23.330824 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 09:27:23.331345 (+ 521us) server_negotiation.cc:407] Connection header received
0809 09:27:23.331512 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 09:27:23.331514 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 09:27:23.331593 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 09:27:23.331674 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 09:27:23.331988 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:23.332748 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:23.333758 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 09:27:23.334046 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 09:27:23.334147 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 09:27:23.334523 (+ 376us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 09:27:23.334601 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 09:27:23.334675 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 09:27:23.334938 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 09:27:23.334988 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 09:27:23.337744 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 3751
I20260809 09:27:23.346446 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 3831
I20260809 09:27:23.353123 11663 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskv_EQJC/build/debug/bin/kudu with pid 3913
2026-08-09T09:27:23Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3043 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6083 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (280287 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST